My Virtual Session Cloud Lunch and Learn Marathon

My Virtual Session Cloud Lunch and Learn Marathon

by | May 13, 2021 | Events, Microsoft

Cloud Lunch and Learn Marathon 2021

This Thursday May 13th 2021 I've been speaking during Cloud Lunch and Learn Marathon 2021. It was the first Cloud Lunch and Learn Marathon conference, more then 1200 registered attendees, 24hours Live and pre recorded sessions. Amazing.  A big compliment to the organizers and thank you for having me.

You can still watch the sessions online:

Live on Youtube

(169) Cloud Lunch and Learn - YouTube

Live on twitch

CloudLunchLearn - Twitch

Azure Synapse Analytics

I presented a session on if there is a way that we can build our Azure Synapse Pipelines all with parameters based on MetaData?

Code from my demos can be found here.

You can find my slides below on Slideshare:

In case you have any questions left please feel free to ask them via the comment or Socials.

Scottisch Summit 2021(Video)

Scottisch Summit 2021(Video)

by | Mar 8, 2021 | Events

Metadata

Recording of my session during Scottisch Summit 2021

Is there a way that we can build our Azure DataFactory all with parameters based on MetaData?

Scottisch Summit 2021(Video)

My Virtual Session Scottish Summit 2021

by | Feb 27, 2021 | Events

Scottisch Summit 2021

This Saturday I've been speaking during Scottisch Summit 2021. It was my first Summit, but is was a great event, with more than  400 sessions covering the full Microsoft Stack in 7 different language English, Spanish, German, French, Italian, Portuguese and Polish. Proud that I was to able to join and to present.

Azure Data Factory

I presented a session on if there is a way that we can build our Azure Data Factory all with parameters based on MetaData?

In the beginning of my sessions the audio wasn't that well. I just double checked my uploaded recording and in there audio was fine.

You can watch the recording of my session Scottisch Summit 2021

Code from my demos can be found here.

You can find my slides below on Slideshare:

In case you have any questions left please feel free to ask them via the comment or Socials.

ADF: Get Metadata Activity stopped working

ADF: Get Metadata Activity stopped working

by | Jul 1, 2019 | Azure, Azure Data Factory

Metadata

by Erwin | Jul 1, 2019

Meta Data Activity

Today my pipelines in Azure Data Factory (ADF) suddenly stopped working. The output structure was not found. Quit strange while these pipelines have been running for weeks.

 

 

Invalid Template

After debugging my Pipeline I found out the output.structure couldn't be evaluated.

ADF METADATA Error

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

Field List

I don't know when this option was added, but if you open the Get Metadata Activity you will find under Dataset the option Field List

ADF METADATA Error field list

 

 

 

 

 

 

 

The only thing I needed to do get my previous output back was adding structure as an argument. The structure will take care of the Metadata of my table and will be used in the Copy Data Activity.

ADF METADATA Structure

 

 

 

 

 

 

 

 

After rerunning my Pipeline the error was gone.ADF METADATA working

 

 

 

 

 

 

 

 

I changed all my pipelines and the processes where running fine again. I took me bit to find out what the exact error was.

 

Hopefully it will save you some time after reading this blog.

More about the Get Metadata Activity can be found here .

Feel free to leave a comment