My 2023: A Year of Learning, Sharing and Growing

My 2023: A Year of Learning, Sharing and Growing

Divers

by Erwin | Jan 2, 2024

by Erwin | Jan 2, 2024

As the year 2023 comes to an end, I want to take a moment to reflect on some of the amazing experiences I had in the past 12 months. It was a year full of learning, sharing and growing, both professionally and personally. I had the opportunity to attend, speak and help at various events, meet new people, visit new places, and become a part of the Microsoft Fabric community. Here are some of the highlights of my 2023:

My first MVP Summit in person in Redmond in April

One of the most memorable events of the year was attending the MVP Summit in person in Redmond, Washington. Visiting the Microsoft headquarters and meeting some of the brilliant minds behind the products and services I use every day. I learned a lot from the sessions, workshops and networking opportunities, and I also had a lot of fun exploring the campus and the city. It was an honor and a privilege to be part of this incredible community of MVPs.

Becoming a Microsoft Fabric Feature Partner in November

Another milestone of the year was becoming a Microsoft Fabric Feature Partner in November. Microsoft Fabric is a new SaaS data platform, I got early access to the platform and provided feedback and suggestions to the product team. I also got to showcase some of the features and benefits of Microsoft Fabric at various events.

Lauched the Microsoft Fabric Content Hub

With the Public review announcement of Microsoft Fabric there was so much content. With this Content hub I try to Stay up-to-date with the latest and most valuable content about Microsoft Fabric, all in one place! From insightful articles and tutorials to engaging videos and community blogs, you’ll find a treasure trove of resources to deepen your understanding. It is one of my best visisted pages this year on my blog

Microsoft Fabric Content Hub – Erwin & Data Analytics (erwindekreuk.com)

Attending and helping during Microsoft Ignite in Seattle in November

Microsoft Ignite is one of the biggest and most exciting events of the year for anyone who is passionate about technology. I had the chance to attend and help during the event in Seattle, Washington. I was amazed by the scale and the quality of the event, and I enjoyed learning from the experts, meeting new and old friends, and discovering the latest innovations and trends in the industry. One of the highlights of the event was the announcement of Microsoft Fabric GA (General Availability), which marked the official launch of the platform to the public.

Speaking and visiting Legoland in June during Data platform Next Step

Data platform Next Step is a unique event that combines data and fun. It was held in June in Billund, Denmark, the home of Lego. I had the opportunity to speak at the event and share my experience and insights on Microsoft Purview. I also had a blast visiting Legoland, the original and largest Lego theme park in the world. It was like a dream come true for a Lego fan.

Helper/volunteer/speaker during SQLBits in March

SQLBits is the leading conference for data professionals to network, develop and share data knowledge in Europe, and it was held in March in Newport. I was happy to be a helper/volunteer at the event, and contribute to its success. I helped with the sessions and anything else that was needed. Besides helping, I had also one session on Microsoft Purview. I also learned a lot from the speakers, the sponsors, and the attendees, and I had a great time in Newport.

Did 2 sessions for SQLDay in May, my first time in Wroclaw, I’ve seen a lot of dwarfs

SQLDay is the biggest data platform conference in Poland, and it was held in May in Wroclaw, the fourth-largest city in the country. It was my first time visiting Wroclaw, and I was impressed by its beauty and history. I did two sessions for SQLDay, one on Microsoft Purview and one on Azure Synapse Analytics. I received positive feedback and questions from the audience, and I enjoyed sharing my knowledge and experience. I also had fun exploring the city and seeing a lot of dwarfs. Wroclaw is famous for its dwarf statues, which are scattered all over the city. There are more than 400 of them, and each one has a different story and personality.

Speaking at events like DataSaturday Stockholm, with an amazing speaker dinner

DataSaturday is a series of events organized by the data community for the data community. I had the chance to speak at several DataSaturday events throughout the year, in different countries and cities. One of them was DataSaturday Stockholm, which was held in May in the capital of Sweden. It was a well-organized and well-attended event, with a lot of interesting sessions and speakers. I spoke about Meta Data driven frameworks and how it can help data professionals to simplify and optimize their data pipelines. I also had an amazing speaker dinner, where I met and mingled with other speakers and organizers. It was a wonderful evening of food, drinks and conversations.

Visited Portugal for the first time to speak during the Iberian Summit

The Iberian Summit is a event from the Portuguese data community, and it was held in April in Olhao, Portugal. It was my first time visiting Portugal, and I was amazed by its culture, cuisine and scenery. I spoke at the event and shared my insights and tips on Azure Synapse Analytics. I also learned from other speakers and attendees, and I had a lot of fun in Olhao.

Had an awesome Inspiration weekend in June with my employer InSpark

InSpark is the company I work for, and it is the leading Microsoft partner in the Netherlands. In June, we had an awesome Inspiration weekend, where we went to a beautiful location and spent two days of learning, brainstorming, and fun. We had sessions and we also had activities, such as climbing. In the evening we had a great White party with beer and wine tastings. It was a great way to get inspired, motivated, and connected with my colleagues.

DataScotland in the Murrayfield Stadium in September

DataScotland is a data platform conference in Scotland, and it was held in September in Edinburgh, the capital of the country. It was a unique event, as it took place in the Murrayfield Stadium, the home of the Scottish rugby team. I spoke at the event and presented on Azure Synapse Analytics togehter with Mathias. I also enjoyed the sessions, the networking, and the atmosphere of the event.

Finally this year DataSaturday Holland was back again, where I spoke about Microsoft Fabric

DataSaturday Holland is the biggest data platform event in the Netherlands, and it was back again this year after a hiatus due to the pandemic. It was held in October in Utrecht, the fourth-largest city in the country. I spoke at the event and gave an overview of Microsoft Fabric and its features and benefits. I also attended some of the sessions, met some of the sponsors, and chatted with some of the attendees. It was a fantastic event, and I was glad to be a part of it.

Techorama Belgium and Techorama the Netherlands

This is year I Spoke at the Belgium and the Dutch Edition. I Belgium I spoke togehter with Marc on Power BI and Microsoft Purview. In Utrecht, the Netherlands I had 2 sessions, one on Microsoft Purview and one on Azure Synapse Analytics

Organized a customer event for all of Data and AI customers of InSpark, which was a really successful event

In September, I organized a customer event for all of the Data and AI customers of InSpark. The event was held in the DDX in Zoetermeer, and it was aimed to showcase some of the latest and greatest technologies and solutions in the data and AI space. I invited some of the experts from Microsoft and other partners to speak at the event, and I also spoke myself about Microsoft Fabric and how it can help customers to achieve their data goals. The event was a really successful one, with a lot of positive feedback and engagement from the customers.

Spoke at several community events

Besides the events I mentioned above, I also spoke at several other community events throughout the year, such as Power BI Gebruikersdag, Power BI gebruikersgroep and more. I always enjoy speaking at community events, as they are a great way to share my passion and knowledge, learn from others, and meet new and old friends. I am very grateful to the organizers, the speakers, and the attendees of these events, for making them possible and valuable.

On a personal level

On a personal level, I also had some achievements and experiences that I am proud of and happy about. One of them was participating in a training called Taking the Stage at the The Speech Republic, led by Natascha Jacobsz and Jantien Streefkerk-van der Meer. In four days, we learned how to take the stage and tell our own story. I do often stand on a stage, but my goal was to create an inspiring story that was not technical. The audience, consisting of family, friends and colleagues, could be themselves during my story. It was a nice step for myself, which was a goal of my training, but which I did not think possible at the beginning and until one of the last days.

Another personal experience that I enjoyed was closing the year with an amazing Christmask dinner with all my colleagues in het Rijk van Keizer in Amsterdam. It was a lovely evening of delicious food, drinks, and conversations. It was a perfect way to celebrate the end of the year and the start of the new one.

Conclusion

2023 was truly an amazing year for me. I learned a lot, shared a lot, and grew a lot, both professionally and personally. I had the opportunity to attend, speak and help at various events, meet new people, visit new places, and become a part of the Microsoft Fabric community. I want to thank everyone who was a part of my 2023, for making it a wonderful and memorable year. ❤️

Let’s celebrate the memories we’ve created and look forward to the adventures that await in 2024! May the new year bring joy, peace, and prosperity to you and your loved ones. Happy New Year!

Feel free to leave a comment

Goodbye 2022, Hello 2023

Goodbye 2022, Hello 2023

Divers

by Erwin | Dec 31, 2022

by Erwin | Dec 31, 2022

Goodbye 2022

​Recap

It’s that time of year again to reflect on the past year. Also think it’s really good, to see what you’ve done in the past year. It is also the time again to traditionally bake Oliebollen on this day, a Dutch Tradition that we do on New Year’s Eve.

Oliebollen

This year we celebrate New Year’s Eve with the family, we were supposed to go to relatives, but unfortunately these have all been felled by the flu. We will enjoy an evening of games, oliebollen and some drinks.

Looking back at 2022, I can say that I personally had a great year. Finally we are released from all COVID restrictions, we can go to physical events again, back to our customers, back to the office and see many people in real life again.
It was a very busy year in terms of work, this is also one of the main reasons that I have blogged much less than other years. The inspiration and energy is slowly coming back for this, so with some hope I can change this soon.

And as many would say, I should exercise more in the evenings and not always sit behind my laptop. My work is my hobby, so that will be difficult, but it will be one of my New Year’s Good intentions for 2023. A better work life balance would be better for my health and maybe I should seek help in the form of a coach for that. If you have suggestions for me, let me know.

Speaking/Volunteering

This year I have spoken at several events on the topics of Azure Synapse Analytics and Microsoft Purview.

DataMinds (Virtual)

Did a virtual session for the DataMinds UG on Data Governance with Azure Purview( Yes is was on that moment still Azure Purview and not Microsoft Purview)

Data Minutes (Virtual)

The second event of the year, within my team I proposed to attend this event together. During the event there was a Last-Minute cancellation, at the request of Ben Weissman I gave a short session about Access Control in Azure Synapse. It’s a fun event where you have a bunch of 10 minute blocks. Works very inspiring.

Data Toboggan (virtual)

Talked about access control in Azure Synapse Analytics. Data Toboggan is one of the events that is 100% focused on Azure Synapse Analytics.

SQL BITS

This year I volunteered at SQLBits for the first time and became part of the Orange family and as you can see in the picture it is a very big family. In addition to volunteering, I was also asked by Microsoft to present a session during SQL Bits on Cloud Scale Analytics solutions. Thanks again Tony and Wee Hyong for the invite.

SQLBITS Orange Team 2022 SQLBITS Orange Team 2022

Data Saturday Stockholm

My first time in Stockholm, great event. Bra så alla tillbaka personligen This means great, so everyone back personally.

DataGrillen

When we say: Data, bratwurst and beer, we are of course talking about DataGrillen. After more than 2 years of absence, it was that time again in recent days, with speakers from all over the world, beautiful weather and a large group of participants.
And as usual with this event, the first day ends with a barbecue for all participants.
By the way, I can’t imagine a better event to celebrate my 50th birthday. It is therefore a great pity that there will be no DataGrillen next year. Hopefully again soon, in any form.

Datagrillen 2022 Datagrillen 2022

Scottish Summit

First time in Glasgow, second time speaking at the Scottish Summit on one of my favorite topics Data Governance and Purview.

DATA Scotland

Second time in 3 months coming to Glasgow and this time it was sunny, over 400 people in attendance and over 50 sessions.

DATA SCOTLAND 2022 DATA SCOTLAND 2022

DataMindsConnect

This year I volunteered for 2 days, the event was sold out with over 650 attendees. For us as Dutch people, the event is easily accessible by car, which means that many Dutch people are also present as participants.

Experts Living in the Netherlands

This was a very big IT event in the Netherlands, my employer InSpark was one of the sponsors. But even better to mention that during this event I was allowed to give a session with my colleague Albert, this was the first time that I presented together with a colleague. And this is certainly worth repeating.

Pass Data Community Summit

I’ve always wanted to speak at the Pass Data Community Summit and it’s a dream come true and definitely one of my bucket list items. I had 3 sessions on Microsoft Purview. The event was great again, had great conversations and met so many old and new people again. Nice thing about this event was that a MVP pre day was also organized on the Microsoft Campus, thanks again to Rie Merritt for the entire organization and putting together the agenda. It always remains a wonderful feeling to be on the Campus. Hopefully we can go to Seattle again next year. And let’s not forget the day that as a community we showed our support to Hugo Kornelis #teamhugo. This was a very and beautifully moving moment, all messages on the socials, all blue shirts. Hugo is fighting Acute Myeloid Leukemia (AML.)

Pass Community Summit 2022 Pass Community Summit 2022

The above was not possible with the support from my wife and kids, you are also quite often on the road during the weekends and I would like to thank my employer InSpark very much as well, they are the ones who encourage and financially support all our MVPs, but also other colleagues, to speak at international events.

InSpark

At my employer InSpark, we have made great progress with the Data and AI team this year with Managed Oyxgen, our Data Platform as a Service. The 2023 roadmap for our solution looks impressive and I’m already looking forward to working on it with everyone.
👉 Within our team we can be proud that we:
✅ Having challenging and varied work.
✅ Added even more gears to our accelerators.
✅ Creating lots of space for your own input, innovation and creativity.
✅ Working and contributing to many interesting projects.
✅ Having a good working atmosphere.
✅ Even took yoga classes.
✅ Attend the coolest events and even speak there.

I am therefore very proud of the team that we have all achieved together this year, on to even more beautiful and innovative projects

And the above certainly contributes to the fact that I can close 2022 as a great year and I look forward to 2023 with great pleasure and enthusiasm.

I wish everyone a great 2023, on to a successful year

Rotterdam Vuurwerk Erasmusbrug.

Feel free to leave a comment

Proud to be an ADF Hackathon winner!

Divers Azure Data Factory Hackathon Around the clock During the event ‘Around the clock Azure SQL and Azure Data Factory’ event on Feb 3, 2021, they kicked-off the Azure Data Factory (ADF) Hackathon. Recording of this event can be found here . Winner I submitted a ADF…

Goodbye 2020 Hello 2021

Divers Goodbye 2020  Started to work for InSpark Last year was certainly an eventful year. Started with a new job at InSpark and after 10 weeks we all know what happened, the first intelligent lockdown. The Netherlands was partially locked, but our office was…

Collection of all ADF Mapping Data Flow videos

Divers ADF Mapping Flow Did you use the Dataflow preview functionality in Azure Data Factory? This has recently be renamed to Mapping Data Flows.   All video’s which the ADF team has created, are collected. Start Here: ADF Data Flow: Overview ADF Data Flow: Data…

Service Health Alerts in Azure

Divers Maintenance and Service Healths in Azure I get often questions, is there no maintenance in Azure. Like every data center, the Azure data center also needs maintenance. You can even be notified when a specific service, in a specific data center, has scheduled…

Calculate Workingdays including Holidays with T-SQL

Divers Calculate Workingdays between 2 Date columns Recently I have been getting some questions from my customers, can I calculate the number of workdays between 2 dates? Of course my answer was, yes you can. But I do want certain closing dates and holidays of our…

New Microsoft Azure Certifications

Divers Microsoft Certification by Solution Area Handy overview of the new Microsoft Azure Certifications. More details can be found here Feel free to leave a comment

How to check your SQL Server Quota in Azure?

Divers Azure Subscription Usages for SQL Server   Last week we reached our Logical server Quota in Azure. By default you’re only allowed to add 20 Logical Servers, but we wanted to have some more for testing purposes. Microsoft Support You can submit a support ticket…

Azure Synapse Analytics

Divers Azure Synapse Analytics   Insights for all Azure Synapse provides a breathtaking view of your data across data warehouses and big data analytics systems. Bringing these two worlds together into a single service is challenging as it requires unifying…

Azure Data Factory: Save a pipeline as a Template

Divers Saving a Pipeline Another great improvement in Azure Data Factory. Saving you template! How can you save your template? First of all you need to connect your Azure Data Factory to  a GIT integration. Both Azure DevOps GIT and GitHub are supported. Please follow…

Data Factory Pricing

Divers Data Factory pricing Are you also having problems to understand the Pricing Model for Azure Data Factory?  After some research on the internet I came across an article which I wanted to share with you. ADFV2 Pricing Examples Feel free to leave a…

Goodbye 2021, Hello 2022

Goodbye 2021, Hello 2022

Divers

by Erwin | Jan 3, 2022

by Erwin | Jan 3, 2022

Goodbye 2021

Recap

First of all, I would like to wish everyone a very beautiful and healthy 2022.

We are now 3 days on the road into the new year and it is always good to look back at what happened last year. It’s certainly been an eventful year, topped off with my MVP Award, which I’m super proud of.
Within InSpark there were a number of changes within our Management Team and that had a significant effect, partly expected but sometimes not completely. Everyone has now been able to find their way and the various Teams are making quite a lot of progress.
Our office is currently closed due to the Lock down in the Netherlands and we communicate through Teams again. I certainly look back to the months that our office was open and that you also saw other colleagues outside your own team. I continue to find meetings via teams very difficult and I regularly have trouble finding the right drive and inspiration there, but unfortunately it is no different and let’s hope for better.

Managed Oxygen

POTY_Analytics_2021

With Managed Oyxgen, our Data Platform as a Service, we have once again made such major improvements that I did not think it was possible at the beginning of this year, but confirmation came in July 2021. We submitted Managed Oxygen for the Microsoft Partner of the Year awards, we just didn’t win the award but we did become a finalist in the Category Analytics and that out of 4400 entries.
Wow we were so happy with this appreciation, then you know were you worked hard for every day. Compliments to all my colleagues who work every day with such a drive and energy on the development of our Managed Oxygen.

In addition to our Managed Oxygen, we continued working with the whole team on our Nitrogen Accelerator.

  • Metadata-driven Framework for Azure Data Factory and Azure Synapse Analytics which allows us to automatically extract data from various sources and  building a Lakehouse.
  • Monitoring, Logging and Audit Pipelines
  • Build and release pipelines for all the necessary Azure Data services and Power BI in DevOps.
  • Data quality and privacy patterns.
  • Automated Documentation and other best practices.

An Accelerator that greatly benefits our customers and to which we as a team provide input from all disciplines.

Cool and innovative projects

As InSpark, we are the Cloud Incubator for our mother company KPN, which has the advantage that we can work a lot on innovation. We have done a lot of connected projects this year, such as Connected Vehicles, Connected Ships, Connected containers, with some projects processing more than 70 million messages per day. Still pretty cool to see how easy it all goes and fit within Managed Oxygen. In addition to these Connected projects, we have done projects in which we help cities and local governments with their ever-growing demand for data and data solutions, the Urban Data Platform. We have made the first steps with Azure Percept and I’m looking forward to start our first Azure Percept project this year.

We are still looking for new colleagues to help us with these cool projects. If you want to know more about InSpark and what cool projects we do even more, let me know.

Blog

Just like last year, I wanted to write more blogs and articles, but unfortunately the counter has stopped at 20 this time. My blogs and articles were mostly about Azure Synapse Analytics and Azure Purview. It was good to see that the community is finding my blogs and articles better and better and that’s what it’s all about in the end.

MVP Award

In October last year I became a Data Platform MVP, a great appreciation from Microsoft for all the input and feedback I provide on the various Azure Data Services and my contribution to the Community. When I saw the message in my mailbox I didn’t know what I saw, so happy, I immediately called my colleagues to share the news. They have always supported me in everything I do.

ADF Hackathon

I submitted a ADF Pipeline Template “Scale Dedicated SQL Pool Dynamically using Azure Data Factory control flow“ to the ADF Hackathon in March and my submission was marked as WINNER. I am very proud that a simple template where you can easily save costs has won. This template will help you to scale up and down a Dedicated SQL Pool in Azure Synapse Analytics. See full post of the announcement here.

Events

This year I regularly spoke at Virtual Events such as SQL Bits, Scottisch Summit, DataWeekender, Data Toboggan, Cloud Lunch and Learn Marathon and various DataSaturdays. In October I helped as a volunteer during DataMinds Connect a physical event(my only one in 2021) which was held in Mechelen. This event gave me so much energy again because I saw so many great sessions and talked to so many people again. The event was perfectly organized according to the then applicable conditions in Belgium. My brain and body were no longer used to that and I was completely exhausted after these 2 super fantastic days.

SQL Bits, Scottish Summit, DataMinds and Datagrillen are already planned for this year. I look forward to seeing everyone again.

Whatever a year looks like, the most important thing is that everyone is healthy and safe. I look forward to a great collaboration with everyone.

Feel free to leave a comment

Azure Purview MSIgnite Spring 2021 Announcements

Divers Azure Purview Ignite 2021 Annoucement Pricing This week the Azure Purview announced that they will extend the Azure Purview offer to provision 4 Capacity Units of the Data Map for free till May 31, 2021! Charging will start on June 1, 2021. Great news for…

Goodbye 2020 Hello 2021

Divers Goodbye 2020  Started to work for InSpark Last year was certainly an eventful year. Started with a new job at InSpark and after 10 weeks we all know what happened, the first intelligent lockdown. The Netherlands was partially locked, but our office was…

Azure Data Factory: New functionalities and features

Divers New functionalities and features Last week, a number of great new functionalities and features were added within Azure Data Factory. I would like to take you in some details in the blog below: Customer key With this new functionality you can add extra security…

Are you using Azure DevOps?

Divers Azure DevOps More and more users are starting with Azure DevOps. Azure DevOps can be used for up to 5 users free of charge and is therefore a great start to start a project.     Build and Release I will not describe what Azure DevOps can do, because that is too…

Azure Synapse Analytics

Divers Azure Synapse Analytics   Insights for all Azure Synapse provides a breathtaking view of your data across data warehouses and big data analytics systems. Bringing these two worlds together into a single service is challenging as it requires unifying…

Book of News Microsoft Ignite 2019

Divers Microsoft Ignite 2019 MSIgnite 2019 has almost come to an end. A lot of new Annoucement have been released and presented.  Would you also like to know which announcements have been made? Microsoft has released during MSIgnite a “Book of News”. This book…

Azure Purview Public Preview Starts billing

Divers Billing for Azure Purview(Public Preview) As of January 20th 2021 0:00 UTC Azure Purview will starts billing. Preview From January 20 ,2021 Azure Purview will start billing. During the Public Preview, you will only be billed if you exceed the 4 capacity units…

Azure Data Factory: Save a pipeline as a Template

Divers Saving a Pipeline Another great improvement in Azure Data Factory. Saving you template! How can you save your template? First of all you need to connect your Azure Data Factory to  a GIT integration. Both Azure DevOps GIT and GitHub are supported. Please follow…

ADF: Get Metadata Activity stopped working

Divers Meta Data Activity Today my pipelines in Azure Data Factory (ADF) suddenly stopped working. The output structure was not found. Quit strange while these pipelines have been running for weeks.     Invalid Template After debugging my Pipeline I found out the…

My First Blog Post SQLSatHolland 790

Divers Yeah, m y first blog is LIVE After a good talk with Reza Rad from RADACAD during SQLSatHolland, I decided to start my first blog! Knowledge sharing is very important, it gives me a lot of energy. But it also gives others people in the community energies to pick…