Goodbye 2021, Hello 2022

by Jan 3, 2022

Goodbye 2021

Recap

First of all, I would like to wish everyone a very beautiful and healthy 2022.

We are now 3 days on the road into the new year and it is always good to look back at what happened last year. It’s certainly been an eventful year, topped off with my MVP Award, which I’m super proud of.
Within InSpark there were a number of changes within our Management Team and that had a significant effect, partly expected but sometimes not completely. Everyone has now been able to find their way and the various Teams are making quite a lot of progress.
Our office is currently closed due to the Lock down in the Netherlands and we communicate through Teams again. I certainly look back to the months that our office was open and that you also saw other colleagues outside your own team. I continue to find meetings via teams very difficult and I regularly have trouble finding the right drive and inspiration there, but unfortunately it is no different and let’s hope for better.

Goodbye 2021 Hello 2022

Managed Oxygen

POTY_Analytics_2021

With Managed Oyxgen, our Data Platform as a Service, we have once again made such major improvements that I did not think it was possible at the beginning of this year, but confirmation came in July 2021. We submitted Managed Oxygen for the Microsoft Partner of the Year awards, we just didn’t win the award but we did become a finalist in the Category Analytics and that out of 4400 entries.
Wow we were so happy with this appreciation, then you know were you worked hard for every day. Compliments to all my colleagues who work every day with such a drive and energy on the development of our Managed Oxygen.

In addition to our Managed Oxygen, we continued working with the whole team on our Nitrogen Accelerator.

  • Metadata-driven Framework for Azure Data Factory and Azure Synapse Analytics which allows us to automatically extract data from various sources and  building a Lakehouse.
  • Monitoring, Logging and Audit Pipelines
  • Build and release pipelines for all the necessary Azure Data services and Power BI in DevOps.
  • Data quality and privacy patterns.
  • Automated Documentation and other best practices.

An Accelerator that greatly benefits our customers and to which we as a team provide input from all disciplines.

Cool and innovative projects

As InSpark, we are the Cloud Incubator for our mother company KPN, which has the advantage that we can work a lot on innovation. We have done a lot of connected projects this year, such as Connected Vehicles, Connected Ships, Connected containers, with some projects processing more than 70 million messages per day. Still pretty cool to see how easy it all goes and fit within Managed Oxygen. In addition to these Connected projects, we have done projects in which we help cities and local governments with their ever-growing demand for data and data solutions, the Urban Data Platform. We have made the first steps with Azure Percept and I’m looking forward to start our first Azure Percept project this year.

We are still looking for new colleagues to help us with these cool projects. If you want to know more about InSpark and what cool projects we do even more, let me know.

Blog

Just like last year, I wanted to write more blogs and articles, but unfortunately the counter has stopped at 20 this time. My blogs and articles were mostly about Azure Synapse Analytics and Azure Purview. It was good to see that the community is finding my blogs and articles better and better and that’s what it’s all about in the end.

MVP Award

In October last year I became a Data Platform MVP, a great appreciation from Microsoft for all the input and feedback I provide on the various Azure Data Services and my contribution to the Community. When I saw the message in my mailbox I didn’t know what I saw, so happy, I immediately called my colleagues to share the news. They have always supported me in everything I do.

ADF Hackathon

I submitted a ADF Pipeline Template “Scale Dedicated SQL Pool Dynamically using Azure Data Factory control flow“ to the ADF Hackathon in March and my submission was marked as WINNER. I am very proud that a simple template where you can easily save costs has won. This template will help you to scale up and down a Dedicated SQL Pool in Azure Synapse Analytics. See full post of the announcement here.

Events

This year I regularly spoke at Virtual Events such as SQL Bits, Scottisch Summit, DataWeekender, Data Toboggan, Cloud Lunch and Learn Marathon and various DataSaturdays. In October I helped as a volunteer during DataMinds Connect a physical event(my only one in 2021) which was held in Mechelen. This event gave me so much energy again because I saw so many great sessions and talked to so many people again. The event was perfectly organized according to the then applicable conditions in Belgium. My brain and body were no longer used to that and I was completely exhausted after these 2 super fantastic days.

SQL Bits, Scottish Summit, DataMinds and Datagrillen are already planned for this year. I look forward to seeing everyone again.

Whatever a year looks like, the most important thing is that everyone is healthy and safe. I look forward to a great collaboration with everyone.

Feel free to leave a comment

0 Comments

Submit a Comment

Your email address will not be published. Required fields are marked *

4 × 5 =

This site uses Akismet to reduce spam. Learn how your comment data is processed.

My First Blog Post SQLSatHolland 790

Yeah, my first blog is LIVEAfter a good talk with Reza Rad from RADACAD during SQLSatHolland, I decided to start my first blog!Knowledge sharing is very important, it gives me a lot of energy. But it also gives others people in the community energies to pick up new...

Are you using Azure DevOps?

Azure DevOpsMore and more users are starting with Azure DevOps. Azure DevOps can be used for up to 5 users free of charge and is therefore a great start to start a project.    Build and Release I will not describe what Azure DevOps can do, because that is too much to...

Collection of all ADF Mapping Data Flow videos

ADF Mapping FlowDid you use the Dataflow preview functionality in Azure Data Factory? This has recently be renamed to Mapping Data Flows.  All video's which the ADF team has created, are collected. Start Here: ADF Data Flow: Overview ADF Data Flow: Data Flow...

Custom comments in Azure Synapse Analytics

Add custom comments to your Azure DevOps and Github commitsFinally ​Finally and secretly hidden, we can now add a Comment to our commits in Azure Synapse Analytics and Azure Data Factory to Azure Dev Ops. How do you activate this custom comment option in your existing...

Azure Data Factory: Save a pipeline as a Template

Saving a PipelineAnother great improvement in Azure Data Factory. Saving you template!How can you save your template? First of all you need to connect your Azure Data Factory to  a GIT integration. Both Azure DevOps GIT and GitHub are supported. Please follow this...

High Concurrency Notebook Activity in Microsoft Fabric

Microsoft Fabric is a cloud-based platform that provides integrated data engineering and data science solutions. One of the key features of Microsoft Fabric is the support for Apache Spark, a distributed computing framework that enables large-scale data processing and...

Yeah My website is Finally Live

Yeah, my first built website is LIVEThe last couple of weeks I've been working hard to design my website and finally the moment is there. My website live and I'm really proud.  Building my own website The last couple of weeks/months I've been working hard... to...

How to use concurrency in Azure Synapse pipelines?

How to prevent concurrent pipeline execution?Concurrency This week I had a discussion with a colleague about how we can now make sure that a Pipeline does not start when it's already started. He then indicated, have you ever thought of the concurrency option?  I've...

Goodbye 2022, Hello 2023

Goodbye 2022​Recap It's that time of year again to reflect on the past year. Also think it's really good, to see what you've done in the past year. It is also the time again to traditionally bake Oliebollen on this day, a Dutch Tradition that we do on New Year's Eve....

Calculate the Last Day of the Month using SQL

Calculate the Last DayToday I needed to calculate the last day of the previous month for a Customer.Ever heard from the function EOMONTH? Searching on the web I came across a function I never heard from before EOMONTH, this function can be used as of SQL Server 2012....