How to Use and Enable High Concurrency for Notebooks in Pipelines with Microsoft Fabric High Concurrency Mode for Notebooks in Pipelines is a game-changer for data engineers and data scientists using Microsoft Fabric. This feature allows multiple notebooks to share a...
#FabConEurope: A New Era for Microsoft Fabric in Stockholm The inaugural #FabConEurope held in Stockholm from September 24-27, 2024, marked a significant milestone for the Microsoft Fabric community. This event brought together enthusiasts, experts, and innovators to...
Get ready for the next enhancement in Microsoft Purview Get ready for the next enhancement in Microsoft Purview, as it brings a range of exciting new features and capabilities. To ensure the best experience with Purview, it is recommended that you tag your existing...
In the previous blog post we explored how to use the PySpark Executor. However, sometimes you may need to run multiple notebooks in a specific order or in parallel, depending on the dependencies and logic of your data pipeline. For example, you may have a notebook...
In this blog post, we will explore how to use the PySpark executor in Notebooks in Microsoft Fabric to leverage the power of Spark and achieve high concurrency, flexibility and scalability. What is the PySpark executor? The PySpark executor is a built-in kernel that...
As the year 2023 comes to an end, I want to take a moment to reflect on some of the amazing experiences I had in the past 12 months. It was a year full of learning, sharing and growing, both professionally and personally. I had the opportunity to attend, speak and...
How Microsoft Purview and Microsoft Fabric work together to empower data discovery and governance Microsoft Purview is a unified data governance service that helps you manage and govern your on-premises, multi-cloud, and software as a service (SaaS) data. Microsoft...
Get ready for data enrichement in Microsoft Fabric Azure OpenAI is fun and exciting and we can use it to do amazing stuff. In combination with Spark on Microsoft Fabric or Azure Synapse Analytics, we can transform and generate large amounts of text data and make use...
Get ready for the next enhancement in Microsoft Purview Get ready for the next enhancement in Microsoft Purview, as it brings a range of exciting new features and capabilities. To ensure the best experience with Purview, it is recommended that you tag your existing...
Microsoft Fabric Capacity Since the first of June 2023, we can create Fabric capacities in Azure. This are currently the Pay as You go pricing, later this year the Azure Reservation will follow. OneLake storage pricing is comparable to Azure ADLS (Azure Data Lake...
Connecting Azure Event Hubs with Eventstream in Microsoft Fabric In my previous blog I did give you an introduction of the possibilities of Real-Time Analytics in Microsoft Fabric. In this blog we will have a closer look into how we can connect data from one of our...
Introduction to Real-Time Analytics in Microsoft Fabric Real-Time Analytics is one of the data and analytical workloads/experiences available in Microsoft Fabric, the new platform currently in Public Preview at Microsoft. With Real-Time Analytics, companies and...