Microsoft Fabric Content Hub Update November

Microsoft Fabric Content Hub Update November

Fabric-Overview-Short

Month: November 2023

by Erwin | Nov 30, 2023

Stay up-to-date with the latest and most valuable content about Microsoft Fabric, all in one place!  From insightful articles and tutorials to engaging videos and community blogs, you’ll find a treasure trove of resources to deepen your understanding.

This time there was so much content, sorry if I missed yours. Attending Ignite in Person with some lack of sleep due a jet lag and following sessions was the main reason for.

Microsoft Fabric is now generally available

One of the most anticipated announcements at Ignite 2023 was the general availability of Microsoft Fabric, a unified data platform that enables organizations to prepare their data for AI innovation. Microsoft Fabric was first introduced at Microsoft Build 2023 as “perhaps the biggest launch of a data product from Microsoft since the launch of SQL Server”, according to Satya Nadella, CEO and Chairman of Microsoft.

Microsoft Fabric integrates Power BI, Azure Synapse Analytics, and Azure Data Factory into a single service, with a common capacity pricing model and a unified user experience. With Microsoft Fabric, users can access, analyze, transform, and govern their data across multiple sources and formats, using familiar tools and languages. Microsoft Fabric also supports the creation and consumption of foundation models, which are large-scale AI models that can be customized and applied to various domains and scenarios.

Microsoft Fabric has been adopted by thousands of organizations around the world, including 67 percent of the Fortune 500, since its preview announcement

InSpark Feature Partner for Microsoft Fabric

Proud to announce that my employer  InSpark | Innovate to Accelerate has been recognized by Microsoft and named on their list of Partners. Our hard work and dedication to onboarding customers on MicrosoftFabric has paid off, and we’re excited to continue this amazing journey. Let’s keep pushing the boundaries and achieving great things together!Fabric-Feature-Partner-InSpark

Latest Community blog posts:

What is Fabric DWH Bursting  – Project Controls blog (datamonkeysite.com)

Bursting and Smoothing - Yin and Yang of the Fabric Capacity! - Data Mozart (data-mozart.com)

Programmatically Creating, Managing Lakehouses in Fabric

Visualizing JSON Structure In Fabric Notebook

Microsoft Ignite 2023 – Fabric Round-up — Advancing Analytics

Demystifying the Data Lakehouse in Microsoft Fabric – justB smart

dbt Cloud is now available for Microsoft Fabric (getdbt.com)

Controlling Direct Lake Fallback Behavior (fabric.guru)

Delta Lake Change Data Feed in Fabric Lakehouses (serverlesssql.com)

Measure Maze: Visualizing Measure Dependencies Using Semantic Link & Network Analysis (fabric.guru)

Fabric : Engines Resource Consumption. – Project Controls blog (datamonkeysite.com)

Fabric Lakehouse Loading using Data Pipelines & Notebooks – Inspired by MS End-to-End Tutorials (serverlesssql.com)

Services that I recommend when working with Microsoft Fabric - Kevin Chant (kevinrchant.com)

Thoughts about the DP-600 exam for the new Microsoft Fabric certification - Kevin Chant (kevinrchant.com)

Spreading your SQL Server wings with Microsoft Fabric Data Warehouses - Kevin Chant (kevinrchant.com)

Debunking Myths and Embracing Innovation with Microsoft Fabric – Data – Marc (data-marc.com)

Kusto Query Language (KQL) Databases in Microsoft Fabric (mssqltips.com)

Copy Activity, Dataflows Gen2, and Notebooks vs. SharePoint Lists (datameerkat.com)

Understanding Storage Costs for Microsoft Fabric – The White Pages (bifocal.show)

Brian Bonk | KQL Data live copy to OneLake

Working with tables in Microsoft Fabric Lakehouse - Everything you need to know! - Data Mozart (data-mozart.com

CHANGE (IN THE HOUSE OF LAKES) - It's Not About The Cell (itsnotaboutthecell.com)

Latest Video’s/ Podcasts:

(1302) Microsoft Fabric - YouTubee

Feel free to leave a comment

How to Discover and Govern Your Data with Microsoft Purview and Microsoft Fabric

How to Discover and Govern Your Data with Microsoft Purview and Microsoft Fabric

Month: November 2023

How Microsoft Purview and Microsoft Fabric work together to empower data discovery and governance

Microsoft Purview is a unified data governance service that helps you manage and govern your on-premises, multi-cloud, and software as a service (SaaS) data. Microsoft Fabric is a new cloud-based data platform that enables you to create, share, and collaborate on data-driven insights with your team. Together, Microsoft Purview and Microsoft Fabric offer a seamless integration that allows you to browse and search Fabric items, access metadata from Fabric items, and apply data policies and classifications to Fabric items.

New Portal Experience

A few months ago, Microsoft announced the new portal Experience in Microsoft Purview as it offers a range of exciting new features and capabilities. Data Governance, Risk and Compliance are increasingly integrating into a unified experience. Microsoft Fabric will have a native integration with Microsoft Purview.

Purvew-New-Portal

Browse and search Fabric items

Just like Microsoft Azure, Microsoft Fabric is a new source for Microsoft Purview. Since Microsoft Purview is attached to every Fabric instance by default, you can click on the tile “Microsoft Fabric” on the front page of Microsoft Purview Data Catalog to start browsing your Fabric items. Automatically, any user can see the workspaces and Fabric items based on the permission setting they have in Fabric. You can also use the search bar to find Fabric items by keywords, filters, or facets.

Purview-Fabric-DataCatalog

Access metadata from Fabric items

In the coming weeks, Microsoft Purview Enterprise customers can provide broader access to metadata from Fabric items by scanning Fabric. When a Fabric is scanned, Microsoft Purview writes information about Fabric items to the Purview data map, and access to that metadata is governed by Microsoft Purview access control. This allows administrators to give users metadata access for data discovery or governance, without requiring those users to have read permissions on the underlying data sources.

Purview-Integration0Fabric

Live view in Microsoft Purview

Resources in live view in the Microsoft Purview Data Catalog automatically have this metadata available:

  • Name
  • Properties
  • Schema
  • Lineage

Creating a new workspace in Fabric will automatically appear in Microsoft Purview.

Purview-LiveView

Available resources

The following Fabric items will be available in Microsoft Purview as part of this public preview release.

Experiences Fabric items
Real-Time Analytics KQL Database
KQL Queryset
Data Science Experiment
ML Model
Data Factory Data pipeline
Dataflow Gen2
Data Engineering Lakehouse
Notebook
Spark Job Definition
SQL analytics endpoint
Data Warehouse Warehouse
Power BI Dashboard
Dataflow
Datamart
Dataset
Report
Paginated report*

* Only available by scanning

Conclusion

Microsoft Purview and Microsoft Fabric are two powerful services that work together to empower data discovery and governance. By integrating Microsoft Purview and Microsoft Fabric, you can leverage the benefits of both services, such as:

  • Browse and search Fabric items in the Microsoft Purview Data Catalog
  • Access metadata from Fabric items without requiring data access permissions

If you want to learn more about Microsoft Purview and Microsoft Fabric, you can visit the following links:

I hope you find this blog post helpful. Please let me know if you have any feedback or questions.

Feel free to leave a comment