Fabric Metadata‑Driven Framework (FMD)

FMD Release Highlights – April 2026

The April update of the Fabric Metadata‑Driven (FMD) Framework focuses on robustness, identity alignment with Microsoft Fabric and improved operational stability. This release contains important fixes and hardening changes based on real‑world usage, parallel workload execution and production feedback.

🔐 Workspace Identity Support for Notebook Activities

With Microsoft Fabric now supporting Workspace Identity in Notebook activities, the FMD Framework has been enhanced to fully align with this model.

Previously, the Workspace Identity used by Notebook activities did not automatically have access to the Data workspace, potentially causing authorization issues during execution.

What’s new?
The Workspace Identity is now explicitly granted access to the Data workspace, ensuring that metadata‑driven pipelines can execute securely without additional manual permission steps.

This enables a cleaner, more secure identity setup that matches modern Fabric best practices.

🛠️ Fix for SCD2 Logic in the Silver Notebook

A rare but critical edge case was identified in the Silver Notebook SCD2 process:

  • Records that were deleted
  • And later reintroduced with updated data
  • Were not always recognized correctly as new versions

This has now been fixed.
The SCD2 logic correctly handles delete‑and‑reinsert scenarios, ensuring accurate historical tracking and reliable slowly changing dimension behavior.

⚡ Reliable Queueing for Parallel Dev & Prod Loads

Running Development and Production loads in parallel surfaced an issue where the queuing mechanism did not behave as expected.

Root cause:
The queueing process lacked workspace-level isolation.

Fix implemented:
The Data Workspace GUID is now explicitly passed as an input parameter.
This guarantees proper separation of Dev and Prod workloads, resulting in deterministic and predictable execution behavior when environments run concurrently.

Notebook updates

✅ Notebook Improvements & Fixes

Notebook Improvements & Fixes

This release includes a significant set of targeted fixes and robustness improvements across core FMD notebooks.

✅ NB_SETUP_FMD.ipynb – Demo Data Guard Fixed

  • Added an explicit if load_demo_data: check before deploying demo SQL
  • Prevents accidental deployment of demo artifacts in non-demo environments
  • Fixes the critical issue identified during framework validation

✅ NB_FMD_CUSTOM_DQ_CLEANSING.Notebook

Multiple fixes applied:

  • Corrected code block formatting (markdown comment syntax)
    Fixed typo in registration logic: fun → func

✅ NB_FMD_LOAD_BRONZE_SILVER.Notebook

Improved error resilience:

  • Merge logic wrapped in try/except
    Audit logging added on failure
    More explicit error handling for operational visibility

✅ NB_FMD_LOAD_LANDING_BRONZE.Notebook

Stability improvements:

  • Removed duplicate TotalRuntime assignment
  • Replaced bare except with except Exception as e
  • Fixed incorrect error message variable reference

✅ NB_FMD_PROCESSING_PARALLEL_MAIN.Notebook

Enhanced error handling:

  • Merge wrapped in try/except with audit logging
    Fixed malformed except clause

✅ NB_UTILITIES_SETUP_FMD.Notebook

Improved robustness and clarity:

  • Simplified execute_with_outputs logic
  • Better exception handling throughout
  • Improved error messages in set_workspace_icon and fill_svg
  • Fixed status code check:
    == 201 or 202 → in (201, 202)

Branding

I also worked with help of AI on the branding, so you will see as of today some new logo’s. Please let me know your thought.

Documentation & Wiki Updates

The April release also includes updated documentation and Wiki pages:

  • Notebook behavior now aligned with the latest fixes
  • Improved explanations around identity, queueing, and execution patterns
  • Content refined based on practical implementation feedback

✔️ Summary

The April FMD Framework release is all about making the framework more production‑ready:

  • Secure Workspace Identity integration
  • Correct and resilient SCD2 behavior
  • Reliable parallel Dev/Prod execution
  • Stronger error handling across all core notebooks
  • Cleaner templates and safer demo data handling
  • Improved and up‑to‑date documentation

These improvements further strengthen FMD as a platform‑engineering foundation for Microsoft Fabric.

Bug Fixes & Community Contributions

A huge thank‑you to the community for reporting issues and submitting pull requests!
This release includes:

  • Minor bug fixes
  • Stability improvements
  • Quality‑of‑life enhancements informed by your feedback

Your contributions directly shape and refine the framework.

Stay Connected

GitHub Repository
👉FMD_FRAMEWORK

Hit Subscribe to get future release notes delivered straight to your inbox!

Feel free to leave a comment

0 Comments

Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.


Discover more from Erwin | Data & Intelligence

Subscribe to get the latest posts sent to your email.