FMD Release Highlights – March 2026
FMD Release Highlights – March 2026
The March 2026 update delivers several important improvements to the Fabric Metadata Driven Framework (FMD), focused on reliability, better data lineage, easier notebook automation, and smoother ingestion experiences. This release builds on real‑world feedback from the community and introduces new capabilities that make FMD more robust and easier to operate across environments.
Enhanced SCD Type 2 Merge Behavior (Silver Layer)
The SCD2 merge logic in the Silver Layer has been updated to more accurately detect deleted and reinserted records.
This ensures:
- Improved historical tracking
- Better data consistency
- Cleaner surrogate key handling for records that reappear after deletion
This enhancement is especially valuable in scenarios with complex data lifecycles or external systems that don’t provide soft-delete indicators.
Improved File Dependency Handling (Bronze Layer)
Incremental loading relies heavily on the correct ordering of file processing. In previous versions, if a file was not processed in an earlier load, downstream logic could be impacted.
With this release:
- File dependency ordering is now enforced
- Bronze ingestion validates whether required files were processed previously
- Missing dependencies are now logged clearly for observability
This ensures consistent incremental loads without silent data gaps.
Bronze Processing Continues When Files Are Missing
Previously, the Bronze process could fail entirely when a file was missing. That behavior has now changed:
- The pipeline continues gracefully
- Missing files are clearly reported in the logs
- Operational transparency is improved without interrupting ingestion flows
This is especially helpful when working with external or irregular sources.
Fabric Notebook Connections Now Supported
You can now automatically create Notebook Connections directly from FMD!
This long‑requested enhancement is now live and supported end‑to‑end in the framework.
For details, see your dedicated deep‑dive:
🔗 Creating Notebook Connections in Microsoft Fabric Just Became a Lot Easier (and Automatable!)
Documentation & Wiki Updates
The FMD Wiki has been refreshed to include:
- Updated explanations for new features
- Corrected or missing links
- Additional operational details
This makes onboarding and implementation much easier—especially for new adopters.
Improved CSV & XLSX Ingestion Logic (Bronze Layer)
Ingestion of CSV and XLSX files has been enhanced with smarter datatype inference:
- A ratio‑based algorithm now determines column datatypes automatically
- The detected schema is used to create new Bronze tables
- Existing tables remain unaffected to ensure backward compatibility
dfDataChanged = (
spark.read
.option("header", True) # first row has column names
.option("inferSchema", True) # ask Spark to infer types
.option("samplingRatio", 0.1) # sample 10% of rows; omit to scan fully
.csv(f"{source_changes_data_path}")
)
This results in cleaner schemas and fewer surprises in downstream layers.
New Setup Notebooks (Cleaner Architecture + Automation)
1. NB_SETUP_FMD – New Notebook connection creation Added
A new setup notebook has been introduced to support the creation of Notebook Connections.
This is now the recommended place to initialize and configure all Fabric environment settings.
2. NB_UTILITIES_SETUP_FMD Converted to Python
The utilities notebook has been migrated to pure Python for better maintainability.
Additionally:
- The new
%runNotebook support is leveraged - Code volume is reduced
- Maintainability is improved
- The setup process is now cleaner and more modular
See Microsoft Fabric’s feature announcement for more details:
🔗Develop, execute, and manage notebooks
Bug Fixes & Community Contributions
A huge thank‑you to the community for reporting issues and submitting pull requests!
This release includes:
- Minor bug fixes
- Stability improvements
- Quality‑of‑life enhancements informed by your feedback
Your contributions directly shape and refine the framework.
Looking Ahead
The March 2026 release marks another strong step toward making FMD a more enterprise‑ready, automatable, and maintainable accelerator for Microsoft Fabric.
Whether you’re configuring ingestion, managing environments, or building scalable workloads, this release delivers meaningful improvements across governance, performance, and usability.
If you haven’t yet upgraded your notebooks or pipelines, now is a great time to explore the new capabilities.
Stay Connected
GitHub Repository
👉FMD_FRAMEWORK
Hit Subscribe to get future release notes delivered straight to your inbox!
Feel free to leave a comment
Discover more from Erwin | Data & Intelligence
Subscribe to get the latest posts sent to your email.




0 Comments