Enhanced SCD Type 2 Merge Behavior (Silver Layer)

The SCD2 merge logic in the Silver Layer has been updated to more accurately detect deleted and reinserted records.
This ensures:

• Improved historical tracking
• Better data consistency
• Cleaner surrogate key handling for records that reappear after deletion

This enhancement is especially valuable in scenarios with complex data lifecycles or external systems that don’t provide soft-delete indicators.

Improved File Dependency Handling (Bronze Layer)

Incremental loading relies heavily on the correct ordering of file processing. In previous versions, if a file was not processed in an earlier load, downstream logic could be impacted.

With this release:

• File dependency ordering is now enforced
• Bronze ingestion validates whether required files were processed previously
• Missing dependencies are now logged clearly for observability

This ensures consistent incremental loads without silent data gaps.

Bronze Processing Continues When Files Are Missing

Previously, the Bronze process could fail entirely when a file was missing. That behavior has now changed:

• The pipeline continues gracefully
• Missing files are clearly reported in the logs
• Operational transparency is improved without interrupting ingestion flows

This is especially helpful when working with external or irregular sources.

Fabric Notebook Connections Now Supported

You can now automatically create Notebook Connections directly from FMD!

This long‑requested enhancement is now live and supported end‑to‑end in the framework.
For details, see your dedicated deep‑dive:
🔗 Creating Notebook Connections in Microsoft Fabric Just Became a Lot Easier (and Automatable!)

Documentation & Wiki Updates

The FMD Wiki has been refreshed to include:

• Updated explanations for new features
• Corrected or missing links
• Additional operational details

This makes onboarding and implementation much easier—especially for new adopters.

Improved CSV & XLSX Ingestion Logic (Bronze Layer)

Ingestion of CSV and XLSX files has been enhanced with smarter datatype inference:

• A ratio‑based algorithm now determines column datatypes automatically
• The detected schema is used to create new Bronze tables
• Existing tables remain unaffected to ensure backward compatibility

dfDataChanged = (
        spark.read
            .option("header", True)            # first row has column names
            .option("inferSchema", True)       # ask Spark to infer types
            .option("samplingRatio", 0.1)      # sample 10% of rows; omit to scan fully
            .csv(f"{source_changes_data_path}")
    )

This results in cleaner schemas and fewer surprises in downstream layers.

New Setup Notebooks (Cleaner Architecture + Automation)

1. NB_SETUP_FMD – New Notebook connection creation Added

A new setup notebook has been introduced to support the creation of Notebook Connections.
This is now the recommended place to initialize and configure all Fabric environment settings.

2. NB_UTILITIES_SETUP_FMD Converted to Python

The utilities notebook has been migrated to pure Python for better maintainability.
Additionally:

• The new %run Notebook support is leveraged
• Code volume is reduced
• Maintainability is improved
• The setup process is now cleaner and more modular

See Microsoft Fabric’s feature announcement for more details:
🔗Develop, execute, and manage notebooks

Bug Fixes & Community Contributions

A huge thank‑you to the community for reporting issues and submitting pull requests!
This release includes:

• Minor bug fixes
• Stability improvements
• Quality‑of‑life enhancements informed by your feedback

Your contributions directly shape and refine the framework.

Looking Ahead

The March 2026 release marks another strong step toward making FMD a more enterprise‑ready, automatable, and maintainable accelerator for Microsoft Fabric.

Whether you’re configuring ingestion, managing environments, or building scalable workloads, this release delivers meaningful improvements across governance, performance, and usability.

If you haven’t yet upgraded your notebooks or pipelines, now is a great time to explore the new capabilities.

Stay Connected

GitHub Repository
👉FMD_FRAMEWORK

Hit Subscribe to get future release notes delivered straight to your inbox!