Microsoft Fabric SQL Database my first experience

Microsoft Fabric SQL Database my first experience

by | Nov 26, 2024 | Articles, Microsoft Fabric Content HUB

Month: November 2024

​Microsoft Announces Public Preview of SQL Database in Microsoft Fabric

Microsoft has announced the Public Preview of the SQL database in Microsoft Fabric, a significant step towards simplifying and accelerating AI app development. This new service is designed to be simple, autonomous, secure, and optimized for AI, making it easier for developers to build AI applications. Today i had a quick look and was very impressed.

Key Highlights:

  • Simplicity: The SQL database in Fabric is designed to be user-friendly, reducing the complexity typically associated with database management.
  • Autonomy: It offers autonomous features that handle routine tasks, allowing developers to focus more on innovation.
  • Security: Enhanced security measures ensure that data is protected, meeting the highest standards.
  • AI Optimization: The service is optimized for AI, providing the necessary tools and infrastructure to support AI-driven applications.

Benefits:

  • Faster Development: Developers can build AI apps up to 71% faster and more effectively.
  • Unified Platform: Fabric evolves from an analytics platform to a comprehensive data platform, integrating operational databases seamlessly.

Hands-On Experience:

Today, I took the opportunity to get some hands-on experience with this new database in my environment. Setting up the database was incredibly easy and took less than a minute. Here’s a quick guide to get you started:

SQL_Fabric_Item

  1. Click on "New Item".
  2. Select "SQL Database" and define a name (I always start with SQL_).
  3. After 60 seconds, your database is ready to use.

To connect to the database, if you are using tools like SSMS, make sure to add the database name to the connection pane to avoid errors related to the master database.

SQL_FABRIC_SSMS

Once connected, you can perform your day-to-day SQL server tasks with ease. Additionally, you can use the database as a source or sink in Data Flows and Pipelines with copy activity and stored procedures activities in Microsoft Fabric or start building an API on top of your data.

I deployed my database project file from Azure Data Studio to the newly created database and that took only like 5 seconds. Next is to copy the data over. I tried to restore a dacpac or bacpac file, but did not succeed yet so far. After that, I connected my database to Git and you know what, all my objects from the database are in there. Awesome!"

For more details, including demo videos and customer testimonials, check out the full blog post here.

Conclusion:

The Public Preview of the SQL database in Microsoft Fabric is a game-changer for developers looking to build AI applications. Its simplicity, autonomy, security, and AI optimization make it an invaluable tool for accelerating development and enhancing productivity. As Microsoft continues to innovate and expand its offerings, the SQL database in Fabric stands out as a testament to the company's commitment to providing cutting-edge solutions for the modern developer. I'm definitely going to use this new database for my Meta Data driven Framework, no Azure SQL Deployment, network setup, Private endpoint setup anymore, just start and connect.

SQL database in Fabric will be free until January 1, 2025, after which compute and data storage charges will begin, with backup billing starting on February 1, 2025.

Next

Microsoft Learn: Implement operational databases in Microsoft Fabric

Azure SQL - YouTube

Get Started

This is a live learning session where you can ask questions and learn all of the basics of SQL database and Microsoft Fabric in one course, register here.

Learn Together: SQL database in Fabric

 

 

Feel free to leave a comment

New Features in Fabric Data Factory Import/Export

New Features in Fabric Data Factory Import/Export

by | Nov 11, 2024 | Articles, Microsoft Fabric, Microsoft Fabric Content HUB

Month: November 2024

New Features in Microsoft Fabric Data Factory: Import, Export, and Use Templates in Data Pipelines

The latest enhancements in Fabric Data Factory that will significantly streamline your data integration processes. The new features—Import, Export, and Use Templates—are now available, making it easier than ever to manage and automate your data pipelines.

Fabric Import/Export labels

Import Data Pipelines

The Import feature allows you to bring in existing data pipelines from other workspaces or projects. This is particularly useful for teams that need to replicate successful data workflows across different departments or for those migrating from other data integration tools. With a few clicks, you can import your pipelines, ensuring consistency and saving valuable time.

How to Import a Data Pipeline:

  1. Navigate to the Data Pipelines section in Data Factory.
  2. Click on the “Import” button.
  3. Select the file or source from which you want to import the pipeline.
  4. Follow the prompts to complete the import process.

Export Data Pipelines

Exporting your data pipelines is now a breeze. This feature enables you to back up your pipelines, share them with colleagues, or move them to different workspaces. Exporting ensures that your data integration processes are portable and can be easily restored or replicated.

How to Export a Data Pipeline:

  1. Go to the Data Pipelines section.
  2. Select the pipeline you wish to export.
  3. Click on the “Export” button.fabric-export
  4. Complete the export process by following the on-screen instructions.
  5. Sensitivity labels will be removed
  6. Your Pipeline will be saved as .zip file in your default download folder.

Fabric Import/Export pipeline

 

Use Templates

Templates are a powerful addition to Data Factory, allowing you to standardize and accelerate the creation of data pipelines. Whether you are setting up a new ETL/ELT process or automating data transfers, templates provide a starting point that can be customized to meet your specific needs.

How to Use Templates:

  1. In the Data Pipelines section, click on the “Templates” button.
  2. Browse through the available templates or search for a specific one.
  3. Select a template and click “Use Template.”
  5. Configure the required inputs
  6. Click on Use this Template, the required activities will now be deployed to your pipeline.

More on templates can be found here.

NOTE:

Import Data Pipelines from Azure Data Factory or Synapse Workspace is not supported. Migration steps will follow later.

The main difference between Microsoft Fabric and ADF or Synapse is, that we use in Fabric connections and ADF/Synapse datasets and Linked services

fabric-import-adf-synapse

Conclusion

The new Import, Export, and Use Templates features in Data Factory are designed to enhance your productivity and ensure seamless data integration. By leveraging these tools, you can simplify your workflows, maintain consistency across projects, and accelerate the configuration of data pipelines.

Feel free to leave a comment