Collection of all ADF Mapping Data Flow videos
ADF Mapping Flow
Did you use the Dataflow preview functionality in Azure Data Factory? This has recently be renamed to Mapping Data Flows.
All video’s which the ADF team has created, are collected.
- ADF Data Flow: Overview
- ADF Data Flow: Data Flow Scenarios
- ADF Data Flows: Getting started
- Getting started with ADF Data Flows from Altius
- Getting started with Mapping Data Flows by Adam from Azure 4 Everyone
Debug and Prep:
- ADF Data Flow: Debug Session, Pt 1
- ADF Data Flow: Debug Session, Pt 2 Data Prep
- ADF Data Flow: Debug and Test Lifecycle
- Mapping and Wrangling: Data Exploration
- Debug and testing End-to-End in Mapping Data Flows
- Data Masking for Sensitive Data
- Benchmark Timings
- Dynamically optimize data flow cluster size at runtime
- ADF Data Flows: Joins
- ADF Data Flows: Pivot Transformation
- ADF Data Flows: Window Transformation
- ADF Data Flows: Alter Row Transformation
- ADF Data Flows: Surrogate Key Transformation
- ADF Data Flows: Lookup Transformation
- ADF Data Flows: Aggregate Transformation
- ADF Data Flows: Derived Column Transformation
- ADF Data Flows: Union Transformation
- ADF Data Flows: Unpivot Transformation
- ADF Data Flows: Exists Transformation
- ADF Data Flows: Filter Transformation
- ADF Data Flows: Conditional Split Transformation
- ADF Data Flows: Select and New Branch
- ADF Data Flows: Flatten Transformation
- ADF Data Flow Sources: CosmosDB
- Fuzzy Lookups
- Quick Transformations
- Drifted Columns using Pivot
- Source & Sink Transformations: Partitioned Files
- ADF Data Flows: New Datasets Parquet and Delimited Text
- JSON Transformations
- Infer Data Types
- Dynamic Joins and Lookups
- ADF Data Flow: Monitoring UX
- ADF Data Flow: Data Lineage
- ADF Data Flow: Optimize Data Flows
- ADF Data Flow: Iterate files with parameters
- ADF Data Flow: Decrease start-up times
- ADF Data Flow Perf: SQL DB
- Optimize compute environment
- ADF Data Flow: Staging Data Pattern
- ADF Data Flow: Clean Addresses Pattern
- ADF Data Flow: ETL DW Load Pattern
- ADF Data Flow: Deduplication of your Data
- ADF Data Flow: Merge Files
- ADF Data Flow: SCD Type 1 Overwrite
- ADF Data Flow: SCD Type 2 History
- ADF Data Flow: Fact Table Loading
- ADF Data Flow: Logical Models
- ADF Data Flow: Detect source data changes
- ADF Data Flow: Schema Drift Handling
- Flexible Schema Handling with Schema Drift
- ADF Data Flow: Parameters
- Transform SQL Server on-prem with delta data loading pattern
- SCD Type 1 and Type 2 demo by Bob Rubocki
- Rule-based Mapping
- Distinct Row & Row Counts
- Handling truncation errors
- Partition your files in the data lake
- Intelligent data routing
- Transform and Create Multiple Tables
- Data Quality Patterns
- Self-join patterns
- Data lake file output options
- Evolving database schema handling
Do you want to know more or you want to try out some examples, you can find them here
Feel free to leave a comment
Goodbye 2021Recap First of all, I would like to wish everyone a very beautiful and healthy 2022. We are now 3 days on the road into the new year and it is always good to look back at what happened last year. It's certainly been an eventful year, topped off with my MVP...
Yeah, my first built website is LIVEThe last couple of weeks I've been working hard to design my website and finally the moment is there. My website live and I'm really proud. Building my own website The last couple of weeks/months I've been working hard... to...
Data Factory pricingAre you also having problems to understand the Pricing Model for Azure Data Factory? After some research on the internet I came across an article which I wanted to share with you. ADFV2 Pricing ExamplesFeel free to leave a comment
Changing jobsAfter almost 11 years and 4 months I have decided to leave Axians and to start a new adventure in the new year. On January 2, 2020 I will start my day as Lead Data and AI at InsparkThe past years have flown by. I started at Eniac BI, which was...
Lead Enterprise Architect ProgramFrom the 4th of December until the 6th of December I've joined the LEAP (Lead Enterprise Architect Program) 2018 Data/AI from Microsoft NL. Three days on the Microsoft Campus in Redmond joining business and technical sessions from a...
Meta Data ActivityToday my pipelines in Azure Data Factory (ADF) suddenly stopped working. The output structure was not found. Quit strange while these pipelines have been running for weeks. Invalid Template After debugging my Pipeline I found out the...
New functionalities and featuresLast week, a number of great new functionalities and features were added within Azure Data Factory. I would like to take you in some details in the blog below:Customer key With this new functionality you can add extra security to your...
Azure Purview Ignite 2021 AnnoucementPricing This week the Azure Purview announced that they will extend the Azure Purview offer to provision 4 Capacity Units of the Data Map for free till May 31, 2021! Charging will start on June 1, 2021. Great news for customer who...
Saving a PipelineAnother great improvement in Azure Data Factory. Saving you template!How can you save your template? First of all you need to connect your Azure Data Factory to a GIT integration. Both Azure DevOps GIT and GitHub are supported. Please follow this...
A hybrid conference in Seattle and online This year's PASS Data Community Summit is more than a conference – it's a homecoming. Reconnect with old friends, build new relationships, gain new skills, and get the world-class training you need to take that next step in...