Collection of all ADF Mapping Data Flow videos
ADF Mapping Flow
Did you use the Dataflow preview functionality in Azure Data Factory? This has recently be renamed to Mapping Data Flows.
All video’s which the ADF team has created, are collected.
Start Here:
- ADF Data Flow: Overview
- ADF Data Flow: Data Flow Scenarios
- ADF Data Flows: Getting started
- Getting started with ADF Data Flows from Altius
- Getting started with Mapping Data Flows by Adam from Azure 4 Everyone
Debug and Prep:
- ADF Data Flow: Debug Session, Pt 1
- ADF Data Flow: Debug Session, Pt 2 Data Prep
- ADF Data Flow: Debug and Test Lifecycle
- Mapping and Wrangling: Data Exploration
- Debug and testing End-to-End in Mapping Data Flows
- Data Masking for Sensitive Data
- Benchmark Timings
- Dynamically optimize data flow cluster size at runtime
Transformations:
- ADF Data Flows: Joins
- ADF Data Flows: Pivot Transformation
- ADF Data Flows: Window Transformation
- ADF Data Flows: Alter Row Transformation
- ADF Data Flows: Surrogate Key Transformation
- ADF Data Flows: Lookup Transformation
- ADF Data Flows: Aggregate Transformation
- ADF Data Flows: Derived Column Transformation
- ADF Data Flows: Union Transformation
- ADF Data Flows: Unpivot Transformation
- ADF Data Flows: Exists Transformation
- ADF Data Flows: Filter Transformation
- ADF Data Flows: Conditional Split Transformation
- ADF Data Flows: Select and New Branch
- ADF Data Flows: Flatten Transformation
- ADF Data Flow Sources: CosmosDB
- Fuzzy Lookups
- Quick Transformations
- Drifted Columns using Pivot
- Source & Sink Transformations: Partitioned Files
- ADF Data Flows: New Datasets Parquet and Delimited Text
- JSON Transformations
- Infer Data Types
- Dynamic Joins and Lookups
Optimize:
- ADF Data Flow: Monitoring UX
- ADF Data Flow: Data Lineage
- ADF Data Flow: Optimize Data Flows
- ADF Data Flow: Iterate files with parameters
- ADF Data Flow: Decrease start-up times
- ADF Data Flow Perf: SQL DB
- Optimize compute environment
Patterns:
- ADF Data Flow: Staging Data Pattern
- ADF Data Flow: Clean Addresses Pattern
- ADF Data Flow: ETL DW Load Pattern
- ADF Data Flow: Deduplication of your Data
- ADF Data Flow: Merge Files
- ADF Data Flow: SCD Type 1 Overwrite
- ADF Data Flow: SCD Type 2 History
- ADF Data Flow: Fact Table Loading
- ADF Data Flow: Logical Models
- ADF Data Flow: Detect source data changes
- ADF Data Flow: Schema Drift Handling
- Flexible Schema Handling with Schema Drift
- ADF Data Flow: Parameters
- Transform SQL Server on-prem with delta data loading pattern
- SCD Type 1 and Type 2 demo by Bob Rubocki
- Rule-based Mapping
- Distinct Row & Row Counts
- Handling truncation errors
- Partition your files in the data lake
- Intelligent data routing
- Transform and Create Multiple Tables
- Data Quality Patterns
- Self-join patterns
- Data lake file output options
- Evolving database schema handling
Expressions:
Do you want to know more or you want to try out some examples, you can find them here
Feel free to leave a comment
1 Comment
Leave a Reply
This site uses Akismet to reduce spam. Learn how your comment data is processed.
Discover more from Erwin | Data & Intelligence
Subscribe to get the latest posts sent to your email.
Hi Kromerm ,
I have a scenario where I need to capture the errors from Execute pipeline Activity, which consists of dataflows and copy activity.
can you please help on this.
BR,
Sai.