Azure Data Factory (ADF) is a Microsoft Azure Platform-as-a-Service offering that provides auto-scale-out data movement and data transformation pipelines for building data integration and ETL/ELT workflows.
This is a hands-on lab for Azure Data Factory based on the V2 service that walks you through building an ETL pipeline as well as Lift & Shift of your SSIS on-prem packages into ADF.
SPECIAL NOTE: There are several very large database backup files in the Deployment Files folders. I have shredded those into ZIP files to fit within the Github file size restrictions. You will need to download them and use 7zip to put them back together before running the deployment scripts.
Each Lab Module has an accompanying video that walks you through the module overview and learnings. Each video is hosted on our ADF YouTube channel and can be found here:
- Intro Video
- Lab 1: Setting up ADF V2 and Resource Groups
- Lab 2: Lift and Shift SSIS packages to Azure with ADF
- Lab 3: Build ETL Process in ADF V2
- Lab 4: Enhance Data Integration with Cloud Sources
- Lab 5: Big Data Transformation in HDInsight with ADF V2
- Lab 6: Load Azure SQL Data Warehouse with ADF V2
- Lab 7: Schedule ADF Pipelines
- Lab 8: Monitor ADF Pipelines
- Lab 9: Final Lab Module - Bring it all together