Azure Data Factory | Data Engineering on the Cloud
Get hands on and build a modern data lake with Azure Data Factory (ADF), Data Lake Storage, Azure SQL and more! (DP203)
Description
Hello students!
I am pleased to present this course on one of the most in demand data engineering tools around... Azure Data Factory!
As the demand for cloud-based data integration services continues to skyrocket, there is a huge demand for professionals with knowledge of services like Azure Data Factory. By learning Azure Data Factory, users can enhance their skills and increase their job prospects in the field of data engineering and analytics.
In this course you will primarily be using Azure Data Factory on Microsoft Azure in addition to other services such as Azure Blob Storage, Azure Data Lake Storage Gen 2 and Azure SQL Database.
The course is packed with lectures, code-along videos and a dedicated course project. As an added benefit you will also have lifetime access to all of the lectures…
This course will cover the following topics:
Azure Storage Solutions such as Azure Blob Storage and Azure Data Lake Gen2 Storage
The basics of Azure Data Factory including the core components such as Linked Services, Datasets, Activities, Data Flows, Pipelines and Integration Runtimes
Integrating data from various file formats such as CSV, JSON and Parquet
The Copy Activity in Azure Data Factory
Data Flows, Control Flow and Transformation Activities in Azure Data Factory
Orchestrating Data Integration Workflows
How to create Schedules and Triggers to execute your pipelines
How to use Parameters and Variables with your Linked Services, Datasets and Pipelines
How to use Azure Data Factory with SQL Databases
Authentication and Access including Managed Identities, Service Principals and Azure Key Vault
What You Will Learn!
- Overview and Background of Azure Big Data Analytics Solutions
- Azure Data Factory
- Azure Storage Accounts
- Azure SQL Databases and Upsert Operations
- Integrating Data From Various File Formats
- Authentication and Access: Service Principals, Managed Identities and Azure Key Vault
- Data Pipelines, Copy Activity, Data Flows, Control Flow and Transformation Activities
- Implementing a Modern Data Lake
- Control Flow, Parameters and Variables
- Real World Application of Azure Data Factory
Who Should Attend!
- Anyone interested in Azure or Cloud Data Engineering
- Anyone interested in working with Big Data
- Anyone working with cloud data