Azure Data Factory - Data Engineering With Real Time Project

Posted By: lucky_aut

Azure Data Factory - Data Engineering With Real Time Project
Last updated 6/2024
Duration: 15h 37m | .MP4 1280x720 30 fps(r) | AAC, 44100 Hz, 2ch | 5.86 GB
Genre: eLearning | Language: English

Real Time Project Using Azure Data Factory , ADLS Gen2 , Azure SQL Database , Key Vault , Logic Apps and Azure Monitor

What you'll learn
- Design and Development of Azure Data Factory Pipelines for Data Ingestion
- Design and Development of Azure Data Factory Pipelines for Data Transformation & Loading
- Design and Development of Azure Data Factory Pipelines for Data Analytical Reporting Database
- Design and Development of Azure Data Factory to process Semi Structured Data

Requirements
- None

Description
The course includes most of the  Real Time Scenarios on Developing Data Analytical Project.

Creating and Configuring Azure Data Lake Storage Gen2, Azure Data Factory, Azure SQL Database

Developing Metadata Driven Ingestion Pipeline to load source data into the Azure Data Lake Storage Account

Expertise knowledge on Lookup , Foreach and Copy activities for Ingesting the Source Data

Dimensional Modelling Design To Design Dimension and Fact Tables

Creating the Dimension Tables in Azure SQL Database

Design and Developing the Azure Data Factory  pipelines to load Type1 Dimension Tables

Design and Development of Type2 Dimension Tables load using Azure Data Factory Pipeline

Design and Development of Fact tables using Azure Data Factory Pipeline

Performing Incremental Load in Data Ingestion and Data Transformation Azure Data Factory Pipeline to Process Delta data

Processing Semi Structured data using Azure Data Factory Dataflow Components

Automate the Azure Data Factory pipeline run using different type of Triggers Schedule , Tumbling Window and Event

Configuring Security between Azure Data Factory, Azure Data Lake Storage Account , Azure SQL Database and Azure Key Vault

Using Azure Key Vault to store the Secrets and use the Secrets in ADF pipelines

Monitoring the ADF pipeline runs using ADF Monitor and Azure Monitor

Debugging and Error Handling of Azure Data Factory Pipelines

Who this course is for:
- Switch Over to Data Analytics Jobs, Students , Datawarehouse & Business Intelligence Developers, Non Cloud Software Developers
More Info