Azure Data Engineer Skill Path

Advanced Data wrangling and Python code optimization

This module dives deep into writing a modular code for challenging data tasks and working with complex data structures like JSON

Big Data Foundations

This module introduces you to the world of big data storage and processing and why using monolithic systems is a bad design for big data

Significance of Cloud

This module introduces you to the need for using the cloud and how it solves the modern-day data problems in the industry

User Management in Azure

Working with Object storage on Azure Cloud

This module gives you a practical sense of data lakes, and when and where to use them. It also introduces you to the work of cloud SDK and how to use it programmatically Ingest the data from Data-Lakes

Working with Azure SQL

This module gives you to various databases on the cloud and how to connect to them This module also deep dives into the ingestion of data from these databases

Need for ETL for Organizations

This module dives deep into the need for ETL Pipelines

A Simple ETL using Python

This is a basic end to end project In which

Introduction to NoSql using CosmosDB

Explore the landscape of database solutions for NoSQL using Azure Cosmos, where we delve into why NoSQL is crucial in modern data handling. This module also briefly introduces you to various

Serverless ETL with Azure Data factory

This module gives a comprehensive overview of building Serverless ETL pipelines using Azure Data factory

ETL Pipeline Using ADF - Part 1

This scenario helps you implement the ADF skills acquired in the previous module.

Advanced Azure Data Factory

This module dives deep into solving core Data engineering problems using ADF. This module also touches upon how to optimize the pipelines to make it production-ready

ETL Pipeline Using ADF - Part 2

This scenario helps you implement the ADF skills acquired in the previous module.

Designing Streaming Pipelines in Azure

This module gives an in-depth exploration of processing live data streams. building scalable streaming applications and integration with various data sources.

Designing Logical Data Warehouse with Azure Synapse

Designing a Physical Data Warehouse with Azure Synapse

Data Governance with Azure Purview

Capstone Project

This is the end-to-end project covering having skills from across the path. You can choose and work with projects from catalog