Deployment

Data Cataloging & Pipeline Engineering

Build a governance-first data pipeline from Unity Catalog design through a full Bronze/Silver/Gold medallion pipeline with CI/CD.

~15h·13 scenarios·0-2 years

Scenario

Your Skill Path

13 modules · Masterclasses, hands-on scenarios & timed mock tests

Setting up Unity Catalog — Catalogs, Schemas & Namespace Design

Data StewardshipScenario

Data Profiling — Analyzing Source Data for Quality, Structure & Completeness

Data StewardshipScenario

Implementing Access Controls & Governance Policies in Unity Catalog

Data StewardshipScenario

Designing a Dimensional Model — Star Schema, Fact & Dimension Tables

Data ModellingScenario

Schema Design & Evolution Planning for Multi-source Pipelines

Data ModellingScenario

Source Connectivity & Raw Data Ingestion into Bronze Layer

Data EngineeringScenario

Building Silver Layer — Data Cleaning, Schema Evolution & Constraints

Data EngineeringScenario

Building Gold Layer — Aggregations, Business Logic & Dimensional Loading

Data EngineeringScenario

Incremental Data Loading — Patterns, CDF & Idempotency

Data EngineeringScenario

Streaming Ingestion with Auto Loader — Schema Handling & Checkpointing

Data EngineeringScenario

Workflow Orchestration — Building & Scheduling Multi-task Pipelines

Data EngineeringScenario

CI/CD Setup with Azure DevOps — Git Integration & Pipeline Automation

Data EngineeringScenario

Data Reconciliation — Validating Pipeline Output Across Layers

Data EngineeringScenario

Get a walkthrough of this skill path and see how Enqurious can accelerate your growth on Databricks.