Industry
e-commerce
Skills
approach
Tools
snowflake
Learning Objectives
Learners will understand how to load raw data from Azure Blob Storage into Snowflake’s Bronze Layer using external stages and the COPY INTO command.
Learners will know about Medallion Architecture and what is the significance it holds in data architecture.
Learners will learn how to define file formats for CSV data, handle errors during data loading, and validate the accuracy of the ingested data.
Overview
In this module, you will learn how to load raw data from Azure Blob Storage into Snowflake’s Bronze Layer, a crucial step in data warehousing. You’ll follow the process of setting up a Snowflake database and schema, creating an external stage for Azure Blob Storage, and defining file formats for loading CSV files. Through hands-on practice, you'll explore how to query data directly from the stage, create tables in Snowflake’s Bronze Layer, and load data into these tables. This module is designed to give you foundational skills in data ingestion using Snowflake and Azure, setting the stage for further transformation and analysis in subsequent layers.
Prerequisites
- Familiarity with Snowflake’s architecture, including databases, schemas, and stages.
- Ability to write SQL queries for creating tables, loading data using COPY INTO, and performing basic data validation.
- Understanding how data is stored in Azure Blob Storage and how to access it securely using SAS tokens.