🖥️
DE Zoomcamp Notes
search
Ctrlk
Linkedin | Kayla TinkerGithub | Tinker0425Blog | From Clouds to CodeBlueSky | Cloudy Blue Wave
🖥️
DE Zoomcamp Notes
  • hand-waveWelcome - Data Engineering Zoomcamp 2025 Notes
  • INTRODUCTION
    • 0Introduction & Set Up
  • MODULE 1
    • 1Introduction to Module 1
    • 1.1 - Google Cloud Platform GCP
    • 1.2 - Docker & Docker-compose
    • 1.3 - Setting up infrastructure on GCP with Terraform
    • memo-circle-checkHomework
  • Module 2
    • 2Introduction to Module 2
    • 2.1 - Introduction to Orchestration and Kestra
    • 2.2 - ETL Pipelines in Kestra: Detailed Walkthrough
    • 2.3 - ETL Pipelines in Kestra: Google Cloud Platform
      • k2.3.1 - Create an ETL Pipeline with GCS and BigQuery in Kestra
      • k2.3.2 - Manage Scheduling and Backfills using BigQuery in Kestra
      • k2.3.3 - Transform Data with dbt and BigQuery in Kestra
    • Bonus: Deploy to the Cloud
    • memo-circle-checkHomework
  • Module 3
    • 3Introduction to Module 3
    • 3.1 - Data Warehouse, Partitioning and Clustering
    • 3.2 - BigQuery Internals and Best Practices
    • 3.3 - Machine Learning
    • memo-circle-checkHomework
  • Workshop
    • wWorkshop Week
    • memo-circle-checkHomework
  • Module 4
    • 4Introduction to Module 4
    • 4.1 - DBT the basics
    • 4.2 - Creating your Project
    • 4.3 - Deployment & Visualizations
    • memo-circle-checkHomework
  • Module 5
    • 5Introduction to Module 5
    • 5.1 - Install & Intro
    • 5.2 - Spark SQL and DataFrames
    • 5.3 - Spark Internals
    • 5.4 - Running Spark in the Cloud
    • memo-circle-checkHomework
  • Module 6
    • 6Introduction to Module 6
    • 6.1 - Stream Processing
    • memo-circle-checkHomework
  • Final Project
    • memo-circle-checkFinal Project
    • pHow To!
    • octagon-exclamationTHE END
gitbookPowered by GitBook
Page cover
block-quoteOn this pagechevron-down
  1. Module 2

2.3 - ETL Pipelines in Kestra: Google Cloud Platform

k2.3.1 - Create an ETL Pipeline with GCS and BigQuery in Kestrachevron-rightk2.3.2 - Manage Scheduling and Backfills using BigQuery in Kestrachevron-rightk2.3.3 - Transform Data with dbt and BigQuery in Kestrachevron-right
Previous2.2.3 - Transform Data with dbt and Postgres in Kestrachevron-leftNext2.3.1 - Create an ETL Pipeline with GCS and BigQuery in Kestrachevron-right

Connect

  • Linkedin | Kayla Tinker
  • BlueSky | Cloudy Blue Wave
  • Blog | From Clouds to Code
  • Github | Tinker0425