🖥️
DE Zoomcamp Notes
CtrlK
Linkedin | Kayla TinkerGithub | Tinker0425Blog | From Clouds to CodeBlueSky | Cloudy Blue Wave
  • Welcome - Data Engineering Zoomcamp 2025 Notes
  • INTRODUCTION
    • Introduction & Set Up
  • MODULE 1
    • Introduction to Module 1
    • 1.1 - Google Cloud Platform GCP
    • 1.2 - Docker & Docker-compose
    • 1.3 - Setting up infrastructure on GCP with Terraform
    • Homework
  • Module 2
    • Introduction to Module 2
    • 2.1 - Introduction to Orchestration and Kestra
    • 2.2 - ETL Pipelines in Kestra: Detailed Walkthrough
    • 2.3 - ETL Pipelines in Kestra: Google Cloud Platform
      • 2.3.1 - Create an ETL Pipeline with GCS and BigQuery in Kestra
      • 2.3.2 - Manage Scheduling and Backfills using BigQuery in Kestra
      • 2.3.3 - Transform Data with dbt and BigQuery in Kestra
    • Bonus: Deploy to the Cloud
    • Homework
  • Module 3
    • Introduction to Module 3
    • 3.1 - Data Warehouse, Partitioning and Clustering
    • 3.2 - BigQuery Internals and Best Practices
    • 3.3 - Machine Learning
    • Homework
  • Workshop
    • Workshop Week
    • Homework
  • Module 4
    • Introduction to Module 4
    • 4.1 - DBT the basics
    • 4.2 - Creating your Project
    • 4.3 - Deployment & Visualizations
    • Homework
  • Module 5
    • Introduction to Module 5
    • 5.1 - Install & Intro
    • 5.2 - Spark SQL and DataFrames
    • 5.3 - Spark Internals
    • 5.4 - Running Spark in the Cloud
    • Homework
  • Module 6
    • Introduction to Module 6
    • 6.1 - Stream Processing
    • Homework
  • Final Project
    • Final Project
    • How To!
    • THE END
Powered by GitBook
Page cover
On this page
  1. Module 2

2.3 - ETL Pipelines in Kestra: Google Cloud Platform

2.3.1 - Create an ETL Pipeline with GCS and BigQuery in Kestra2.3.2 - Manage Scheduling and Backfills using BigQuery in Kestra2.3.3 - Transform Data with dbt and BigQuery in Kestra
Previous2.2.3 - Transform Data with dbt and Postgres in KestraNext2.3.1 - Create an ETL Pipeline with GCS and BigQuery in Kestra

Connect

  • Linkedin | Kayla Tinker
  • BlueSky | Cloudy Blue Wave
  • Blog | From Clouds to Code
  • Github | Tinker0425