2.3.2 - Manage Scheduling and Backfills using BigQuery in Kestra

Last updated Jan 30, 2025

Youtube Video | ~5 min

https://youtu.be/DoaZ5JWEkH0

✍️ Goal is to include a trigger to add the taxi datasets moving forward, and also backfilling in years past.

🗄️ Working files can be found here

Not found

In Kestra: Flow 6 scheduled -> Saved -> Triggers -> backfill

❗Maybe it is my good-ole Alaska wifi, but I can only backfill a couple months at a time. I tried to do yellow taxi 2020 as a full year, but it timed out on me.

👀 Take a look at the homework questions, and determine which and when you should download these files