2.1.1 - Workflow Orchestration Introduction
Last updated Jan 25, 2025
Last updated
Last updated Jan 25, 2025
Last updated
Youtube Video | ~9 min
This video is a brief introduction to what orchestration and Kestra mean.
To come this week, we will learn more about Kestra, load our data into Postgres and GCP, parameterizing execution, learn about scheduling and backfills, and then we will install Kestra on the cloud and sync your flows with git.
Kestra is a platform we use to 'Orchestrate' our tasks. Like an orchestra, certain 'instruments' play at different times, and they all come together to create what we need.
In the video, we go through a Kestra demo with python and sql. This reminds me of a combination between what I would personally use powershell or powerautomate for. I really like the Gnatt chart that separates what is being run, if it was successful, and what the outputs were.
