#034: Getting Started w/ Prefect (Task Orchestration)
Mar 15, 2023It's one thing to build a data stack. It's another to orchestrate it.
Plus, most modern stacks consist of many different tools which makes it all the more challenging.
Fortunately, there are tools designed to address this exact issue (task orchestration) and make our lives as data engineers easier.
So in today's video, I want to show you how to use a great open-source task orchestration tool called Prefect.
Prefect is a tool I've personally used on recent consulting projects to automate data workflows and have started to really enjoy using.
By the end of this video you'll understand what Prefect is all about and how you can easily start using it in your own data stack.
Enjoy!
What will you learn?
- What Prefect is & how data teams use it
- How to create your first data workflow
- How to run workflows on Prefect Cloud (for free)
When you're ready, here are 2 other ways I can help you:
1. Simple Stack Academy: Level-up your data career by learning more than just SQL. Design, build & automate an end-to-end data architecture using modern tools like dbt⢠& Github. (Free 7 Day Preview)
2. Consulting Services: Get personalized support to properly implement a well-structured, scalable, and maintainable data architecture at your company.