Modern Data Workflows - Explained
Mar 06, 2024Modern data engineering isn't all about tools & technologies.
One area that's often overlooked is the concept of a team development workflow.
This includes everything from environments, naming conventions, automation and more.
Yet even today, many teams still save straight to Production.
I'll admit - those are some fun times and it can feel like you can execute incredibly fast.
But it comes at the cost of quality and unnecessary errors.
It's not a secret - you shouldn't be doing that.
Nowadays, you can move fast while still having a more formal process with automation that saves you time (and catches your errors).
So in today's video you'll learn more about this process and how to potentially implement it on your own team.
What will you learn?
- Why having a structured development workflow is important
- High level process of common team workflows
- An example implantation with dbt & Snowflake
Enjoy!
When you're ready, here are 2 other ways I can help you:
1. Simple Stack Academy: Level-up your data career by learning more than just SQL. Design, build & automate an end-to-end data architecture using modern tools like dbt⢠& Github. (Free 7 Day Preview)
2. Consulting Services: Get personalized support to properly implement a well-structured, scalable, and maintainable data architecture at your company.