#063: How to Create a 3 Layer Data Model Pipeline
May 01, 2024A data warehouse acts as the main hub for most data teams, yet it often becomes a mess.
While there are many different strategies to handle this, in this video I want to share the approach I follow.
It's based around a simple 3-layered design to take raw source data into meaningful data marts ready for analytics.
The main things we'll cover include:
- A high level pipeline overview (source to analytics)
- A simple example of each layer (staging, warehouse & marts)
- The importance of data modeling, even on modern DBs
Enjoy!
When you're ready, here are 3 ways I can help you further:
1. The Modern Engineer Playbook (Online Course): Master the art of building modern data architectures. Get an end-to-end blueprint for building simple, structured & scalable data pipelines with modern tools.Â
2. The Playbook for dbt™ (Online Course): Learn to build, automate & scale dbt™ with confidence. Discover common strategies teams follow, avoid costly rookie mistakes & get actionable tips based on real-world experience, not a textbook.
3. Consulting Services:Â Request to work 1:1 with Michael Kahan to help you and your team implement a modern data architecture with a simple, scalable structure.