How to Structure AI Projects for Data Engineering

Apr 02, 2026

Like any data tool, using AI like Claude Code with no structure is a risky play.

On one hand, it's exciting and freeing to have unlimited options.

It's fun to let the AI take the wheel and watch the magic happen.

 

On the other, that freedom can become a runaway train if you're not paying attention.

So how can you leverage this tech while still keeping things under control?

This is a big topic and constantly evolving.

 

But in this week's video, we're going to start with the basics.

We're going to talk about a critical file in Claude Code called CLAUDE.md.

And how it works with the rest of your AI project.

 

We'll cover:

  • How this one file plays a pivotal role in maintaining the structure
  • How this compares to typical AI prompting
  • An example AI project architecture layout (APT/PAT? Framework)
  • Tips to expedite your setup 

 

By the end, you'll have a better understanding of how tools like Claude Code (and other AIs) operate.

And start thinking more about ways to structure your project going forward.

 

 

Get More Resources & Connect With 1,000+ Data Engineers

Join a free private community to access resources, templates, and training designed to help you build modern data architectures with confidence

👉 Join The Free Community