Tristan Handy - Balancing Competing Tensions and Handling Complexity
The Joe Reis Show
00:00
The Problem With Scaling Large Data Models
The largest dbt project that I'm aware of has 39,000 data models today. So it's a lot and That is not an in and of itself a problem. It's like saying oh We write too much software code today. And so we need the constructs to enable you to kind of decompose your your big dbt code base into many Different parts and then allow those parts to like kind of be reintegrated with one another using Well-defined interfaces that are mature and reliable.
Play episode from 24:48
Transcript
