CoRecursive: Coding Stories Tech Talk: Rethinking databases and Noria with Jon Gjengset
14 snips
Apr 30, 2019 
Jon Gjengset, a leader on the Noria project at MIT CSAIL, dives into innovative database management. He discusses how Noria redefines performance by integrating caching directly into the database, using materialized views for query optimization. Jon elaborates on the ingenious data flow model and how it enhances cache management compared to traditional systems like MySQL. He also shares insights on teaching Rust through live coding, showcasing its unique features that prevent bugs while empowering developers.
AI Snips
Chapters
Transcript
Episode notes
Database Inside Out Concept
- Noria conceptually turns the database inside out, processing writes first and then maintaining materialized views.
- This approach parallels CQRS and Kafka patterns but infers the processing declaratively from SQL queries.
Powerful Multi-Query Optimization
- Noria applies multi-query optimization by jointly analyzing all application queries to optimize cache maintenance.
- This allows it to infer indexes, sharding, and intermediate materializations automatically.
Distributed Scaling with Sharded Views
- Noria scales beyond a single server by partitioning and sharding its operator graph across machines or cores.
- Each materialized view shard lives on one server/core, enabling parallel and distributed computation.