MLOps.community  cover image

Python Power: How Daft Embeds Models and Revolutionizes Data Processing // Sammy Sidhu // #165

MLOps.community

00:00

DAFT: A Distributed Data Frame for Unstructured Data

DAFT is a distributed data frame that's all Pythonic, but the entire engines right now in Rust. The idea is that you can load in all of this data and then you can query it easily. And what it looks like to you is you're just building this query using a lazy API. It will actually run it on a cluster using this query plan that it develops, but then also intimately understands the data it's running on. So no more um errors and very optimal queries for complex data.

Play episode from 17:44
Transcript

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app