Data Science at Home cover image

There Is No AI. There's a Stateless Function on 10,000 GPUs Pretending to Know You (Ep. 299)

Data Science at Home

00:00

Pre-fill vs decode and hardware split

Francesco covers pre-fill (processing input) and decode (token generation) and splitting work across specialized hardware.

Play episode from 21:32
Transcript

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app