Data Science at Home cover image

There Is No AI. There's a Stateless Function on 10,000 GPUs Pretending to Know You (Ep. 299)

Data Science at Home

00:00

Key numbers for serving LLMs

Francesco reviews model weight sizes, GPU node specs, and context window scale for large language models.

Play episode from 01:23
Transcript

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app