Latent Space: The AI Engineer Podcast cover image

[LIVE] Anthropic Distillation & How Models Cheat (SWE-Bench Dead) | Nathan Lambert & Sebastian Raschka

Latent Space: The AI Engineer Podcast

00:00

Information Theory and Memorization Dynamics

swyx and Sebastian touch on information theory, superposition, and how LLMs can memorize from limited exposure.

Play episode from 41:52
Transcript

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
 Get the app