Latent Space: The AI Engineer Podcast cover image

[LIVE] Anthropic Distillation & How Models Cheat (SWE-Bench Dead) | Nathan Lambert & Sebastian Raschka

Latent Space: The AI Engineer Podcast

00:00

Logit Distillation and Open-Weight Advantages

Sebastian and swyx explain logits-based distillation limits with closed APIs and benefits of open-weight teachers for control.

Play episode from 21:04
Transcript

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app