LessWrong (30+ Karma) cover image

“A List of Research Directions in Character Training” by Rauno Arike

LessWrong (30+ Karma)

00:00

Re-evaluating distillation: DPO vs on-policy

Discussion of DPO limitations and recent work advocating on-policy and self-distillation for better credit assignment.

Play episode from 02:25
Transcript

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app