Outer alignment: reward misspecification

Perrin Walker describes reward misspecification and gives examples like LLMs rewarded for convincing answers.

Play episode from 12:41

Transcript

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!