LessWrong (30+ Karma)

“My most common advice for junior researchers” by LawrenceC

Apr 2, 2026
Lawrence C, a writer and researcher who mentors junior researchers, shares practical advice for sanity checks, clarity, and deeper questioning. He highlights quick sanity checks for ideas and data. He talks about checking correlations, inspecting examples and outliers, using small concrete tests, and when to stop digging. Short, practical, and cautionary guidance.
Ask episode
AI Snips
Chapters
Transcript
Episode notes
ADVICE

Do Fast Sanity Checks Early

  • Do quick sanity checks before diving deep into research to avoid wasting hours or months.
  • Check basic correlations, means, SDs, and ask if your idea or data have obvious biases like selection bias or wrong prompts.
ADVICE

Know Your Data's High Level Stats

  • Quantitatively know your dataset at a high level by computing summary statistics and key dimensions of variation.
  • Example checks include mean and standard deviation, how many tool calls LLM agents make, and their success rates.
INSIGHT

Failures Can Be Refusal Not Incapability

  • LLM failures often stem from refusal to perform the task rather than lack of capability.
  • Inspect typical chains of thought and outliers to see if models are confused or simply refusing to comply.
Get the Snipd Podcast app to discover more snips from this episode
Get the app