Very Bad Wizards

Episode 74: Lies, Damned Lies, and Ashley Madison

9 snips
Sep 16, 2015
Ask episode
AI Snips
Chapters
Transcript
Episode notes
INSIGHT

Replication Reveals Smaller, Fewer Effects

  • A large replication project retried 100 psychology studies and only ~1/3 replicated with significant results.
  • Mean effect sizes in successful replications were roughly half those reported originally.
INSIGHT

Treat Single Replications With Caution

  • Failed replications don't automatically prove original findings false, but they reduce confidence until multiple attempts converge.
  • Binary significance thresholds (p<.05) can misleadingly categorize near-identical outcomes as success or failure.
ADVICE

Replicate And Publish Negative Results

  • Researchers should attempt to replicate their own findings and publish null or failed replications.
  • Journals and incentives must shift to reward replications and reporting negative results.
Get the Snipd Podcast app to discover more snips from this episode
Get the app