The Behavioral Economics in Marketing’s Podcast

Sample Selection Bias | Definition Minute

Oct 18, 2021
A quick take on how picking non-random data skews results and creates systematic errors. A classic 1936 polling failure is used to show how excluded groups warp predictions. A contrast with a smaller, truly random poll highlights the difference sampling methods make.
Ask episode
AI Snips
Chapters
Transcript
Episode notes
INSIGHT

How Sample Selection Bias Distorts Results

  • Sample selection bias arises when data chosen for analysis is non-random and systematically flawed.
  • Excluding subsets by attribute, technique, or location skews results and significance.
ANECDOTE

The 1936 Polling Failure

  • The 1936 Literary Digest poll predicted Alf Landon would beat Franklin Roosevelt using 2 million mailed surveys.
  • The sample over-represented wealthy car and phone owners, producing a misleading result corrected by Gallup's smaller, random poll.
INSIGHT

Size Doesn’t Fix A Biased Sample

  • Larger sample size cannot fix biased sampling if the selection process over-represents certain groups.
  • George Gallup's smaller, properly selected poll predicted the election accurately despite fewer respondents.
Get the Snipd Podcast app to discover more snips from this episode
Get the app