The Testing Psychologist Podcast 561. Digital vs. Analog Administration: Research & Practice
Would you rather read the transcript? Click here.
As we continue our exploration of modern assessment, I wanted to dive deep into the long-standing debate between digital and paper-based administration. While many of us have made the switch to platforms like Q-interactive, concerns about mode effects and statistical differences in scores remain a common point of anxiety. In this discussion, I review the robust research confirming cross-mode equivalence for most cognitive subtests, but I also highlight critical nuances like technology anxiety in older adults and the tactile friction gap that can influence fine motor performance. We also look at the significant advantage of digital tools in eliminating the 5% human error rate common in manual scoring. To wrap up, I outline a 2026 mode integrity protocol to help you maintain data purity, including screening for digital literacy and proper documentation of your administration methods.
Main Topics
- 00:35: The evolution of digital platforms and research regarding mode effects
- 01:15: Meta-analysis findings on cross-mode equivalence for cognitive subtests
- 01:50: User experience bias and the impact of technology anxiety on older adults
- 03:02: The tactile friction gap and how stylus-on-glass influences motor speed
- 04:15: Human error rates in manual scoring and the benefits of digital clerical accuracy
- 05:40: Granularity in timing and the value of millisecond-accurate digital precision
- 06:45: The 2026 mode integrity protocol for clinical practice
- 08:35: Best practices for documenting digital administration and AI disclosures in reports
Cool Things Mentioned
- The Testing Psychologist mastermind groups and business consulting
- Reverb: the premier AI-powered report-writing platform for testing psychologists
Featured Resources
TherapyNotes is the leading EHR system for mental health practitioners. I’ve used TherapyNotes for over 10 years, and it just keeps getting better. Use this link and the promo code “testing” to get two free months and try it for yourself! www.therapynotes.com/testing
The Testing Psychologist podcast is approved for CEU’s!
I’ve partnered with At Health to offer CE credits for podcast episodes! Visit this link to access current and past episodes available for CE credit. You can use code “TTP10” for a discount on ALL the course credits you purchase from At Health!th!
About Dr. Jeremy Sharp
I’m a licensed psychologist and Clinical Director at the Colorado Center for Assessment & Counseling, a private practice that I founded in 2009 and have grown to over 20 clinicians. I earned my undergraduate degree in Experimental Psychology from the University of South Carolina before getting my Master’s and PhD in Counseling Psychology from Colorado State University. These days, I specialize in psychological and neuropsychological evaluation with kids and adolescents.
As the host of the Testing Psychologist Podcast, I provide private practice consulting for psychologists and other mental health professionals who want to start or grow psychological testing services in their practices. I live in Fort Collins, Colorado with my wife (also a therapist) and two young kids.
Ready to grow your testing services? Click below to get on the waitlist!