LLMs Outperforming Human Labels

Check out this episode of the #1 people analytics podcast with special guest, Scott Hines, Previous Co-Host of Directionally Correct!

In this long-awaited reunion episode, Cole and Scott reconnect after Scott's time away from the mic, diving into a candid, wide-ranging conversation that blends humor, reflection, and sharp insight on the evolving world of work, technology, and people analytics. The discussion opens with Scott’s decision to step away from the podcast, driven in part by personal reflection following the loss of his mother and a reassessment of how he spends his time. What follows is an honest look at the hidden effort behind content creation, the opportunity cost of side projects, and the reality that even passion projects can become demanding commitments.

As the conversation unfolds, the two explore how advances in AI are reshaping not just workflows, but the very nature of knowledge work itself. From fully automated academic research to AI-powered coding and reporting tools, they reflect on the accelerating pace of change and the tradeoffs that come with it, including the subtle erosion of foundational skills. At the same time, they wrestle with the paradox of wanting to stay current in a rapidly evolving tech landscape while avoiding the noise, hype, and constant distractions that come with it. This tension shows up in their discussion of digital minimalism, notification fatigue, and the idea of building a “command center” for life and work.

The episode also revisits core people analytics topics, including the relationship between cognitive ability and personality, the nuances of assessment design, and the ongoing debate around prediction, fairness, and subgroup differences. Scott brings his signature analytical lens, while Cole connects these ideas back to real-world applications and the future of workforce strategy. They also touch on broader societal themes, from generational shifts in workplace behavior to the potential long-term impacts of pandemic-era disruptions on social and cognitive development.

True to form, the episode mixes depth with levity. The duo riff on everything from the “Gen Z stare” to the absurdity of hyper-competitive pickleball, while also tackling more serious ideas like workplace surveillance, the changing nature of organizations in an AI-driven world, and whether academia should still be viewed as a calling or simply another job under pressure. Throughout, there’s a consistent thread: questioning assumptions, challenging norms, and trying to make sense of a world where the boundaries between human and machine capabilities are increasingly blurred.

The episode closes on a high note with updates on Scott’s new role at HRBench and Cole’s continued growth of the podcast and broader ecosystem, signaling that while things evolve, the core mission of exploring people analytics and the future of work remains as strong as ever.

If you like this episode, you’d also love exploring prior episodes—visit colenapper.com for the full archive and show links.