Lenny's Podcast: Product | Career | Growth

chevron_right

Inside the expert network training every frontier AI model | Garrett Lord (Handshake CEO)

whatshot 958 snips

Aug 24, 2025

Guest

Garrett Lord

Garrett Lord, co-founder and CEO of Handshake, shares how his career network evolved into a powerful data-labeling business tapping into a vast network of academic experts. He discusses the crucial role of expert data in training AI models, illustrating how PhDs help make models like GPT-5 smarter. The transformation from generalist to specialist labeling has opened new business opportunities. Garrett also touches on the collaboration with AI labs, and how AI technology enhances productivity, likening it to giving junior employees 'Iron Man suits.'

01:09:50

forum

Ask episode

web_stories

AI Snips

view_agenda

Chapters

menu_book

Books

auto_awesome

Transcript

info_circle

Episode notes

Fix Models By Providing Stepwise Ground Truth

Break models by finding where reasoning or steps fail, then provide ground truth and step-by-step corrections.
Use expert-created trajectories, rubrics, and SFT data to teach correct intermediate steps, not just final answers.

Quality, Volume, Speed — Lab Priorities

Labs care first about data quality, then volume, then speed when choosing labeling partners.
Handshake built tech, post-training teams, and rented GPUs to evaluate each unit's likely model impact.

Treat Expert Contributors With Respect

Treat experts like experts: pay well, train them, and integrate their learning back into their careers.
Enable fellows to earn meaningful hourly rates and bring insights back to academia and research.

Get the Snipd Podcast app to discover more snips from this episode

Enhancing AI Through Expert Data Labeling

05:10 • 13min

chevron_right

Navigating AI Model Development and Human Collaboration

17:50 • 14min

chevron_right

Navigating the Shift from Generalists to Expert Networks

31:49 • 5min

chevron_right

Building Connections and Driving AI Innovation

36:29 • 26min

chevron_right

Building Dreams and Sharing Wisdom

01:02:24 • 3min

chevron_right

Hustle and Growth: The Handshake Journey

01:05:51 • 4min

chevron_right

#25

• Mentioned in 349 episodes

Zero to One

Notes on Startups, or How to Build the Future

Peter Thiel

In 'Zero to One,' Peter Thiel argues that true innovation comes from creating something entirely new, going from 'zero to one,' rather than incrementally improving existing ideas. He emphasizes the importance of vertical progress through technology and the benefits of monopoly in driving innovation. Thiel also discusses the need for long-term planning, the importance of finding the right co-founders, and the power law in startup success. The book challenges conventional wisdom and encourages readers to think critically and aim big to build the future.

#83

• Mentioned in 208 episodes

The hard thing about hard things

building a business when there are no easy answers

Ben Horowitz

In this book, Ben Horowitz shares his personal and often humbling experiences in the tech industry to offer essential advice and practical wisdom. He addresses various hard decisions and challenges that business leaders face, such as firing friends, managing company culture, handling layoffs, and making tough strategic decisions. Horowitz emphasizes the importance of honesty, resilience, and adaptability in leadership, drawing from his experiences with companies like Loudcloud and Andreessen Horowitz.

#110

• Mentioned in 175 episodes

Shoe Dog

Phil Knight

Shoe Dog is a memoir that chronicles the journey of Phil Knight as he builds Nike from its humble beginnings as Blue Ribbon Sports. The book is a personal and detailed account of Knight's experiences, from his early days selling Japanese running shoes out of the trunk of his car to the global brand Nike is today. It highlights his relentless work ethic, the challenges he faced, and the key relationships with his partners and employees that were crucial to the company's success. The memoir also touches on Knight's personal life, including his family and the emotional struggles he encountered along the way.

Garrett Lord is co-founder and CEO of Handshake, which started as a career network for college students and new grads but recently discovered something extraordinary: they were sitting on the world’s largest network of academic experts—exactly what frontier AI labs desperately needed. With 500,000 PhDs and 3 million advanced degree holders creating training data, in just eight months they’ve built a new business that hit $50 million in revenue in its first four months and is on track to blow past $100M in the first 12 months.

What you’ll learn:

1. How Handshake found an opportunity to leverage their proprietary network of experts to launch a data-labeling business that’s on track to blow past $100 million ARR in 12 months

2. Why AI models need human experts (e.g. physics PhDs) to improve, and what this “data labeling” actually involves

3. Inside the actual work: what a biology PhD does for 8 hours that makes GPT-5 smarter

4. The playbook for building a startup inside a startup: separate teams, separate offices, separate everything

5. Why the shift from “generalist” to “expert” data labeling created a once-in-a-lifetime business opportunity

6. Why AI won’t eliminate entry-level jobs—it’s creating “Iron Man suits” that make junior employees 10x more productive

—

Brought to you by:

CodeRabbit—Cut code review time and bugs in half. Instantly: https://coderabbit.link/lenny

Orkes—The enterprise platform for reliable applications and agentic workflows: https://www.orkes.io/

Claude.ai—The AI for problem solvers and enterprise: http://claude.ai/

—

Transcript: https://www.lennysnewsletter.com/p/inside-handshake-garrett-lord

—

My biggest takeaways (for paid newsletter subscribers): https://www.lennysnewsletter.com/i/171410958/my-biggest-takeaways-from-this-conversation

—

Where to find Garrett Lord:

• X: https://x.com/garrettlord

• LinkedIn: https://www.linkedin.com/in/garrettlord/

• Email: Garrett@joinhandshake.com

—

Where to find Lenny:

• Newsletter: https://www.lennysnewsletter.com

• X: https://twitter.com/lennysan

• LinkedIn: https://www.linkedin.com/in/lennyrachitsky/

—

In this episode, we cover:

(00:00) Introduction to Garrett Lord

(05:00) Understanding data labeling and its importance

(13:08) The role of experts in AI model training

(15:35) The future of AI and human collaboration

(24:17) Why AI won’t eliminate entry-level jobs

(27:58) The continuous improvement of AI models

(33:05) The emergence of Handshake’s new business model

(37:07) Incubating new ideas in established companies

(40:42) Handshake's competitive advantage

(45:43) Scaling up and meeting market demand

(48:38) Overcoming challenges and adapting

(53:08) The importance of separate teams and ownership

(57:26) The future of job matching with AI

(01:00:30) The biggest bottlenecks to advancing models further

(01:02:37) Lightning round and final thoughts

—

Referenced:

• GPQA: https://github.com/idavidrein/gpqa

• Handshake: https://joinhandshake.com/

• OpenAI’s CPO on how AI changes must-have skills, moats, coding, startup playbooks, more | Kevin Weil (CPO at OpenAI, ex-Instagram, Twitter): https://www.lennysnewsletter.com/p/kevin-weil-open-ai

• Inside Bolt: From near-death to ~$40m ARR in 5 months—one of the fastest-growing products in history | Eric Simons (founder and CEO of StackBlitz): https://www.lennysnewsletter.com/p/inside-bolt-eric-simons

• Goldman Sachs: https://www.goldmansachs.com/

• General Motors: https://www.gm.com/

• Google: https://about.google/

• Sahil Bhaiwala on LinkedIn: https://www.linkedin.com/in/sahil-bhaiwala-459b0354/

• Francisco “Paco” Guzman on LinkedIn: https://www.linkedin.com/in/guzmanhe/

• Avery Yip on LinkedIn: https://www.linkedin.com/in/averyyip/

• Game of Thrones on HBO: https://www.hbomax.com/shows/game-of-thrones/4f6b4985-2dc9-4ab6-ac79-d60f0860b0ac

• SNOO: https://www.happiestbaby.com/products/snoo-smart-bassinet

• Careers at Handshake: https://joinhandshake.com/careers/

—

Recommended books:

• Zero to One: Notes on Startups, or How to Build the Future: https://www.amazon.com/Zero-One-Notes-Startups-Future/dp/0804139296

• The Hard Thing About Hard Things: Building a Business When There Are No Easy Answers―Straight Talk on the Challenges of Entrepreneurship: https://www.amazon.com/Hard-Thing-About-Things-Building/dp/0062273205

—

Production and marketing by https://penname.co/. For inquiries about sponsoring the podcast, email podcast@lennyrachitsky.com.

Lenny may be an investor in the companies discussed.

To hear more, visit www.lennysnewsletter.com

Home Top podcasts Popular guests Top books