Retesting, Stat Sig, and Knowledge Experiments

She helped grow a YouTube channel from 100,000 to 14 million subscribers in just four years, all while balancing a suite of other successful podcasts and media ventures? Grace Miller, Head of Failure and Experimentation at Flight Story, the powerhouse behind "The Diary of a CEO" and other massive shows, shares her unique insights. In this episode, Grace pulls back the curtain on the world of high-stakes content creation, revealing the ingenious experiments and surprising failures that have fueled their meteoric rise. If you're obsessed with crafting great content and eager to understand the nuanced mechanics of YouTube growth, this conversation offers an unparalleled look into how one of the industry's leading teams navigates the ever-evolving digital landscape.

Timestamps:
00:00 Introduction
02:00 The Scale of Diary of a CEO & Flight Story
04:40 When Doubling Content Backfired
08:01 Why Multiple YouTube Channels?
13:00 Measuring YouTube Experiments
15:37 Underutilized YouTube Features
21:55 The Power of YouTube Chapters
26:06 Anatomy of a Successful Experiment
29:20 The Localization & Dub Experiment
35:45 Designing Effective Experiments
37:33 Core Metrics for YouTube Growth
40:08 Tactics for Returning Viewers
47:20 The Culture of Failure and Learning
51:40 YouTube vs. Podcast Content
54:26 Embracing Failure Personally
59:00 The Value of Action Over Inaction
1:03:00 Fostering a Culture of Experimentation
1:11:57 AI in Content Creation
1:16:17 The Future of the Creator Economy
1:20:24 Targeting the Right Audience, Not Just All Audiences
1:25:21 Grace's Personal Experimentation Journey
1:28:31 Lead vs. Lagging Indicators for Growth

If you enjoyed this episode, please like and subscribe, share it with your friends, and leave a review. I read every single one.

Learn more about the podcast: https://nathanbarry.com/show

Follow Nathan:
Instagram: https://www.instagram.com/nathanbarry
LinkedIn: https://www.linkedin.com/in/nathanbarry
X: https://twitter.com/nathanbarry
YouTube: https://www.youtube.com/@thenathanbarryshow
Website: https://nathanbarry.com
Kit: https://kit.com

Follow Grace:
Instagram: https://www.instagram.com/graceexperiments
LinkedIn: https://www.linkedin.com/in/grace-miller-linked-in

Featured in this episode:
Kit: https://www.kit.com

Highlights:
04:40 When Doubling Content Backfired
08:01 Why Multiple YouTube Channels?
13:00 Measuring YouTube Experiments
15:37 Underutilized YouTube Features
21:55 The Power of YouTube Chapters