

Experiment Nation: The Podcast
Rommil from Experiment Nation
Every week we share:
- Interviews with the Best Conversion Rate Optimization (CRO) professionals and Experimenters from around the world
- Conference sessions / Tutorials
Recent recognition:
- Top 10% of most followed Podcasts on Spotify experimentnation.substack.com
- Interviews with the Best Conversion Rate Optimization (CRO) professionals and Experimenters from around the world
- Conference sessions / Tutorials
Recent recognition:
- Top 10% of most followed Podcasts on Spotify experimentnation.substack.com
Episodes
Mentioned books

Oct 6, 2021 • 26min
Seven lessons from running 22,000 AB tests with Ayat Shukairy
Experiment Nation: The Conference ReloadedThe average success rate of most AB testing programs hovers around 12%. Yep, for every 100 experiments you run, only 12 of them will generate an increase in conversions. That is worse than a coin toss. Too many companies start AB testing hoping that it will deliver a great increase in conversions. A few months later, they are bitterly disappointed. In this session, I will share the lessons we learned by analyzing over 22,000 AB tests on 700 CRO projects. These lessons paint the common patterns that helped us deliver upwards of 50% success rates on AB testing programs. The lessons provide a strategic roadmap for a CRO project as well as tactical details needed while running the day-to-day operations. Key takeaways Attendees will learn what it really takes to run a successful CRO program (Time, resource, management, etc). Attendees will learn the right balance between strategy and tactics when running an experimentation program. Attendees will see an actual project management board running a CRO program This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit experimentnation.substack.com

Oct 5, 2021 • 45min
Migrando para a área de experimentação vindo do Jornalismo (participação especial Fabricio Migues)
Hoje começamos um novo papo em nosso podcast: como migrar para a área de experimentação? Nosso convidado especial é Fabricio Migues, CRO Manager na Small World Financial Services, conta pra gente como foi sair da área de jornalismo e relações públicas e adentrar na experimentação, como aproveitar seus aprendizados e conhecimentos da área de comunicação dentro de CRO e como isso o tem ajudado. Edição: João Pedro Alencar Referências citadas no episódio: Referência citada da minha parte https://www.exp-growth.com/ https://open.spotify.com/episode/4d3Prnlc0VIf6dQSdWdGmb?si=ziE3zbnwSKSmW8P34oQIZg&dl_branch=1 This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit experimentnation.substack.com

Oct 3, 2021 • 19min
Women in experimentation: What holds us back? With Bithika Mehra
Experiment Nation: The Conference ReloadedWhy is it that all through school, girls outperform boys but that equation is flipped in the corporate world? Are there factors in our nurture (and possibly nature) that play against us? How do these factors play out in the experimentation space? In this session – recommended for women in experimentation and those working with them – Bithika will help identify blind spots and hopes to help women and teams reach their true potential. This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit experimentnation.substack.com

Sep 18, 2021 • 35min
Shopify’s Shanelle Mullin on tough buy-in conversations and how we can empower future optimizers
Tracy Laranjo chats with Shopify’s Experimentation & Analysis Lead, Shanelle Mullin, about tough buy-in conversations, her take on the “I don’t dream of labour” trend, making experimentation more representative of diverse voices, and how we can empower the next generation of optimizers.Follow Shanelle on Twitter: @shanelle_mullin This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit experimentnation.substack.com

Sep 18, 2021 • 28min
Adventures in Experimentation: Is my company doing CRO right?
There's no single answer as Conversion Optimization and Experimentation continue to evolve and find fit in the digital era. What resonates with us is, if you're constantly testing and celebrating performance instead of delivery, you're likely to be on the right path of doing it right. In this episode, Marion Ravel, Eden Bidani, and Positive John shared different angles, from e-commerce, copywriting, and product, to structuring and thinking through CRO. Books mentioned: Emotional Design — https://www.amazon.com/Emotional-Design-Love-Everyday-Things/dp/0465051367 Working Backwards: https://www.amazon.com/Working-Backwards-Insights-Stories-Secrets/dp/1250267595 This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit experimentnation.substack.com

Aug 23, 2021 • 41min
Série - Estruturando uma área de CRO na sua empresa - episódio 3 (Participação especial André Vieira)
Neste terceiro episódio contamos com a presença de André Vieira, fundador da Looptimize. Ele nos conta um pouco mais da sua visão sobre: Qual o ponto de partida para começar a investir em CRO? Popularização da experimentação: heurísticas e boas práticas — pontos positivos e negativos A qual área CRO melhor pertence dentro de uma empresa? Edição do podcast por João Pedro (https://www.linkedin.com/in/joaopedroalencar/) Referências citadas ao longo do ep: Looptimize: https://looptimize.com.br/ Online Dialogue: https://onlinedialogue.com/ How to measure anything: https://www.amazon.com/How-Measure-Anything-Intangibles-Business-ebook/dp/B00INUYS2U#:~:text=Written%20by%20recogni Post CRO vs Experimentation: https://www.linkedin.com/posts/joaoostrowski_cro-vs-experimentation-fight-activity-6830566831628124160-Ia-z GrowthMentor: https://www.growthmentor.com/?ref=johnostrowski This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit experimentnation.substack.com

Aug 13, 2021 • 35min
Comment mesurer le ROI de mon programme d’expérimentation?
Hosted by Marion Ravel and Mathieu Fauveaux This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit experimentnation.substack.com

Jul 31, 2021 • 26min
Série: Estruturando uma área de CRO na sua empresa - episódio 2
Nesse segundo episódio, falamos sobre gatilhos que fazem empresas procurarem o CRO e desafios para se começar a trabalhar com a área. Discutimos sobre entendimento geral de experimentação em uma empresa sobre o produto "estar pronto" para ser otimizado. Fiquem à vontade para contribuir. Editor: https://www.linkedin.com/in/jo%C3%A3o-pedro-de-queiroz-alencar-1852a518b/ Referências: Agende uma mentoria com John no GrowthMentor: https://www.growthmentor.com/?ref=johnostrowski Podcast com Ron Kohavi: https://www.abtasty.com/blog/1000-experiments-club-ronny-kohavi/ Auditoria de maturidade de experimentação com base no artigo The Evolution of Continuous Experimentation in Software Product Development: https://exp-platform.com/Documents/2017-05%20ICSE2017_EvolutionOfExP.pdf This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit experimentnation.substack.com

Jul 9, 2021 • 43min
Dexter's Joris Bryon on Common Practices, Starting a CRO agency, and how to spot a CRO imposter
Tracy Laranjo asks Dexter's Joris Bryon about How we need to stop saying Best practices and start saying Common Practices His tips on starting a CRO agency and working with a partner And how to spot a CRO imposter This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit experimentnation.substack.com

Jun 30, 2021 • 29min
Série: Estruturando uma área de CRO na sua empresa - episódio 1
Nesse primeiro episódio da série, vamos discutir como caímos no mundo de Otimização de Conversão (CRO), algumas experiências até posições atuais e diferentes perspectivas entre exatas/humanas e seus benefícios. Editor: João Pedro Alencar https://bit.ly/3jt4BLuMateriais comentados no episódio: Learning how to learn from the Awesome Dr. Barbara Oakley: https://bit.ly/3h2AAk1 Making websites win, free audiobook on Spotify >> https://spoti.fi/3qzRYzX CXL Conversion Optimization minidegree >> https://bit.ly/3Aid9em Trustworthy Online Controlled Experiments: A Practical Guide to A/B Testing >> https://bit.ly/3AicXvE You should test that https://amzn.to/3x7gTNv This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit experimentnation.substack.com


