The Product Podcast

Intro to A/B Testing by Ever's Senior PM

Apr 20, 2017
Ask episode
Chapters
Transcript
Episode notes
1
Introduction
00:00 • 2min
2
Why Is AB Testing Important?
01:38 • 3min
3
Is There a Correlation Between a 31% Increase in Conversion Rate and a 50% Increase in Sales?
04:10 • 4min
4
Optimizing for the Number of Parents Using Your App?
08:13 • 2min
5
How to Set Up an AV Test
09:59 • 3min
6
The Importance of a Sample Size
12:31 • 2min
7
How Long Will Your Experiment Take to Run?
14:43 • 3min
8
Are You Patient With Your Experiment?
17:50 • 1min
9
The Chi-Square Test
19:08 • 4min
10
When to Use A.B. Testing?
23:17 • 2min
11
Can You Test Your Hypothesis?
24:52 • 3min
12
How to Maximize Your Experiments
28:02 • 3min
13
AB Testing Consideration Number Two - Be Aware of Downstream Metrics
30:55 • 2min
14
Are You Considering Downstream Mechanics?
32:48 • 3min
15
Optimizing for Local Maximum?
35:56 • 4min
16
Six Common Ways to Invalidate an Experiment
40:14 • 3min
17
How Do You Make Sure You're Getting the Same Experience?
42:45 • 2min
18
How Do You Control for Social Oriented Features?
45:10 • 4min
19
Qualitative Versus AB Test?
48:48 • 2min
20
Designing a Product to Optimize for AB Testing
50:35 • 3min
21
A.B. Testing Is a Powerful Tool to Optimize Your Product
53:08 • 2min
22
Should You Always Be A.B. Testing When You Release Any Features?
55:15 • 2min
23
B2B Product Testing
57:39 • 3min
24
Problems With Tapletics
01:00:32 • 3min
25
How Long Do You Optimize a Certain Component?
01:03:06 • 3min