There is more of this guide.
Practice
40 questions- Experiment designYour PM wants to test a new onboarding flow. How would you frame the hypothesis before running anything?
- Experiment designA stakeholder wants to ship a change after one week of A/B data. How do you decide if you have enough?
- Experiment designYour test moves the primary metric in the wrong direction but every secondary metric improves. What do you do?
- Experiment designYour team wants to A/B-test a copy change on a critical CTA. The change is two words. Walk me through whether and how you'd run it.
- Experiment designYour A/B test shows a 4% lift in revenue but no movement in any other metric. How suspicious should you be and why?
- Experiment designA teammate wants to A/B-test virality features that depend on other users in the test. What's the risk and how do you handle it?