Coach note

Interviewers ask this kind of question to surface how you think, not what you remember. The strongest answers are specific, calmly told, and end on what changed.

Experiment design · Evaluating AI features

Your offline evals say a new prompt for your LLM summarization feature beats the current one. The PM asks why you'd bother with an online A/B test at all. What's your answer?

Type your answer
0of ~220 wordsAbout a minute spoken

Voice isn’t supported in this browser — type your answer in the box.

Create a free account to get more critiques.

Your answer
Your answer appears here as you speak.

Practice more

Thousands of questions, calibrated to your role — your progress saved across every session, with model answers and full breakdowns.