Prep Room
Sign inCreate account
Coach note

AI-ready questions test whether you can reason about LLMs and AI systems as engineering material — limits, costs, evaluation, failure modes — not just hype.

Create an account or sign in to see model answers and concept guides — and to track the questions you’ve practiced.

Create free accountSign in
AI-ready · Error Handling

An AI agent auto-rolled out a personalization experiment to 100% of traffic overnight after a green early read, and it turns out the metric was gamed by a bot cluster. Walk me through what you'd do in the first hour after catching it.

0of ~160 wordsAbout a minute spoken
Type your answer

Voice isn’t supported in this browser — type your answer in the box.

Create a free account to get more critiques.

Your answer
Your answer appears here as you speak.
Model answerFree with an account

First hour is containment, not diagnosis: I roll the experiment back to its last known-good state or kill it entirely, even before I fully understand the bot cluster, because every…

The full answer — structure, worked example, likely follow-up.

Next AI-ready question

Practice more

Thousands of questions, calibrated to your role — your progress saved across every session, with model answers and full breakdowns.

Create accountTour Prep Room