Code RoomModel drift detection
HardPrep Room Coding #3701

Model drift detection

System designML systemsReliability & on-callSenior–Staff~50 min

Design a model-monitoring and drift-detection system for an organization running hundreds of production models, where labels for many models arrive late or never. It must detect feature drift, prediction drift, and performance degradation, distinguish a real model problem from an upstream data outage, and alert the owning team with enough context to act, all without adding meaningful latency to the serving path. Cover what you log, the detection methods, and how you avoid alert fatigue.

What a strong answer looks like

Clarify scale and constraints first. Propose a clean component breakdown, then go deep on the hard parts (data model, bottlenecks, consistency, failure modes) and name the trade-offs you are making.

Clarify5:30 left
Estimate5:30 planned
Design16:30 planned
Deep dive13:30 planned
Failure9:00 planned
0:00
Which questions mattered is sealed until you submit. Telling you now would just be handing over the edge cases.