There is more of this guide.
Practice
32 questions- ML system designDesign the monitoring story for a credit-decisioning model that's been in production for six months. What do you alert on?
- ML system designYour offline model evaluation looks great but online metrics show degraded performance. Walk me through the most common reasons.
- ML system designDesign a system that decides when to retrain a customer-churn model. What signals would trigger a retrain?
- ML system designDesign a system where your ML model serves predictions for an e-commerce ranking page. What happens when the model is unavailable?
- ML system designWalk me through how you'd build a drift-detection system for a fleet of fifty production ML models.
- ML system designHow would you instrument a deployed model so that you can detect training-serving skew quickly?