Automated model retraining

DesignMedium35 minDatabricks style

Your task

Design an automated retraining system that keeps ~80 production models fresh as data drifts, without a human babysitting each one. The system should decide when to retrain a model (on a schedule, on drift signal, or on a data-volume trigger), retrain reproducibly, validate the candidate against the incumbent before promotion, and roll back if the new model underperforms. Models have different cadences (some daily, some monthly) and different label-availability delays. The goal is fresh models with a strong safety gate, so a bad automated retrain can never silently ship and degrade production.

It covers

  • Retraining
  • Automated pipeline
  • Validation