Monitoring with delayed ground truth

DesignHard45 minCapital One style

Your task

Design a monitoring system for a loan-default prediction model where the true label, did the borrower actually default, only resolves months to years after the prediction. You can't wait that long to know the model is degrading. Walk through how you monitor model health when ground truth is delayed by quarters, what early proxy signals you use, and how you avoid both crying wolf and missing a real regression in the meantime.

It covers

  • Delayed labels
  • Proxy metrics
  • Label lag
  • Segment monitoring