Disk fills after deploy

On-call incidentEasy15 min

Your task

Right after a deploy this afternoon, every host in a service's pool starts running low on disk, all at once, and disk usage is climbing fast, not over days, but over minutes. The application is still serving traffic but is slowing down. You notice the new release turned on debug-level logging. How do you triage and stop the disk from filling?

It covers

  • Logging
  • Disk full
  • Verbosity