CodingLevel 7
Incident response
Easynot started
Mediumnot started
Hardnot started
StatusFormatCompany style
Easy
TLS certificate expiredOn-call incidentOn-call incident15 minOne pod fails every request but passes health checksOn-call incidentOn-call incident15 minOne API key sends a third of all trafficOn-call incidentOn-call incident15 minProduct images vanish after a storage cleanup ruleOn-call incidentOn-call incident20 minHundreds of orders go through at zero dollarsOn-call incidentOn-call incident15 minMedium
Cache stampede on aligned expiryOn-call incidentOn-call incident30 minInventory shows in stock intermittentlyOn-call incident · Shopify styleShopify styleOn-call incidentShopify style30 minGC pauses after serialization refactorOn-call incidentOn-call incident30 minCart endpoint p99 regressionOn-call incidentOn-call incident35 minJVM warmup tail latencyOn-call incidentOn-call incident30 minFeature flag cache staleness after kill-switchOn-call incidentOn-call incident30 minInternal certificate expiredOn-call incidentOn-call incident30 minWebhook delivery delayedOn-call incident · Stripe styleStripe styleOn-call incidentStripe style30 minBatch job rate limit from parallelizationOn-call incidentOn-call incident30 minSMS provider carrier-specific degradationOn-call incidentOn-call incident30 minMidnight cron stampedeOn-call incidentOn-call incident30 minContainer pull latency on scale-from-zeroOn-call incident · Google styleGoogle styleOn-call incidentGoogle style35 minHard
Hot shard in Redis ClusterOn-call incident · Meta styleMeta styleOn-call incidentMeta style35 minCache misses from nonexistent productsOn-call incidentOn-call incident35 minProlonged degradation after Redis failoverOn-call incidentOn-call incident35 minTail latency from scatter-gather fan-outOn-call incident · Google styleGoogle styleOn-call incidentGoogle style40 minFeature flag rollout saturates downstreamOn-call incidentOn-call incident40 minCanary session token skewOn-call incidentOn-call incident40 minMobile client version skewOn-call incident · Meta styleMeta styleOn-call incidentMeta style40 minIn-flight requests lostOn-call incident · Stripe styleStripe styleOn-call incidentStripe style40 minDual-write flag causes read-write skewOn-call incidentOn-call incident45 minSplit-brain write conflictsOn-call incidentOn-call incident45 minRoot CA certificate expiredOn-call incidentOn-call incident40 minSynchronized reconnect stormOn-call incidentOn-call incident40 min