Questions
Status
Closed-loop test underestimates tailHardOn-call incidentOn-call incidentHard40 minControl plane requests blockedHardOn-call incidentOn-call incidentHard40 minHTTP/2 stream head-of-line blockingHardOn-call incidentGoogle styleOn-call incidentGoogle styleHard40 minHedged request amplificationHardOn-call incidentGoogle styleOn-call incidentGoogle styleHard40 minDirty page writeback stallHardOn-call incidentOn-call incidentHard40 minSafepoint spin time latencyHardOn-call incidentOn-call incidentHard40 minNetwork bandwidth burst exhaustionHardOn-call incidentAmazon styleOn-call incidentAmazon styleHard40 minTLS session cache miss spikeHardOn-call incidentOn-call incidentHard40 minRetries hammer degraded nodeHardOn-call incidentOn-call incidentHard40 minFlag evaluation percentage drifts upwardHardOn-call incidentDoorDash styleOn-call incidentDoorDash styleHard40 minCanary cache key cardinality explosionHardOn-call incidentOn-call incidentHard40 minIdempotency key version skewHardOn-call incidentStripe styleOn-call incidentStripe styleHard40 minMemory leak undetected in short canaryHardOn-call incidentOn-call incidentHard40 minOmitted field null deserializationHardOn-call incidentOn-call incidentHard40 minLong-running matches evicted during rolloutHardOn-call incidentOn-call incidentHard40 minTLS handshake fails certificate verifyHardOn-call incidentOn-call incidentHard35 minUpstream latency degradationHardOn-call incidentOn-call incidentHard35 minCertificate notBefore clock skewHardOn-call incidentOn-call incidentHard35 minSidecar memory leak causes container restartHardOn-call incidentOn-call incidentHard40 minAsymmetric network partition in clusterHardOn-call incidentAmazon styleOn-call incidentAmazon styleHard40 minOCSP responder unavailableHardOn-call incidentOn-call incidentHard35 minSplit-brain cache after partitionHardOn-call incidentOn-call incidentHard40 minWebhook handler latency regressionHardOn-call incidentStripe styleOn-call incidentStripe styleHard35 minCold cache stampede after restartHardOn-call incidentOn-call incidentHard30 minCoordinator bottleneck on scaleHardOn-call incidentDatabricks styleOn-call incidentDatabricks styleHard30 minNAT gateway port allocation failsHardOn-call incidentAmazon styleOn-call incidentAmazon styleHard30 minJIT compilation flag activationHardOn-call incidentOn-call incidentHard30 minToken expiry synchronized across fleetHardOn-call incidentOn-call incidentHard30 minCache hit rate crashesHardOn-call incidentOn-call incidentHard35 minKafka consumer lag climbsHardOn-call incidentOn-call incidentHard40 minBatch update clobbers rowsHardOn-call incidentOn-call incidentHard45 minRetry storm cascadesHardOn-call incidentNetflix styleOn-call incidentNetflix styleHard45 minJWT validation fails on subsetHardOn-call incidentOn-call incidentHard40 minAvailability zone degradationHardOn-call incidentAmazon styleOn-call incidentAmazon styleHard45 minConnection storm after blipHardOn-call incidentMeta styleOn-call incidentMeta styleHard40 minVector index compaction latencyHardOn-call incidentOpenAI styleOn-call incidentOpenAI styleHard35 minLate upstream partial aggregatesHardOn-call incidentDatabricks styleOn-call incidentDatabricks styleHard35 minCache busting config deployHardOn-call incidentOn-call incidentHard35 minAccount balances zeroedHardOn-call incidentStripe styleOn-call incidentStripe styleHard40 minWrite amplification climbsHardOn-call incidentOn-call incidentHard40 minBitrot checksum mismatchesHardOn-call incidentOn-call incidentHard40 minEgress bandwidth spikeHardOn-call incidentOn-call incidentHard40 minCI token compromisedHardOn-call incidentOn-call incidentHard40 minPrivilege escalation detectedHardOn-call incidentAmazon styleOn-call incidentAmazon styleHard40 minSSRF reads instance credentialsHardOn-call incidentAmazon styleOn-call incidentAmazon styleHard40 minBreach lateral movement activeHardOn-call incidentOn-call incidentHard45 minWrite amplification spikesHardOn-call incidentMeta styleOn-call incidentMeta styleHard35 minCompaction throughput throttledHardOn-call incidentOn-call incidentHard35 minCache eviction storms originHardOn-call incidentOn-call incidentHard30 minRaft split brain divergenceHardOn-call incidentStripe styleOn-call incidentStripe styleHard45 min