Questions
Status
In-flight requests lostHardOn-call incidentStripe styleOn-call incidentStripe styleHard40 minDual-write flag causes read-write skewHardOn-call incidentOn-call incidentHard45 minRoot CA certificate expiredHardOn-call incidentOn-call incidentHard40 minSynchronized reconnect stormHardOn-call incidentOn-call incidentHard40 minSkewed partition key starves consumersHardOn-call incidentDatabricks styleOn-call incidentDatabricks styleHard45 minUnscoped delete wipes collectionHardOn-call incidentOn-call incidentHard45 minDual write timeout divergenceHardOn-call incidentOn-call incidentHard45 minOffset replay cascading side effectsHardOn-call incidentDatabricks styleOn-call incidentDatabricks styleHard40 minElasticsearch split brain divergenceHardOn-call incidentOn-call incidentHard45 minDST timezone wall clock divergenceHardOn-call incidentOn-call incidentHard40 minUnauthorized data exfiltrationHardOn-call incidentOn-call incidentHard45 minActive ransomware outbreakHardOn-call incidentOn-call incidentHard50 minShared secret rotationHardOn-call incidentStripe styleOn-call incidentStripe styleHard45 minCI IAM role privilege escalationHardOn-call incidentAmazon styleOn-call incidentAmazon styleHard45 minDouble-extortion ransomware threatHardOn-call incidentOn-call incidentHard50 minSSRF to credential theftHardOn-call incidentAmazon styleOn-call incidentAmazon styleHard45 minJWT signing key rotation after leakHardOn-call incidentOn-call incidentHard45 minInsider data access spikeHardOn-call incidentOn-call incidentHard45 minOut-of-order events post-reshardHardOn-call incidentAmazon styleOn-call incidentAmazon styleHard40 minKafka partition skew from hot customerHardOn-call incidentOn-call incidentHard35 minRabbitMQ retry loop amplifies failuresHardOn-call incidentStripe styleOn-call incidentStripe styleHard40 minEvent ordering violation from producer retriesHardOn-call incidentOn-call incidentHard40 minLag spikes during rolling restartHardOn-call incidentOn-call incidentHard40 minSwap thrashing nodeHardOn-call incidentOn-call incidentHard40 minInotify watch limit exhaustion from file explosionHardOn-call incidentOn-call incidentHard40 minNAT gateway port exhaustion from cluster scaleHardOn-call incidentAmazon styleOn-call incidentAmazon styleHard40 minSwap thrashing during RDB saveHardOn-call incidentOn-call incidentHard40 minCache collapse metastable failureHardOn-call incidentMeta styleOn-call incidentMeta styleHard45 minEdits reverting to older valuesHardOn-call incidentOn-call incidentHard40 minInventory oversells after region partitionHardOn-call incidentShopify styleOn-call incidentShopify styleHard45 minEtcd cluster writes failingHardOn-call incidentOn-call incidentHard45 minAutovacuum blocked by idle transactionHardOn-call incidentOn-call incidentHard40 minNoisy neighbor disk latencyHardOn-call incidentOn-call incidentHard35 minQueue buildup hides server latencyHardOn-call incidentOn-call incidentHard40 minHumongous allocation full GCHardOn-call incidentOn-call incidentHard35 minQueue depth increases tail latencyHardOn-call incidentGoogle styleOn-call incidentGoogle styleHard35 minConsumer lag on few partitionsHardOn-call incidentOn-call incidentHard35 minCache serialization format collisionHardOn-call incidentOn-call incidentHard40 minConsumer stalls on schema mismatchHardOn-call incidentOn-call incidentHard40 minVendor schema change silent failureHardOn-call incidentStripe styleOn-call incidentStripe styleHard40 minPartial network partition splits quorumHardOn-call incidentOn-call incidentHard45 minFailover controller creates split-brainHardOn-call incidentOn-call incidentHard45 minOCSP responder timeout blocks handshakesHardOn-call incidentOn-call incidentHard40 minFeature store endianness mismatchHardOn-call incidentOn-call incidentHard40 minLRU evicts durable keysHardOn-call incidentStripe styleOn-call incidentStripe styleHard35 minTTL backfill deletes active documentsHardOn-call incidentAmazon styleOn-call incidentAmazon styleHard35 minMigrated accounts show stale balancesHardOn-call incidentStripe styleOn-call incidentStripe styleHard40 minCache invalidation storm from backfillHardOn-call incidentOn-call incidentHard35 minConsumer stuck on oversized recordHardOn-call incidentOn-call incidentHard35 minSessions expire ahead of scheduleHardOn-call incidentOn-call incidentHard35 min