Questions

Reset filters
Status
Databases in productionLevel 6Open topic
Replication lag read inconsistencyHardOn-call incidentNetflix styleOn-call incidentNetflix styleHard40 minRace condition in refactored order write pathHardOn-call incidentOn-call incidentHard45 minModel approval rate doubles overnightHardOn-call incidentCapital One styleOn-call incidentCapital One styleHard35 minReplication lag from batchHardOn-call incidentOn-call incidentHard35 minStorage node rebalance cascadesHardOn-call incidentOn-call incidentHard40 minStandby promotion stalledHardOn-call incidentOn-call incidentHard45 minQuery plan stale statisticsHardOn-call incidentOn-call incidentHard40 minSingle partition throttledHardOn-call incidentAmazon styleOn-call incidentAmazon styleHard45 minMigration holding exclusive lockHardOn-call incidentOn-call incidentHard40 minTransaction ID wraparound approachingHardOn-call incidentOn-call incidentHard45 minData lost in async failoverHardOn-call incidentStripe styleOn-call incidentStripe styleHard45 minInserts fail on month boundaryHardOn-call incidentOn-call incidentHard40 min
Query model embedding mismatchHardOn-call incidentOpenAI styleOn-call incidentOpenAI styleHard35 minNAT connection timeoutHardOn-call incidentOn-call incidentHard40 minPostgres WAL directory fills diskHardOn-call incidentOn-call incidentHard35 minElasticsearch OOM from expensive aggregationHardOn-call incidentOn-call incidentHard40 minConnection pool exhaustion after autoscaleHardOn-call incidentOn-call incidentHard35 minConnection churn from sidecar keepalive misconfigurationHardOn-call incidentOn-call incidentHard40 minQuery plan regression post-loadHardOn-call incidentOn-call incidentHard35 minPlan cache parameter sensitivityHardOn-call incidentMicrosoft styleOn-call incidentMicrosoft styleHard35 minLogical replication apply lag explodesHardOn-call incidentOn-call incidentHard40 minSequence reached maximum valueHardOn-call incidentOn-call incidentHard35 minReplica replay lag growingHardOn-call incidentOn-call incidentHard35 minPrepared statement plan varianceHardOn-call incidentOn-call incidentHard35 minDisk full on primaryHardOn-call incidentOn-call incidentHard40 minDisk full WAL accumulationHardOn-call incidentOn-call incidentHard35 minIndex larger than tableHardOn-call incidentOn-call incidentHard40 min
Incident responseLevel 7Open topic
Hot shard in Redis ClusterHardOn-call incidentMeta styleOn-call incidentMeta styleHard35 minCache misses from nonexistent productsHardOn-call incidentOn-call incidentHard35 minProlonged degradation after Redis failoverHardOn-call incidentOn-call incidentHard35 minTail latency from scatter-gather fan-outHardOn-call incidentGoogle styleOn-call incidentGoogle styleHard40 minFeature flag rollout saturates downstreamHardOn-call incidentOn-call incidentHard40 minCanary session token skewHardOn-call incidentOn-call incidentHard40 minMobile client version skewHardOn-call incidentMeta styleOn-call incidentMeta styleHard40 minIn-flight requests lostHardOn-call incidentStripe styleOn-call incidentStripe styleHard40 minDual-write flag causes read-write skewHardOn-call incidentOn-call incidentHard45 minSplit-brain write conflictsHardOn-call incidentOn-call incidentHard45 minRoot CA certificate expiredHardOn-call incidentOn-call incidentHard40 minSynchronized reconnect stormHardOn-call incidentOn-call incidentHard40 minSkewed partition key starves consumersHardOn-call incidentDatabricks styleOn-call incidentDatabricks styleHard45 minUnscoped delete wipes collectionHardOn-call incidentOn-call incidentHard45 minDual write timeout divergenceHardOn-call incidentOn-call incidentHard45 minOffset replay cascading side effectsHardOn-call incidentDatabricks styleOn-call incidentDatabricks styleHard40 minElasticsearch split brain divergenceHardOn-call incidentOn-call incidentHard45 minDST timezone wall clock divergenceHardOn-call incidentOn-call incidentHard40 minUnauthorized data exfiltrationHardOn-call incidentOn-call incidentHard45 minActive ransomware outbreakHardOn-call incidentOn-call incidentHard50 minShared secret rotationHardOn-call incidentStripe styleOn-call incidentStripe styleHard45 minCI IAM role privilege escalationHardOn-call incidentAmazon styleOn-call incidentAmazon styleHard45 minDouble-extortion ransomware threatHardOn-call incidentOn-call incidentHard50 min