Code RoomSkewed partition key starves consumers
HardPrep Room Coding #2483

Skewed partition key starves consumers

On-callDistributed systemsSenior–Staff~45 min

Your event pipeline consumes a Kafka topic with 12 partitions via a consumer group. Volume tripled after onboarding a big customer, and consumer lag is now climbing without bound even though you scaled the consumer group from 12 to 40 instances. CPU on the consumers is low. You notice that only 12 consumers are ever doing work and the other 28 sit idle. The producers are keyed by `customerId`, and the new big customer is ~70% of all traffic. How do you triage and get the pipeline to keep up?

What a strong answer looks like

Stop the bleeding first (mitigate), then form hypotheses from real signals. Separate root cause from symptom, communicate status as you go, and close with what prevents a repeat.

0:00 of about 45 min
Which questions mattered is sealed until you submit. Telling you now would just be handing over the edge cases.