Multi-priority job queue
Your task
Design a multi-priority job queue at scale: 8 priority levels, 200K enqueues/sec, thousands of competing tenants, workers pull the highest-priority ready job. Requirements: high-priority jobs must start within 2s, but no tenant's low-priority work may starve indefinitely, and a single noisy tenant must not monopolize a priority level. Jobs have per-tenant concurrency limits.
It covers
- Priority queue
- Starvation
- Fairness