Code Room
System designHard
Question
Design a distributed web crawler that fetches billions of pages, respects politeness/robots rules, and avoids re-crawling the same content.
What a strong answer looks like
Clarify scale and constraints first. Propose a clean component breakdown, then go deep on the hard parts — data model, bottlenecks, consistency, failure modes — and name the trade-offs you are making.
Learn the concepts
Loading whiteboard…
Run or narrate your approach, then ask the coach.