System
City
Workspace
Problems
Canvas
Pricing
Sign in
Design a Web Crawler — Hard System Design Problem
Back to problems
Hard
SYSTEM DESIGN
·
Infrastructure
Design a Web Crawler
Crawling
Politeness
Upgrade to view full problem details
Upgrade to Premium
Related System Design Problems
Browse all →
Hard
Infrastructure
Design a Web Crawler That Will Crawl Wikipedia
#Crawling
#URL Frontier
#Deduplication
Easy
Infrastructure
Design a URL Shortening Service
#Hashing
URL Frontier
Open Canvas
Upgrade to Premium to unlock this problem
#Key-Value
#Redirection
Medium
Infrastructure
Design a Database Batch Auditing Service
#CDC
#Audit Trail
#Compliance
Medium
Infrastructure
Design a Distributed Counter
#Consistency
#Sharding
#Aggregation
Easy
Infrastructure
Design a Multi-Device Screenshot Capture System
#Headless Browser
#Queue
#Storage
Medium
Infrastructure
Design a Distributed Locking System
#Mutex
#Lease
#Consensus