Show HN: Proxy-benchmark – Find what blocks your scraper

Category: devtools

Tags: web-scraping, proxy-testing, benchmarking, browser-automation, reproducibility

Score: 6.8/10 (Innovation: 6, Technical: 7, Documentation: 8, Utility: 6)

Proxy-benchmark is a Python harness for isolating what actually blocks a web scraper: the proxy exit, the browser fingerprint, the host machine, or the target itself. It runs controlled experiments across engines, proxy paths, countries, and warm-up strategies, logging every attempt as a reproducible JSONL row. The project is notable for its rigorous methodology, committed run data, and findings like host-dependent success rates and Chrome's 43 MB per-profile vendor traffic.

Target audience: backend devs and data engineers working on web scraping infrastructure

Repository: https://github.com/nodemaven/proxy-benchmark · Python · MIT · 31 stars

View on Hacker News