RESEARCH INDEX / ANTI-BOT ECONOMICS
Scraping API engineering research & cost audits
Long-form teardowns for teams that have to defend a scraping bill. Every report starts from the invoice, normalizes it to cost per 1,000 usable pages, and shows the arithmetic you can re-run on your own targets.
Published by 600me2 long-form reportsPython standard library onlyBaselines dated 2026-10-17 / 2026-10-19
2Deep-dive reports
4Scraping APIs normalized
1.43×Retry tax at 70% yield
Published research
MOST RECENT FIRST
Anti-bot economics / credit multipliers
A 100,000-request crawl can bill 160,000 attempts once retries enter the picture. This teardown separates the sticker price from the usable-page price across ZenRows, ScrapingBee, ScraperAPI and Crawlbase, then gives you a two-hour pilot that produces a buying decision instead of a vendor ranking.
- 160,000 billed attempts for 100,000 URLs
- $2.94 → $73.50 spread per 10k at 1 vs 25 credits
- $0.280 vs $3.500 per 1k usable pages
Proxy cost audit / open-source CLI
A reseller quotes $0.49 per 1,000 requests. At 70% usable yield the real price is $0.70, and a naive three-retry policy pushes it to $1.12. The check-proxy-tax CLI measures status codes, blocked reasons, latency percentiles and effective cost per 1,000 usable responses with no account and no dependencies.
- $0.49 sticker → $0.70 at 70% yield (1.43×)
- 2.29× multiplier with three retries
- 1M usable pages: $490 → $700/month
How to read these numbers. The managed-provider figures are supplied planning baselines observed on 2026-10-17, not independent target measurements or current vendor quotes. The CLI results were produced by local runs on 2026-10-19. A 70% yield figure is not a guarantee for your targets: run the probe against your own URL list and marker before you commit to a plan.