▧ SCRAPE / STACK
RESEARCH INDEX / ANTI-BOT ECONOMICS

Scraping API engineering research & cost audits

Long-form teardowns for teams that have to defend a scraping bill. Every report starts from the invoice, normalizes it to cost per 1,000 usable pages, and shows the arithmetic you can re-run on your own targets.

Published by 600me2 long-form reportsPython standard library onlyBaselines dated 2026-10-17 / 2026-10-19

2Deep-dive reports
4Scraping APIs normalized
1.43×Retry tax at 70% yield

Published research

MOST RECENT FIRST
Anti-bot economics / credit multipliers

The 403 Tax: What Anti-Bot Protection Really Does to Your Scraping Bill

A 100,000-request crawl can bill 160,000 attempts once retries enter the picture. This teardown separates the sticker price from the usable-page price across ZenRows, ScrapingBee, ScraperAPI and Crawlbase, then gives you a two-hour pilot that produces a buying decision instead of a vendor ranking.

  • 160,000 billed attempts for 100,000 URLs
  • $2.94 → $73.50 spread per 10k at 1 vs 25 credits
  • $0.280 vs $3.500 per 1k usable pages
18 October 20261,698 words · ~8 minRead the teardown →
Proxy cost audit / open-source CLI

The $0.49/GB Proxy Illusion: How a 200-Line CLI Exposes Real Scraping Costs

A reseller quotes $0.49 per 1,000 requests. At 70% usable yield the real price is $0.70, and a naive three-retry policy pushes it to $1.12. The check-proxy-tax CLI measures status codes, blocked reasons, latency percentiles and effective cost per 1,000 usable responses with no account and no dependencies.

  • $0.49 sticker → $0.70 at 70% yield (1.43×)
  • 2.29× multiplier with three retries
  • 1M usable pages: $490 → $700/month
19 October 20262,218 words · ~11 minRead the audit →

How to read these numbers. The managed-provider figures are supplied planning baselines observed on 2026-10-17, not independent target measurements or current vendor quotes. The CLI results were produced by local runs on 2026-10-19. A 70% yield figure is not a guarantee for your targets: run the probe against your own URL list and marker before you commit to a plan.

Measure your own bill before you negotiate it

Clone the zero-dependency CLI, point it at the hardest URLs in your list, and get cost per 1,000 usable responses in JSON. Then compare that number with the live benchmark.

Get check-proxy-tax ↗Open the live benchmark ↗Calculate true TCO ↗