Anti-Bot Benchmark Dataset
A monthly, open dataset of how AlterLab scrape jobs performed against each detected anti-bot vendor class, per tier: success rate and median billed cost over the trailing 30 days of customer jobs. Window 2026-09-30 to 2026-10-30 (end exclusive, UTC). Licensed CC-BY-4.0.
| Feature | T1 | T2 | T3 | T4 | All tiers |
|---|---|---|---|---|---|
| No defence detected | 98.6% | 97.8% | 76.3% | 65.8% | 84.8% |
| Cloudflare | below floor | below floor | 67.7% | 33.7% | 52.4% |
| Other defences | below floor | below floor | 52.8% | 34.7% | 41.2% |
| DataDome | below floor | below floor | 0.0% | 33.5% | 3.8% |
| AWS WAF | below floor | below floor | below floor | 53.0% | 57.0% |
| Akamai | below floor | below floor | below floor | below floor | 46.3% |
| Imperva | below floor | below floor | 0.8% | below floor | 9.8% |
| HUMAN (PerimeterX) | below floor | below floor | below floor | below floor | 52.0% |
Full table
| Vendor class | Tier | Jobs | Success rate | Median cost / 1k |
|---|---|---|---|---|
| Akamai | All tiers | 160 | 46.3% | $2.00 |
| AWS WAF | T4 | 266 | 53.0% | $4.00 |
| AWS WAF | All tiers | 293 | 57.0% | $4.00 |
| Cloudflare | T3 | 5,658 | 67.7% | $2.50 |
| Cloudflare | T4 | 4,567 | 33.7% | $4.00 |
| Cloudflare | All tiers | 10,244 | 52.4% | $2.50 |
| DataDome | T3 | 2,586 | 0.0% | n/a |
| DataDome | T4 | 331 | 33.5% | $4.00 |
| DataDome | All tiers | 2,917 | 3.8% | $4.00 |
| Imperva | T3 | 124 | 0.8% | $2.50 |
| Imperva | All tiers | 153 | 9.8% | $4.00 |
| No defence detected | T1 | 15,348 | 98.6% | $0.20 |
| No defence detected | T2 | 21,385 | 97.8% | $0.30 |
| No defence detected | T3 | 16,387 | 76.3% | $2.00 |
| No defence detected | T4 | 18,660 | 65.8% | $4.00 |
| No defence detected | All tiers | 71,780 | 84.8% | $0.30 |
| Other defences | T3 | 1,653 | 52.8% | $2.50 |
| Other defences | T4 | 2,918 | 34.7% | $4.00 |
| Other defences | All tiers | 4,579 | 41.2% | $4.00 |
| HUMAN (PerimeterX) | All tiers | 125 | 52.0% | $4.00 |
Methodology
- Source: AlterLab production job telemetry, read with a committed read-only query. Each row is one finished job.
- Success rate is successful jobs divided by all jobs in the cell.
- Vendor class is the anti-bot defence detected on the job. Detector labels are grouped into vendor families; "Other defences" covers defences outside the named families and "No defence detected" covers jobs where none was seen.
- Tier is the fetch rung that finished the job (T1 to T4). Post-hoc tiers 3.5 and 4.5 count toward T3 and T4; pre-tier cache replays are excluded. "All tiers" sums the vendor class across tiers.
- Median cost is the exact median billed price of successful jobs, shown per 1,000 requests. It is the price customers pay, not infrastructure cost.
- Cohort: customer jobs only. Internal, admin, test and first-party crawler accounts are excluded.
- Privacy floor: any cell with fewer than 100 jobs is omitted, including a vendor class's all-tier row. The files carry no customer, domain, URL or job identifiers.
Downloads
- latest.csv: the current window, one row per vendor class and tier.
- datapackage.json: Frictionless Data Package descriptor with the schema, window, license and floor.
- GitHub: RapierCraftStudios/alterlab-datasets: every monthly snapshot.
License and citation
Released under CC-BY-4.0. Use, share and adapt it with attribution. Cite as:
AlterLab anti-bot benchmark (2026-09-30 to 2026-10-30), https://alterlab.io/datasets/antibot-benchmark, CC-BY-4.0.
Refresh
The dataset is regenerated monthly; each release adds a dated snapshot and replaces latest.csv. This release was generated on 2026-10-30. For a controlled, reproducible run on a fixed target set, see the benchmark.
Your first scrape.
Sixty seconds.
Up to 5,000 free requests — about 5,000 Light, 500 Protected or 250 Dynamic requests. No credit card.
Just a POST request.
No credit card required · Up to 5,000 free requests (about 5,000 Light, 500 Protected or 250 Dynamic requests) · Balance never expires