High-Throughput Scraping and Billing Accuracy
This release brings major throughput improvements for high-concurrency scraping requests alongside better detection of target site challenge blocks and error redirects. Streaming response status codes and upstream rate limit header passthrough are now more accurate across all proxy endpoints. Additionally, organization credit reconciliation and auto-recharge settings have been updated for seamless team management.
Upgraded browser execution engines significantly reduce false-positive responses on challenge-protected target sites. Over 50% fewer false successes ensure your scraping jobs reliably retrieve real page content instead of challenge pages.
Optimized API endpoint handling eliminates temporary 503 Service Unavailable errors during high-volume scraping bursts. Requests now process with significantly reduced connection overhead under peak loads.
Improvements
4Protected Site Evasion Reliability
Upgraded browser execution engines significantly reduce false-positive responses on challenge-protected target sites. Over 50% fewer false successes ensure your scraping jobs reliably retrieve real page content instead of challenge pages.
High Concurrency Request Throughput
Optimized API endpoint handling eliminates temporary 503 Service Unavailable errors during high-volume scraping bursts. Requests now process with significantly reduced connection overhead under peak loads.
Upstream Rate Limits and Responses
Search, map, and crawl proxy endpoints now pass upstream rate limit headers directly to your applications. Upstream 204 No Content and 304 Not Modified responses are also handled without proxy errors.
General bug fixes and improvements
Plus 6 internal improvements for better reliability and performance.
Bug Fixes
6Automatic Target Error Redirect Detection
Scraping jobs now identify target site redirects to internal error pages or 404 routes as soft blocks rather than successful requests. The system automatically escalates request execution to ensure full page extraction.
Streaming Status and Error Precision
Streaming scraper responses now accurately retain HTTP 4xx and 5xx status codes rather than returning error bodies as success pages. Cancellation states and byte metrics are also correctly recorded.
Stalled Retry Job Auto Recovery
Jobs interrupted during deferral waits no longer remain stuck in a retrying state indefinitely. The API background monitor now identifies stalled retry jobs and automatically processes account credit refunds.
Organization Auto-Recharge Billing Management
Updates to auto-recharge settings now correctly modify the organization's shared wallet instead of individual member accounts. Account administrators can reliably configure automated billing rules for their teams.
Scheduled and Crawl Refund Reconciliation
Failed scheduled scraping jobs and multi-depth crawl children now accurately reconcile credit spend. Refunded usage is properly credited back to your balance upon job completion or cancellation.
Organization Usage Analytics Reporting
Enterprise dashboard extraction metrics now correctly aggregate usage data across all organization members. Non-personal organization accounts now display full extraction activity in reporting views.
Plus 6 internal changes for stability and performance.