Smarter Failover, Auto-Pause, and Improved Reliability
This release introduces automated schedule pausing and failure alerts to protect API quotas, alongside structured error hints across the API and SDKs. Users can also configure fallback modes when extraction requests encounter challenges or timeouts. Additionally, we have rolled out adaptive domain request pacing and resolved key billing and session management issues.
Scheduled jobs now track consecutive failures and automatically pause when targets remain broken. You will receive instant notifications so you can investigate before wasting API credits.
You can now enable opt-in fallbacks for high-tier extraction requests. If a request encounters a challenge or timeout, the system automatically attempts secondary extraction modes.
New Features
2Auto-pause for failing schedules
Scheduled jobs now track consecutive failures and automatically pause when targets remain broken. You will receive instant notifications so you can investigate before wasting API credits.
Automatic fallback on request challenges
You can now enable opt-in fallbacks for high-tier extraction requests. If a request encounters a challenge or timeout, the system automatically attempts secondary extraction modes.
Improvements
4Adaptive per-domain request pacing
Request pacing now dynamically adjusts based on real-time target domain responsiveness. This improves overall extraction throughput while minimizing blocks and strain on target servers.
Automatic back-off for URL failures
Consecutive failures on specific URLs now trigger automatic back-off delays. This halts repetitive retries against unreachable endpoints and conserves your API credit quota.
Bounded concurrency for sticky sessions
Sticky session connections now enforce concurrency limits across requests. This guarantees consistent session reuse and improves extraction success rates during multi-step web flows.
General bug fixes and improvements
Plus 58 internal improvements for better reliability and performance.
Bug Fixes
4Accurate billing for challenge responses
Resolved an issue where responses returning challenge pages were marked as successful extractions. Requests blocked by target site challenges are no longer charged full credits.
Correct batch job refund calculation
Fixed a ledger calculation discrepancy for batch extractions. Failed individual jobs inside a batch now correctly receive credit refunds against the initial batch debit.
Real-time credit balance cache updates
Fixed cache ordering gaps during credit balance updates. Account balances and API entitlement limits now update immediately in real time following any transaction.
Search endpoint request stability
Fixed network egress timeouts occurring on search extraction calls. Search requests now experience consistent response times and higher overall completion rates.
Plus 58 internal changes for stability and performance.