Smarter Request Escalation and Native Exports
This release introduces native crawl export support to both our Python and Node.js SDKs, eliminating the need for manual HTTP integration. We have also overhauled our synchronous request budget to automatically prevent gateway timeouts and added actionable billing hints to timeout payloads. Additionally, several routing and header enhancements ensure cleaner request execution when targeting JSON endpoints.
We now enforce an automatic 80-second budget on synchronous requests to prevent unexpected gateway timeouts. This ensures you receive a response even during multi-stage request escalations.
New Features
1Automatic Request Timeout Prevention
We now enforce an automatic 80-second budget on synchronous requests to prevent unexpected gateway timeouts. This ensures you receive a response even during multi-stage request escalations.
Improvements
2Actionable Billing Hints for Timeouts
Timeout responses now include a machine-readable billing status and a concrete polling hint. Your integrations can now safely track pending jobs without risking duplicate credit charges.
General bug fixes and improvements
Plus 22 internal improvements for better reliability and performance.
Bug Fixes
3Optimized Request Headers for API Endpoints
Requests targeting REST endpoints now utilize standardized API headers rather than browser-navigation headers. This ensures your traffic matches real API clients and avoids detection systems.
Seamless Plan Tier Request Escalation
We fixed an issue where request escalations would trigger unexpected tier-limit errors. The platform now escalates your requests smoothly and provides accurate plan-tier feedback.
Enhanced Connection Routing Reliability
Legitimate network resources are no longer incorrectly flagged as failing when a request is capped by your plan limit. This ensures consistent connection quality and routing stability.
Plus 22 internal changes for stability and performance.