Upgraded Scraping Fidelity and Reliability
This release introduces key reliability upgrades to our web scraping engine, including automatic detection and extraction of JSON API payloads and safeguards against redundant credit billing for unsolvable targets. We have also restored HTML as a default output format to simplify data retrieval, while resolving multiple interface bugs to deliver a smoother developer playground experience.
Paid users with inactive accounts and remaining credit balances will now receive automated email notifications after 14 days of inactivity. These friendly digests display your remaining balance and provide a direct link to your dashboard so your pre-funded scraping credits never go to waste.
Fixed an issue where scraping JSON API endpoints returned empty responses. The API now correctly detects JSON response headers, ensuring payloads are returned cleanly in their native format instead of failing readability extraction as HTML.
Fixed a billing loop where scraping jobs encountering unsolvable pages could be re-billed during escalation. Unsolvable scraping jobs are now immediately failed and refunded on their first attempt, preventing duplicate credit deductions.
New Features
1Inactive Account Notifications
Paid users with inactive accounts and remaining credit balances will now receive automated email notifications after 14 days of inactivity. These friendly digests display your remaining balance and provide a direct link to your dashboard so your pre-funded scraping credits never go to waste.
Improvements
2Default HTML Scraping Output
The scraping API once again includes HTML format output by default. If you run scraping requests without specifying format parameters, the API will now return clean HTML content alongside markdown and JSON, ensuring immediate access to structured page code.
General bug fixes and improvements
Plus 7 internal improvements for better reliability and performance.
Bug Fixes
6JSON API Response Handling
Fixed an issue where scraping JSON API endpoints returned empty responses. The API now correctly detects JSON response headers, ensuring payloads are returned cleanly in their native format instead of failing readability extraction as HTML.
Improved Trustpilot Scraping Reliability
Resolved scraping errors when navigating to Trustpilot pages and country-specific subdomains. The scraper now successfully blocks resource-heavy third-party widgets while ensuring the main target domains load reliably.
Billing Protection for Unsolvable Requests
Fixed a billing loop where scraping jobs encountering unsolvable pages could be re-billed during escalation. Unsolvable scraping jobs are now immediately failed and refunded on their first attempt, preventing duplicate credit deductions.
Playground Access for Non-Logged Users
Fixed a crash and persistent loading indicator that blocked unauthenticated users from using the public playground. Guests can now access and test the playground interface smoothly.
Dashboard Theme Toggle Stability
Resolved a rendering crash on the playground dashboard when toggling between light and dark modes. UI theme updates are now perfectly synchronized with browser transition animations to prevent React component errors.
Clearer Playground Error Displays
Improved error reporting within the playground. If a request fails without a detailed message, the panel now correctly displays a descriptive fallback message rather than displaying an unhelpful "undefined" status.
Plus 7 internal changes for stability and performance.