Reliable Scheduled Crawls and Billing
This release delivers significant enhancements to the reliability of our scheduled crawling system and billing durability. We have introduced highly robust credit refund processing and persistent billing identity validation for recurring crawls. Additionally, custom proxy revalidations no longer interfere with active crawl budget reservations, and ad profile validations have been hardened against processing failures.
Scheduled crawl refunds are now durable and spend counters are settled with stable idempotency keys. This ensures you are never double-charged and failed scheduler credits are correctly refunded.
Improvements
3General bug fixes and improvements
This release includes 2 internal improvements for better reliability and performance.
Durable crawl credit refunds
Scheduled crawl refunds are now durable and spend counters are settled with stable idempotency keys. This ensures you are never double-charged and failed scheduler credits are correctly refunded.
Reliable recurring crawl auth
The resolved billing identity is now persistently used for recurring crawl schedules. This prevents auth timeouts and ensures your scheduled tasks execute reliably.
Bug Fixes
2Preserved crawl budget reservations
Your scheduled crawl budget reservations are now safely preserved when revalidating custom proxy credentials. This ensures validation checks do not block or discard active crawl allocations.
Robust profile ad validation
We have introduced automated retries and terminal status handling to paired profile ad validation. This prevents validation checks from hanging and improves success rates for active ad profiles.
Plus 3 internal changes for stability and performance.