Website URL Discovery API
Discover every URL on any website in seconds. AlterLab's Map API parses sitemap.xml, follows internal links, and returns a complete URL inventory with depth, source, and metadata. Sitemap-aware, pattern-filterable, $0.001 per map call. No JS rendering — pure, fast discovery.
Simple API, Powerful Results
Get started in minutes with our intuitive API. One request gives you structured data, screenshots, PDFs, and more. No browser management, no infrastructure headaches.
Multi-Format Output
Markdown, JSON, HTML, text
Adaptive Rendering
JS, SPAs, shadow DOM
3 Lines to Integrate
Any language, any stack
Up to 5,000 free scrapes included. No credit card required.
How URL Discovery Works
Submit a domain — AlterLab parses sitemaps, traverses links, and returns a complete URL inventory in seconds.
Sitemap Parsing
AlterLab automatically fetches sitemap.xml and sitemap index files from the domain root and robots.txt. All declared URLs are extracted immediately — giving instant coverage of important pages before link traversal begins. Sites without a sitemap proceed directly to link traversal.
Link Traversal with Pattern Filtering
Internal links are followed up to your configured depth limit. URLs matching your exclude_patterns are skipped; include_patterns (if set) restrict results to specific sections like /blog/* or /docs/*. AlterLab deduplicates URLs across sitemap and link sources automatically.
Metadata Enrichment
Each URL in the inventory includes its depth level (how many hops from the seed URL), discovery source (sitemap or link), and last-modified date when declared in the sitemap. This metadata powers downstream SEO audits and change detection workflows.
Flat $0.001 Per Call
Map a 500-URL blog or a 50,000-URL e-commerce catalog for the same flat rate. No per-URL pricing, no surprises. Map a site weekly for change monitoring and pay $0.05 per month. No subscriptions — your balance never expires.
Built for URL Discovery at Any Scale
Fast, lightweight URL mapping with the control you need for production workflows.
Sitemap-Aware Discovery
Automatically parses sitemap.xml and sitemap index files for complete coverage alongside link traversal.
Glob Pattern Filtering
Include or exclude URL patterns with glob syntax — scope maps to /blog/*, /products/*, or any path prefix.
Metadata Enrichment
Each URL includes depth level, discovery source (sitemap vs link), and last-modified date when available.
Depth Control
Set maximum link-follow depth to control breadth vs. precision. Combined with sitemap parsing for full coverage.
URL Discovery Use Cases
From SEO audits to change monitoring — map any site structure for any workflow.
SEO Audits
Discover all URLs on a domain to identify orphan pages, missing metadata, and crawl coverage gaps — no browser needed
Content Gap Analysis
Map competitor site structures to identify content areas you haven't covered yet
Broken Link Detection
Build a complete URL inventory first, then test each URL in batch — find 404s and redirect chains across entire domains
Change Monitoring
Run two map calls on the same domain and diff the results to detect new pages, deleted content, or URL structure changes
Sitemap Generation
Automatically generate accurate sitemap.xml files for sites that lack one or have incomplete coverage
Flat Rate URL Mapping
$0.001 per map call — map a 50,000-URL site for $0.05. No per-URL fees, no subscriptions.
Why Teams Switch to AlterLab
Smart routing, no subscriptions, balance that never expires
| Feature | AlterLab You are here | ScraperAPI | Bright Data | Firecrawl |
|---|---|---|---|---|
Avg cost (real workload) Smart routing vs flat rate | ~$0.001 | $0.00049/credit | $0.0015 | $0.0063 |
Simple scrape Basic HTTP request | $0.0002 | $0.00049 | $0.0015 | $0.0063 |
JS rendering Full browser render | $0.004 | $0.0049 | $0.0015 | $0.0063 |
Free tier Free requests to start | Up to 5,000 scrapes | 5,000 credits | None | 500 scrapes |
Minimum Smallest purchase | $10 one-time | $49/month | $0 (PAYG) / $499/mo (subscription) | $19/month |
Balance expires? Does unused balance expire | Never | Monthly | Never (prepaid) / Monthly (subscription) | Monthly |
CAPTCHA solving Built-in CAPTCHA bypass | $0.02/solve | Extra cost | Extra cost | Not available |
Avg cost based on typical content/SEO workload (75% simple, 25% protected). Competitor prices from public pricing pages, March 2026.
Map API FAQ
Crawling & Scraping Resources
Batch Scraping API
Submit up to 10,000 URLs at once with webhook delivery and auto-retries.
Anti-Bot Handling API
Automatic challenge handling on every crawled page — no extra configuration.
JavaScript Rendering API
Render SPAs and dynamic content with headless Chromium.
View Pricing
From $0.0002/page. No subscription. Pay only for what you scrape.
Your first scrape.
Sixty seconds.
$1 free balance. No credit card. No SDK.
Just a POST request.
No credit card required · Up to 5,000 free scrapes · Balance never expire