Nine endpoints between a URL and clean data.
Crawl whole sites, scrape one page, search the web, capture screenshots, run AI extraction. Same Bearer auth, same JSON shape, optional streaming.
- Pages / sec
- 10K+
- Core endpoints
- 9
- Output formats
- 4
- JSON & streaming
- REST
One API. Nine endpoints.
Each endpoint focuses on one shape of job. Switch between them with one parameter.
Discovery
Crawl
Recursively crawl entire websites and collect every page. Set depth limits, respect robots.txt, and get structured output in markdown, HTML, or plain text.
Scrape
Extract content from individual pages with precision. Optimized for single-page extraction with CSS selectors and metadata.
Search
Perform search engine queries and automatically crawl the results. Discovery + extraction in one step.
Output
Screenshot
Capture high-quality screenshots of any web page. Full-page or viewport, as base64 or binary.
Transform
Convert raw HTML or PDF into clean markdown, plain text, or sanitized HTML. Process content offline without re-fetching pages from the web.
Links
Collect all links from a website without extracting page content. Optimized for sitemap generation and URL discovery at lower cost.
Advanced
Unblocker
Access content behind anti-bot protections and challenging security measures. Advanced fingerprinting and session management.
Fetch
Per-website fetch APIs with AI-discovered configurations. Configs are discovered once, validated, cached, and reused.
What every endpoint already does.
Proxy support
Residential, mobile, and ISP proxies with geo-routing to 100+ countries
Streaming
JSONL streaming so you can process results as they arrive
Caching
Built-in HTTP caching with configurable TTL
Webhooks
Async delivery when crawls complete
Rate limiting
Automatic concurrency management
Auth header
Simple Bearer token on every request
Multi-format
JSON, XML, CSV, or JSONL output
Client libraries
SDKs for Python, JavaScript, Rust, Go, and CLI
Skip the REST calls. Use the MCP server instead.
All 9 endpoints (plus browser automation and AI tools) are available as MCP tools. Connect Claude, Cursor, or Windsurf directly.
npx spider-cloud-mcp or mcp.spider.cloudBandwidth and compute, billed by the request.
Auto-detects when a page needs a browser. Same $0.03 / 1K rate for every request type.
$0.03 per 1K pages
Competitor cost from published pricing · minimums labelled
How spider compares
Production cost at scale.
Estimated monthly cost at production volumes. Spider charges bandwidth + compute with no credit multipliers.
| Provider | 10K pages | 100K pages | 1M pages | Multipliers | Credits expire |
|---|---|---|---|---|---|
| Spider | ~$0.30 | ~$3 | ~$30 | None | Never |
| Firecrawl | $16 min | $83 | $599 | None | Monthly |
| ScrapingBee | $49+ | $99–$249 | $599+ | 1–75x | Monthly |
| Bright Data | $40+ | $270+ | $2,700+ | Per-feature | Monthly |
| ScrapFly | $30+ | $250–$500 | $500+ | 1–30x | Monthly |
Costs assume production workloads with anti-bot bypass. Competitor pricing as of Feb 2026. Spider cost based on avg production workload of ~$0.03/1K pages.
From signup to first crawl.
A Bearer token, a URL, a curl. That's the first request.