Pricing

Spider operates on a pay-as-you-go model for pricing. You only pay for the data consumed, with no extra costs once you stop using the service.

|
Enterprise Volume pricing & custom SLAs Custom scraping Tailored data collection

Every request is billed for bandwidth + compute, plus any add-ons you enable.

Base
$1.00/GB
$0.001/min
Add-ons
$0.0003/req
$0.0001/req
Features
$0.0003 / avg per req
$0.0002 / avg per req
$0.0006 / avg per req
$0.001 / per req
+ $0.001 - $0.004 / per req
$0.0001 / per req
$0.0001 / per req
$1-4 / per gb
Avg cost / 100 pages
$0.0020 – $0.0100
$0.0028 – $0.0123
$0.0035 – $0.0155
DOC: FAQ

What is Spider?

Spider is a fast web scraping and crawling API designed for AI agents, RAG pipelines, and LLMs. It supports structured data extraction and multiple output formats including markdown, HTML, JSON, and plain text.

How can I try Spider?

Purchase credits for our cloud system or test the Open-Source Spider engine to explore its capabilities.

What are the rate limits?

Every account can make up to 50,000 core API requests per second.

Can you crawl all pages?

Yes, Spider accurately crawls all necessary content without needing a sitemap ethically. We rate-limit individual URLs per minute to balance the load on a web server.

What formats can Spider convert web data into?

Spider outputs HTML, raw, text, and various markdown formats. It supports JSON, JSONL, CSV, and XML for API responses.

Does it respect robots.txt?

Yes, compliance with robots.txt is default, but you can disable this if necessary.