Skip to main content

The web has an API now.

Scrape, crawl and search the web from your agent or RAG pipeline. One call returns markdown or JSON, and Spider runs the browsers and proxies.

Get an API key

No card required.

Request
POST api.spider.cloud/scrape

This is what your agent gets back.

Sample response, captured November 18, 2026.

## Introduction
Go is an open-source programming language that focuses on simplicity, reliability,
and efficiency, specifically designed to make it easy to build software at scale.
Although it borrows ideas from existing languages,
it has unusual properties that make effective Go programs
different in character from programs written in its relatives.
A straightforward translation of a C++ or Java program into Go
Time
Run to measure
Cost
Run to measure
Status and size
200
100.2 KB
From $0.16 per 1,000 pages. Cost varies by site. An attempt bills only the bandwidth it used and the time it ran. Get an API key
Try

  • 10,000 requests per minute

    Scrape, crawl and search on one host. The limit starts here and rises to 80,000.

  • 1,000 sessions open at once

    A browser we run for you. Your code drives it over a WebSocket.

  • 199 countries

    Residential IP addresses, rotated per request.

One key opens all three.

Use the whole web like a dataset.

Spider is a research lab for web data quality. Most websites have no API, so we ship one for your RAG pipeline or agent. Run the web scraper before you sign up, or read our web scraping guide.

  1. Renders like a user

    Scripts run before we read the page, so you get what a person sees.

    request: "browser" See the browser
  2. Loads the protected page

    Some pages refuse a plain fetch. This loads them in a full browser.

    stealth: true See the scrape endpoint
  3. Extracts the content

    The page comes back as markdown or plain text instead of raw HTML.

    return_format: "markdown" See the formats
  4. Streams as it crawls

    In a crawl, each page arrives as one JSON line when it finishes.

    application/jsonl See streaming

Pay for what you use, or a flat month.

From $0.16 per 1,000 pages. Cost varies by site.

pay as you go

from $1 per GB

No subscription. Top up from $5.

Time a request runs
$0.0001 per minute
Balance
Never expires
Get an API key

unlimited

$40 a month

For 2 requests at once in http mode.

Requests at once
from 2
Requests
unlimited
Per request at once
$20 down to $13
See unlimited plans

Make your first request.

Pick your client and paste.

01 Get a key

Get an API key

Your new account gets 2,500 free credits, worth $0.25, if your signup passes our checks.

export SPIDER_API_KEY="sk-..."

02 Connect Claude Code

claude mcp add spider --transport http \
  https://mcp.spider.cloud/mcp \
  -H "Authorization: Bearer $SPIDER_API_KEY"
CLAUDE.md
For web pages use spider-agent. Read https://spider.cloud/agent-skill/spider-agent/SKILL.md first.

Or the CLI. It picks HTTP or a browser per page, stops at your budget, and returns 187 bytes for named fields where asking for everything returns 9021.

Client configs in the docs

03 Read the data

example output example data after a scrape
[{
  "url": "https://example.com",
  "status": 200,
  "content": "# Example Domain\n\n..."
}]
Quickstart in the docs

Start with one URL.

Get an API key

No card required.