MCP Server

One MCP, the whole web.

Name: Spider MCP Server
Author: Spider

Your AI can crawl sites, scrape pages, search the web, and control a real browser. One config change and it works in seconds.

https://mcp.spider.cloud/mcp

22 tools Hosted Streamable HTTP OAuth or API key

Get API Key Connect your client →

Claude Code Claude Desktop Cursor Windsurf Any MCP client

spider@mcp session search + crawl

You Research how Stripe handles idempotency keys.

Claude I'll search for the docs and crawl the relevant pages.

spider_search query: "stripe idempotency keys" · limit: 5

5 results · 0.4s

spider_crawl url: stripe.com/docs/api/idempotent_requests · markdown

6 pages · 2.3s · $0.006

Stripe caches responses for 24 hours, keyed by a unique Idempotency-Key header. Retries return the cached response instead of a new charge.

Real session shape · you ask, the agent picks the tools

22 Native tools

<1s Single-page response

99.9% Success on protected sites

199+ Proxy countries

Connect

Two ways to set up.

Pick one, paste the config, and you're done.

Claude Code

One command

$ claude mcp add spider \
  --transport http https://mcp.spider.cloud/mcp \
  -H "Authorization: Bearer your-key"

→ added spider · 22 tools

Claude Desktop · Cursor · Windsurf

{
  "mcpServers": {
    "spider": {
      "type": "url",
      "url": "https://mcp.spider.cloud/mcp",
      "headers": {
        "Authorization": "Bearer …"
      }
    }
  }
}

No dependencies · Spider handles crawling, proxies, and browsers

Toolset

22 tools, one connection.

Your AI picks the right one for the job. Here's what it has to work with.

spider_* · called by your agent, not by you

Core 8

spider_crawl
Follow links and pull content from an entire site or section.
spider_scrape
Grab one page. No link following, just the content you asked for.
spider_search
Search the web, then optionally crawl whatever comes back.
spider_links
List every link on a page without downloading anything else.
spider_screenshot
Full-page or viewport screenshot, returned as base64.
spider_unblocker
Get past bot detection walls that would block a normal request.
spider_transform
Turn raw HTML into clean markdown locally. No network call.
spider_get_credits
Check how many credits you have left.

AI 5 Subscription

spider_ai_crawl
Tell it what to crawl in plain English, like "only product pages".
spider_ai_scrape
Describe the data you want and get structured JSON back.
spider_ai_search
Web search that ranks results by what actually matters to your query.
spider_ai_browser
Describe what to do in the browser and it figures out the clicks.
spider_ai_links
Extract links with AI deciding which ones are relevant.

Browser 9

spider_browser_open
Spin up a cloud browser with stealth and anti-bot built in.
spider_browser_navigate
Go to a URL and wait for the page to finish loading.
spider_browser_click
Click something on the page using a CSS selector.
spider_browser_fill
Type into a form field.
spider_browser_screenshot
Take a screenshot of what the browser sees right now.
spider_browser_content
Pull the page HTML or just the visible text.
spider_browser_evaluate
Run arbitrary JavaScript on the page.
spider_browser_wait_for
Pause until a selector appears, a nav finishes, or the network settles.
spider_browser_close
End the session and free up the browser.

Under the hood

Why it actually works.

Markdown, not HTML soup

Nav bars, ads, cookie banners, and footers all stripped. You get clean markdown that uses 60–80% fewer tokens than raw HTML, so the context window goes toward your actual task instead of boilerplate.

Sub-second responses

A single page comes back in under a second. Bulk crawls hit 100K+ pages per second. Every slow tool call is dead time where your agent is waiting instead of thinking.

Anti-bot walls handled

Cloudflare, Akamai, PerimeterX, CAPTCHAs. Spider handles all of it so your agent doesn't burn tool calls retrying blocked requests. 99.9% production success on protected sites.

Real browser, not curl

SPAs, lazy-loaded images, infinite scroll, client-rendered content. Spider runs a real browser so you get the page people actually see, not the empty shell HTTP gives you.

Browser you can drive

Open, navigate, click, type, screenshot, run JS, close. Your agent can log into dashboards, fill forms, or walk through multi-step flows the way a person would.

199+ country proxies

Residential, ISP, datacenter. Proxies rotate automatically and geo-restricted content just works. Pass a country code if you need a specific location.

Ship it

Give your AI web access.

One API key. One config change. Your AI can reach the entire web.

Get API Key Connect a client

mcp.spider.cloud/mcp · works with any MCP client