Skip to main content New gottem — one API for every web scraping vendor.
Integrations

Native integrations for every stack.

One API for the leading AI frameworks, automation platforms, and language SDKs. Drop Spider into the tools you already use.

LangChain LlamaIndex CrewAI AutoGen MCP +11 more
01 · Frameworks

AI & LLM frameworks.

Native integrations for building intelligent applications with live web data.

Spider Browser

New Browser

Custom Rust browser engine with AI agents, stealth, and retry engine. Connect to pre-warmed cloud browsers via WebSocket.

npm install spider-browser

MCP Server

Popular MCP

22 tools for Claude, Cursor, Windsurf, and any MCP client. Run locally via npx or connect to the hosted server at mcp.spider.cloud.

npx spider-cloud-mcp

LangChain

AI Framework

Use Spider as a document loader in your LangChain applications. Perfect for building RAG systems and AI agents.

LlamaIndex

AI Framework

Spider Reader for LlamaIndex enables seamless web data ingestion for your LLM applications.

CrewAI

AI Agents

Build AI agent crews with web crawling capabilities using the SpiderTool integration.

AutoGen

AI Agents

Microsoft's AutoGen framework integration for multi-agent web crawling and scraping workflows.

Agno

AI Framework

Web scraping toolkit integration for the Agno AI platform.

FlowiseAI

No-Code

No-code integration for building LLM workflows with Spider as a document loader.

02 · Workflows

Automation & data pipelines.

Plug Spider into your automation stack and route data wherever it needs to go.

Data Connectors

Data Pipeline

Pipe crawl results directly to S3, GCS, Azure Blob, Supabase, or Google Sheets as pages arrive.

Learn more →

Zapier

Automation

Connect Spider to 5,000+ apps. Trigger crawls from any event and send data anywhere.

Learn more →

Webhooks

Automation

Receive crawl results in real-time via HTTP webhooks to any endpoint.

Learn more →

n8n

Automation

Community node for n8n workflow automation. Crawl, scrape, search, and transform web content in your workflows.

Learn more →
03 · SDKs

API client libraries.

Official SDKs for the Spider Cloud API. View on GitHub ↗

Python

Official Python client with async support and type hints.

pip install spider-client Docs →

Node.js

TypeScript-ready Node.js client for server and edge environments.

npm install @spider-cloud/spider-client Docs →

Rust

Native Rust client for maximum performance in Rust applications.

cargo add spider-client Docs →

cURL / REST

Direct REST API access for any language or platform.

Docs →
Build your own

Don't see your tool?

Spider's REST API works with any language or platform. Build your own integration or contribute to the ecosystem.