# Web scraping integrations for LangChain, MCP and n8n | Spider

Web scraping integrations for LangChain, LlamaIndex, CrewAI, MCP clients, n8n, and Zapier, plus Python, Node, and Rust SDKs. Crawl from the tools you use.

Canonical: https://spider.cloud/integrations/

## Web scraping integrations for the tools you already use.

Native document loaders for the AI frameworks, ready-made nodes for n8n and Zapier, and official SDKs for Python, Node, and Rust.

LangChain LlamaIndex CrewAI AutoGen MCP +14more

## AI frameworks with native loaders.

Pull Spider into LangChain, LlamaIndex, CrewAI, and the other frameworks shipping today. No glue code.

Browser New

### Cloud browser

Native Rust browser engine with AI agents and a retry engine. Connect to pre-warmed cloud browsers via WebSocket.

`npm install spider-browser`

[Docs → ](https://spider.cloud/docs/core/spider-browser/)[GitHub ↗](https://github.com/spider-rs/spider-browser)

MCP Popular

### MCP Server

27 tools for Claude, Cursor, Windsurf, and any MCP client on the hosted server at mcp.spider.cloud. Or run it locally via npx.

`npx spider-cloud-mcp`

[Docs → ](https://spider.cloud/mcp/)[GitHub ↗](https://github.com/spider-rs/spider-mcp)

AI Framework

### LangChain

Use Spider as a document loader in your LangChain applications. Perfect for building RAG systems and AI agents.

[Docs → ](https://spider.cloud/docs/integrations/langchain/)[Guide →](https://spider.cloud/guides/langchain-groq/)

AI Framework

### LlamaIndex

Spider Reader for LlamaIndex loads pages into your index as clean documents.

[Docs →](https://spider.cloud/docs/integrations/llamaindex/)

AI Agents

### CrewAI

Build AI agent crews with web crawling capabilities using the SpiderTool integration.

[Docs → ](https://spider.cloud/docs/integrations/crewai/)[Guide →](https://spider.cloud/guides/crewai-spider-research-agent/)

AI Agents

### AutoGen

Microsoft's AutoGen framework integration for multi-agent web crawling and scraping workflows.

[Guide →](https://spider.cloud/guides/crawl-agent-with-autogen/)

AI Framework

### Agno

Web scraping toolkit integration for the Agno AI platform.

[Docs →](https://spider.cloud/docs/integrations/agno/)

No-Code

### FlowiseAI

No-code integration for building LLM workflows with Spider as a document loader.

[Docs →](https://spider.cloud/docs/integrations/flowiseai/)

No-Code

### Langflow

Spider Web Crawler and Scraper component, ready to drop into any Langflow graph.

[GitHub ↗](https://docs.langflow.org/bundles-langchain)

No-Code

### Dify

Dify-verified plugin that gives workflows and agents scrape and crawl tools.

[GitHub ↗](https://marketplace.dify.ai/plugin/langgenius/spider)

AI Agents

### Julep

Crawl, links, search, and screenshot methods available to Julep tasks.

[GitHub ↗](https://docs.julep.ai/integrations/webbrowser/spider)

## Automation and data pipeline integrations.

Ready-made nodes for n8n and Zapier, first-party connectors for S3, GCS, Supabase, and Sheets, and webhooks for everything else.

Data Pipeline

### Data Connectors

Pipe crawl results directly to S3, GCS, Azure Blob, Supabase, or Google Sheets as pages arrive.

[Learn more →](https://spider.cloud/docs/core/data-connectors/)

Automation

### Zapier

Connect Spider to 5,000+ apps. Trigger crawls from any event and send data anywhere.

[Learn more →](https://spider.cloud/docs/integrations/zapier/)

Automation

### Webhooks

Receive crawl results in real-time via HTTP webhooks to any endpoint.

[Learn more →](https://spider.cloud/docs/api/)

Automation

### n8n

Community node for n8n workflow automation. Crawl, scrape, search, and transform web content in your workflows.

[Learn more →](https://spider.cloud/n8n/)

## Official SDKs for Python, Node, and Rust.

All three share the same methods, and the REST API covers every other language. [View on GitHub ↗](https://github.com/spider-rs/spider-clients)

client libraries

- ### Python

  Official Python client with async support and type hints.

  `pip install spider-client`

  [Docs →](https://spider-rs.github.io/spider-clients)

- ### Node.js

  TypeScript-ready Node.js client for server and edge environments.

  `npm install @spider-cloud/spider-client`

  [Docs →](https://spider-rs.github.io/spider-clients)

- ### Rust

  Native Rust client for maximum performance in Rust applications.

  `cargo add spider-client`

  [Docs →](https://docs.rs/spider-client)

- ### cURL / REST

  Direct REST API access for any language or platform.

  [Docs →](https://spider.cloud/docs/api/)

## Don't see your tool?

Spider's REST API works with any language or platform. Build your own integration, or open a pull request on the open-source clients.

[API reference ](https://spider.cloud/docs/api/)[Contribute on GitHub ↗](https://github.com/spider-rs)
