Skip to main content
Docs API Ref

FlowiseAI integration

Use Spider as a document loader inside FlowiseAI and scrape or crawl pages from the visual builder.

Setup

Give the Spider node your API key.

  1. 01Open the Spider dashboard.
  2. 02Go to API keys and create one. The account needs credits before it can issue a key.
  3. 03Paste the key into the "Credential" field of the Spider node.
spider nodeThe Spider document loader form in FlowiseAI

Scrape and crawl

Set up the Spider node in a flow.

  1. 01Pick "Scrape" or "Crawl" in the mode dropdown.
  2. 02Enter the URL in the "Web Page URL" field.
  3. 03For "Crawl", set the most pages you want in the "Limit" field. Empty or 0 crawls every page.
example flowA FlowiseAI flow with the Spider document loader wired in