Zapier Integration

Scrape and crawl pages as part of any Zapier workflow — no code required. Install the Spider integration to get started.

Example: Automatically enrich company data by scraping a URL each time a new row is added to a Google Sheet.

Zapier Sales Lead Scrape

Before you start

Accept the Spider Zapier invite and connect your Google Sheets account.

Setting up the Zapier workflow

  1. Add the first step to fire off the "New Spreadsheet Row" in Google Sheets trigger.Google Sheets New Spreadsheet Row
  2. Add an optional 1 min. delay (Delay by Zapier) for our Zap to run when a new row is added in our Google Sheet.Add Delay to crawl (optional)
  3. Add the "Scrape New Page URL" Spider Zap in Zapier. For this example, we'll be using the single scrape action event.Scrape New Page URL

    For the Scrape URL field, select the URL column from our Google Sheet. Set return format as "text", and optionally we'll set premium proxy to "True".Configure Scrape New Page URL
  4. Next step is to format the output response from our scraped data using Zapier's "Text in Formatter" and select "text" for action event.Text Formatter

    Now, let's configure this text formatter to truncate our text from the scraped output. For the "input" field select the "content" from the output response of our Spider Zap from the previous step. Set the max length to 6000 for this example (feel free to adjust) and set "append the ellipsis" to "True".Text Formatter Config
  5. Then we pass on this formatted text to the built-in AI tool from Zapier (requires upgrade to Pro).AI Summary

    Configure the AI prompt assistant by describing our desired action. This will auto generate our prompt and works pretty decent (feel free do adjust). In the "input fields" section, set the Scraped Content that we truncated to the "Output" of the last step. Lastly, we'll create an output field named "company_summary" which will contain the summarized content.AI Summary Config
  6. Once the text from the scrape URL has been summarized, we then update our spreadsheet row in our Google Sheet.Update Google Sheet

    Now configure our Google Sheet to point the same spreadsheet and worksheet from step #1. Set the field of the row number from our Google Sheet. Set "description" to point to our company summary field that we set from the previous step. We can leave url,company_name, and comments empty as these fields aren't being updated. Ignore the notice on Zap loop being detected as our workflow updates a previous row.Update Google Sheet Config
  7. Finally, when we run our test we should have the description field filled out in our Google Sheet (as seen in row #6 in our example below).Google Sheet Added