Run a search query and automatically crawl the top results. This combines discovery and extraction into one step: you send a query, Spider finds the most relevant pages, visits each one, and returns clean content. Useful for market research, competitive analysis, and building datasets around a topic.

Key capabilities

  • Search + crawl in a single API call
  • Configurable result limits
  • Full content extraction from each result
  • Streaming output as results are processed
  • Geo-targeted search results via proxy routing
  • All common parameters supported