Run a search query and automatically crawl the top results. This combines discovery and extraction into one step: you send a query, Spider finds the most relevant pages, visits each one, and returns clean content. Useful for market research, competitive analysis, and building datasets around a topic.
Key capabilities
- ✓ Search + crawl in a single API call
- ✓ Configurable result limits
- ✓ Full content extraction from each result
- ✓ Streaming output as results are processed
- ✓ Geo-targeted search results via proxy routing
- ✓ All common parameters supported