Track competitor prices the moment they shift.
Spider watches product pages on a schedule and returns structured price, stock, and SKU data the moment something changes. JavaScript storefronts, bot-protected stores, and regional currencies included.
- Wireless Headphones Pro $149.99 -$20
- 4K Action Camera $299.00 +$15
- Standing Desk Frame $449.95 --
- Ergonomic Keyboard $89.00 -$11
- USB-C Hub 10-in-1 $54.99 +$5
- Noise Cancelling Buds $79.00 -$30
- Smart Home Speaker $129.99 OOS
Flat-rate billing on bot-protected stores.
Most providers charge multipliers for bot-protected sites. E-commerce stores are almost always protected, which makes the monthly bill a guessing game. Spider bills on bandwidth and compute at the same rate regardless of how protected the target site is.
Estimate based on 100K Chrome-rendered scrapes. See full pricing .
Pull exactly the fields you need.
Point CSS selectors at the elements you care about. Spider renders the full storefront, including JavaScript-loaded prices, runs your selectors, and returns clean JSON. Define selectors once, reuse them across every scheduled run.
import requests
response = requests.post(
"https://api.spider.cloud/scrape",
headers={"Authorization": "Bearer YOUR_API_KEY"},
json={
"url": "https://store.example.com/product/123",
"cache": False,
"css_extraction_map": {
"/product": [
{"name": "product", "selectors": ["h1.product-title"]},
{"name": "price", "selectors": [".price-current"]},
{"name": "stock", "selectors": [".availability-status"]},
{"name": "sku", "selectors": [".sku-value"]},
]
},
},
)
data = response.json()
print(data[0]["css_extracted"])
# {"product": ["Wireless Headphones Pro"], "price": ["$149.99"],
# "stock": ["In Stock"], "sku": ["WHP-2024-BK"]}From URL list to automatic repricing.
Four stages. Each one feeds the next.
Recurring scrapes
Submit competitor product URLs from a cron job, Lambda, or any scheduler. Spider renders JavaScript-heavy storefronts and returns structured data every cycle. Define CSS selectors once and reuse across runs.
Compare and alert
Compare each run's structured JSON against the previous snapshot. When a price drops, a product goes out of stock, or a listing title changes, your pipeline triggers Slack, your dashboard, or your repricing engine. Spider delivers data via webhooks as pages finish.
Regional prices
The same product often costs different amounts depending on visitor location. Spider's proxy network covers 199+ countries, so you see the localized storefront and currency your customers see. Useful for cross-border sellers and MAP enforcement.
Update automatically
Feed structured JSON into your repricing tool or rules engine. When a competitor undercuts you on a key SKU, your system adjusts before shoppers notice the gap.
Keep reading.
Structured product data on your schedule.
Bot-protection bypass included in the base flow. Free balance on sign-up.