Unblocker API POST /unblocker

Reach pages standard scrapers can't.

Browser fingerprints, CAPTCHA solving, session pinning, and adaptive retries. Billed only when the unblock succeeds.

Start unblocking Try in playground

403

Blocked

CAPTCHA

Solving

200

Content

spider.unblocker() handles the rest

What gets bypassed

Four defense layers, one request.

No manual challenge solving, no proxy juggling — Spider walks each layer in sequence.

IP & rate limiting

Rotates through residential and mobile proxies with authentic geo-targeting

Browser fingerprinting

Real browser sessions with matching WebGL, fonts, screen dimensions, and hardware profiles

CAPTCHA / challenges

Automatically detects and solves verification challenges, puzzles, and interstitials

JavaScript checks

Executes JS detection scripts as a real browser would, passing timing and behavioral analysis

When to use

Standard or Unblocker?

Standard Crawl / Scrape

Works for most websites. Spider's Smart mode handles JS rendering, common bot detection, and standard protections. Start here — it's cheaper and faster.

Standard JS-rendered sites
Basic rate limiting / IP blocks
Common Cloudflare / CDN protections

Unblocker

For sites where standard requests return blocks, challenges, or empty content. Costs 10-40 additional credits per successful request.

Advanced CAPTCHA / challenge pages
Sophisticated fingerprint checks
Sites that actively detect bots

Bypass sequence

How it gets through.

Bypass log

$ spider.unblocker("https://protected-site.com")

[1] launching browser session with authentic fingerprint

screen: 1920×1080 · webgl: ANGLE · fonts: 247 installed

[2] challenge detected — Cloudflare Turnstile

solving challenge... passed (1.2s)

[3] loading content — waiting for page render

DOM ready · 47 elements · 12KB content

→ 200 OK · content extracted · markdown returned

Capabilities

What you can control.

Retry logic

If the first attempt is blocked, Spider automatically retries with different fingerprints, proxy paths, and timing patterns to maximize success rate.

Sessions

Maintain browser sessions across requests with session. Once a site is unblocked, subsequent requests reuse the authenticated session state.

Proxies

Combine with residential, mobile, or ISP proxies for maximum stealth. Geo-target requests so they originate from the right country.

Same API

Accepts the same parameters as crawl and scrape. Switch between endpoints by changing the path — no code restructuring needed.

Pay per success

The additional 10-40 credits are only charged on successful unblocking. If Spider can't get through, you don't pay the premium.

Custom JS

Run JavaScript on the page after unblocking with evaluate_on_new_document. Interact with elements, expand content, or trigger actions.

Credit cost

Pay only for what gets through.

Base Standard crawl credits

+10–40 Per successful unblock

$0 If unblocking fails

Examples

cURL, Python, Node.

from spider import Spider

client = Spider()

# Access a site with heavy bot protection
result = client.unblocker(
    "https://protected-site.com/data",
    params={
        "return_format": "markdown",
        "proxy_enabled": True,
        "country_code": "us",
    },
)

print(result[0]["content"])

curl -X POST https://api.spider.cloud/unblocker \
  -H "Authorization: Bearer $SPIDER_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "url": "https://protected-site.com",
    "return_format": "markdown",
    "session": true,
    "fingerprint": true,
    "proxy_enabled": true
  }'

import Spider from "@spider-cloud/spider-client";

const client = new Spider();

const result = await client.unblocker("https://protected-site.com/data", {
  return_format: "markdown",
  proxy_enabled: true,
  country_code: "us",
});

console.log(result[0].content);

More from the API.

Crawl API

Start with standard crawling first

Screenshot API

Capture protected pages visually

Get started

Reach any website, no matter the protection.

Advanced anti-bot bypass when standard scraping isn't enough.

Get started View all APIs