Skip to main content

GET publicsuffix.org HTTP 200398 ms1.7 KB$0.000018 captured Aug 7, 2026

publicsuffix.org, as data

One API turns any publicsuffix.org page into markdown, structured JSON, its link graph or a screenshot, and crawls the whole site the same way. The panel shows the real response we captured.

target profile from the capture
Render mode
Plain HTTP, no browser needed
Response
HTTP 200 in 398 ms
Page size
1.7 KB of markdown, 14 lines
Fields
Business Name, Address, Phone, Category and 2 more
Captured
Aug 7, 2026

Free balance on signup, no card. This publicsuffix.org page cost $0.000018 to fetch.

response 200 · 398 ms · 1.7 KB
A "public suffix" is one under which Internet users can (or historically could) directly register names. Some examples of public suffixes are `com`, `co.uk` and `pvt.k12.ma.us`. The Public Suffix List is a list of all known public suffixes.The Public Suffix List is an initiative of Mozilla, but is maintained as a community resource. It is available for use in any software, but was originally created to meet the needs of browser manufacturers. It allows browsers to, for example:Avoid privacy-damaging "supercookies" being set for high-level domain name suffixesHighlight the most important part of a domain name in the user interfaceAccurately sort history entries by siteWe maintain a fuller (although not exhaustive) list of what people are using it for. If you are using it for something else, you are encouraged to tell us, because it helps us to assess the potential impact of changes. For that, you can use the psl-discuss mailing list, where we consider issues related to the maintenance, format and semantics of the list. Note: please do not use this mailing list torequest amendments to the PSL's data.It is in the interest of Internet registries to see that their section of the list is up to date. If it is not, their customers may have trouble setting cookies, or data about their sites may display sub-optimally. So we encourage them to maintain their section of the list by submitting amendments.
POST /scrape · publicsuffix.org/index.md · markdown · 14 lines · captured Aug 7, 2026

What Spider does on publicsuffix.org

Same key, five endpoints. The numbers under a cell were measured on this page.

/scrape

Page to markdown

Clean text for RAG and LLM context, boilerplate removed. The lane that runs without a key.

398 ms · $0.000018
/fetch

Page to JSON

Spider reads the page and names the fields. Pass your own schema when you need exact keys.

/crawl

Whole site

Follows publicsuffix.org's own links, respects robots, streams pages as they land.

/links

Link graph

Every internal and external URL on a page, before you decide what to fetch.

/screenshot

Rendered capture

Real Chromium, full-page PNG. The same call also returns the rendered HTML.

The call behind the panel

This request produced the response above. Paste it with your key and you get the same bytes.

request scrape.sh
curl -X POST https://api.spider.cloud/scrape \
  -H "Authorization: Bearer $SPIDER_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"url": "https://publicsuffix.org/", "return_format": "markdown"}'
plain request · no browser, no selectors

What publicsuffix.org costs

Multiplied from the measured 1.7 KB page. Estimates round to the cent.

cost measured
This page, once 1.7 KB over HTTP, measured $0.000018
This page, daily for a month 30 fetches at the measured price ≈ $0.000551
1,000 pages this size 1.6 MB at the measured price ≈ $0.02
10,000 pages this size 16.2 MB at the measured price ≈ $0.18

1 GB of transfer costs $1, plus $0.001 per CPU minute, and failed requests cost $0. Crawling daily? The Unlimited plan is a flat monthly rate.

Point this at the rest of publicsuffix.org.

The capture above took 398 ms and cost $0.000018. The same call takes any URL on publicsuffix.org.

Get an API key

More in Directories

All Directories scrapers