Skip to main content

GET simonwillison.net HTTP 200817 ms62.7 KB$0.000156 captured Aug 7, 2026

simonwillison.net, as data

One API turns any simonwillison.net page into markdown, structured JSON, its link graph or a screenshot, and crawls the whole site the same way. The panel shows the real response we captured.

target profile from the capture
Render mode
Plain HTTP, no browser needed
Response
HTTP 200 in 817 ms
Page size
62.7 KB of markdown, 621 lines
Fields
Business Name, Address, Phone, Category
Captured
Aug 7, 2026

Free balance on signup, no card. This simonwillison.net page cost $0.000156 to fetch.

response 200 · 817 ms · 62.7 KB
# Simon Willison’s Weblog**Simon Willison on Technical Blogging**.I was interviewed by Cynthia Dunlop for her "Write that blog!" series back in January, but I just realized I never linked to the interview from my own blog!It includes my answers to the following questions:* Why did you start blogging – and why do you continue?* What has been the most surprising impact of blogging for you?* What blog post are you most proud of and why?* What post was the most difficult to write and how did you tackle it?* Any lessons learned that you want to share with the community?* Your advice for people just getting started with blogging?* A few blogs that you particularly enjoy?I'll repeat my most important piece of advice here:> My number one tip for blogging is to lower your standards! Aim to hit publish while you are still actively unhappy with what you have written, because the only alternative is a huge folder full of drafts and never publishing anything at all.> Nobody will ever know how perfect the thing you*> to write would have been. The flaws you see in your writing are invisible to everyone else.**An AI model from Meta also hacked another company during testing**.Stop me if you've heard this one before:> An AI model from the parent company of Facebook and Instagram hacked into another company’s systems during cybersecurity testing, a spokesperson confirmed on Wednesday.> Meta says the breach occurred because of an inadvertent error during testing of the model, similar to previously disclosed incidents with OpenAI and Anthropic.> “A misconfiguration by Irregular, an independent testing company Meta uses, inadvertently allowed one of our models access to the internet during evaluation,” the Meta spokesperson said.> Meta’s Muse Spark model “exploited a security vulnerability” in another company “in a manner similar to previously-reported instances with other companies.”
POST /scrape · simonwillison.net/index.md · markdown · Showing 21 of 621 lines · captured Aug 7, 2026

What Spider does on simonwillison.net

Same key, five endpoints. The numbers under a cell were measured on this page.

/scrape

Page to markdown

Clean text for RAG and LLM context, boilerplate removed. The lane that runs without a key.

817 ms · $0.000156
/fetch

Page to JSON

Spider reads the page and names the fields. Pass your own schema when you need exact keys.

/crawl

Whole site

Follows simonwillison.net's own links, respects robots, streams pages as they land.

/links

Link graph

Every internal and external URL on a page, before you decide what to fetch.

/screenshot

Rendered capture

Real Chromium, full-page PNG. The same call also returns the rendered HTML.

The call behind the panel

This request produced the response above. Paste it with your key and you get the same bytes.

request scrape.sh
curl -X POST https://api.spider.cloud/scrape \
  -H "Authorization: Bearer $SPIDER_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"url": "https://simonwillison.net/", "return_format": "markdown"}'
plain request · no browser, no selectors

What simonwillison.net costs

Multiplied from the measured 62.7 KB page. Estimates round to the cent.

cost measured
This page, once 62.7 KB over HTTP, measured $0.000156
This page, daily for a month 30 fetches at the measured price ≈ $0.004682
1,000 pages this size 61.2 MB at the measured price ≈ $0.16
10,000 pages this size 612.4 MB at the measured price ≈ $1.56

1 GB of transfer costs $1, plus $0.001 per CPU minute, and failed requests cost $0. Crawling daily? The Unlimited plan is a flat monthly rate.

Point this at the rest of simonwillison.net.

The capture above took 817 ms and cost $0.000156. The same call takes any URL on simonwillison.net.

Get an API key

More in Directories

All Directories scrapers