Skip to main content

GET arxiv.org HTTP 2001.1 s10.7 KB$0.000076 captured Aug 7, 2026

arxiv.org, as data

One API turns any arxiv.org page into markdown, structured JSON, its link graph or a screenshot, and crawls the whole site the same way. The panel shows the real response we captured.

target profile from the capture
Render mode
Plain HTTP, no browser needed
Response
HTTP 200 in 1.1 s
Page size
10.7 KB of markdown, 186 lines
Fields
Paper title, Authors, Abstract, Categories and 4 more
Captured
Aug 7, 2026

Free balance on signup, no card. This arxiv.org page cost $0.000076 to fetch.

response 200 · 1.1 s · 10.7 KB
Tables should be formatted as shown in the example below with no column lines, unless these are essential for clarifying the content of the table. Row lines can be used to distinguish the column headings from the content of the table.tables must be numbered and cited within the text in strict numerical order. Table captions must be above the table and in 10 pt font.Equations should fit into a two-column print format and be single spaced.When writing mathematics, avoid confusion between characters that could be mistaken for one another, e.g. the letter ‘l’ and the number one.Vectors and matrices should be in bold italic and variables in italic.If your paper contains superscripts or subscripts, take special care to ensure that the positioning of the characters is unambiguous.Exponential expressions should be written using superscript notation, i.e. 5×1035superscript1035\times 10^{3}5 × 10 start_POSTSUPERSCRIPT 3 end_POSTSUPERSCRIPT not 5E03.A multiplication symbol should be used, not a dot.Refer to equations using round brackets e.g. (1)Use SI (MKS) units only and avoid spelling the unit in full instead of using the shortened notation e.g. use kJ not kilo Joules.If for any reason you must use mixed units, the units used for each quantity in an equation must be stated.Place a zero before decimal points: “0.10” do not put “.10”.Submissions should always include the following sections: an abstract; an introduction; a conclusion and a references section. If any of the above sections are not included the paper may be asked to add the relevant section or be rejected.Acknowledgements should be placed after the conclusion and before the references section. Details of grants, financial aid and other special assistance should be noted.You should number your references sequentially throughout the text, and eachreference should be individually numbered and enclosed in square brackets
POST /scrape · arxiv.org/html/2403.04665v2.md · markdown · Showing 16 of 186 lines · captured Aug 7, 2026

What Spider does on arxiv.org

Same key, five endpoints. The numbers under a cell were measured on this page.

/scrape

Page to markdown

Clean text for RAG and LLM context, boilerplate removed. The lane that runs without a key.

1.1 s · $0.000076
/fetch

Page to JSON

Spider reads the page and names the fields. Pass your own schema when you need exact keys.

/crawl

Whole site

Follows arxiv.org's own links, respects robots, streams pages as they land.

/links

Link graph

Every internal and external URL on a page, before you decide what to fetch.

/screenshot

Rendered capture

Real Chromium, full-page PNG. The same call also returns the rendered HTML.

The call behind the panel

This request produced the response above. Paste it with your key and you get the same bytes.

request scrape.sh
curl -X POST https://api.spider.cloud/scrape \
  -H "Authorization: Bearer $SPIDER_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"url": "https://arxiv.org/html/2403.04665v2", "return_format": "markdown"}'
plain request · no browser, no selectors

What arxiv.org costs

Multiplied from the measured 10.7 KB page. Estimates round to the cent.

cost measured
This page, once 10.7 KB over HTTP, measured $0.000076
This page, daily for a month 30 fetches at the measured price ≈ $0.002268
1,000 pages this size 10.5 MB at the measured price ≈ $0.08
10,000 pages this size 104.6 MB at the measured price ≈ $0.76

1 GB of transfer costs $1, plus $0.001 per CPU minute, and failed requests cost $0. Crawling daily? The Unlimited plan is a flat monthly rate.

Point this at the rest of arxiv.org.

The capture above took 1.1 s and cost $0.000076. The same call takes any URL on arxiv.org.

Get an API key

More in AI & Developer

All AI & Developer scrapers