Newscientist Scraper
Spider read newscientist.com in 149 ms without a browser and returned 325 lines of clean markdown, including the section "Video".
Online ### Darwin, Wallace, and the joint discovery of natural selection Online 3 September 2026Online ### Chasing totality: How to view and photograph the 2026 solar eclipse Online On Demand EventListen to our weekly science and technology round-up show, as well as your other favourite New Scientist podcasts#### Change your mind ### Caffeine – Could Your Morning Coffee be Protecting Your Brain? Podcast#### Change your mind ### Bonus Brain Tips – How to maintain your friendships and how to use sunlight to get better sleep Podcast#### Change your mind ### Bonus Brain Tips – How To Hack Your Nap and How to Beat Chronic Stress PodcastExplore all of our podcasts New episodes every week, available wherever you listen to podcasts## Video### Watch the latest science news, discoveries and big ideas from New Scientist’s video team* [ Video ## The paradox that breaks the laws of physics | John Goold Video](https://www.newscientist.com/video/2583218-2583218/)* [ Video ## The biggest mysteries in physics may have one answer Video](https://www.newscientist.com/video/2582019-the-biggest-mysteries-in-physics-may-have-one-answer/)* [ Video ## We still don’t know how black holes get so big | Becky Smethurst Video](https://www.newscientist.com/video/2580686-we-still-dont-know-how-black-holes-get-so-big-becky-smethurst/)* [ Video ## “Physics is the antagonist” in Claire North’s space opera Slow Gods Video](https://www.newscientist.com/video/2580111-physics-is-the-antagonist-in-claire-norths-space-opera-slow-gods/)* [ Video ## The Dinosaur Extinction Was More Complicated Than You Think Video](https://www.newscientist.com/video/2579776-the-dinosaur-extinction-was-more-complicated-than-you-think/)* [ Video ## The physicist trying to solve the gravity question Video](https://www.newscientist.com/video/2533453-the-physicist-trying-to-solve-the-gravity-question/)The same call, in code.
The capture above came back as markdown. These examples add a key, so you get browser rendering, proxies, and concurrency on newscientist.com.
import { SpiderBrowser } from "spider-browser";
const spider = new SpiderBrowser({
apiKey: process.env.SPIDER_API_KEY!,
});
await spider.connect();
const page = spider.page!;
await page.goto("https://newscientist.com");
// No selectors, no schema. Spider reads the page and names the fields.
const data = await page.scrape();
console.log(data);
await spider.close();import { Spider } from "@spider-cloud/spider-client";
const spider = new Spider({ apiKey: process.env.SPIDER_API_KEY! });
const result = await spider.scrapeUrl("https://www.newscientist.com", {
return_format: "markdown",
});
console.log(result);Ready for volume? Get an API key →
Fields you can pull.
Spider names these from the page. The capture above came back as markdown; the same
call with return_format: "json" returns them as keys.
What newscientist.com costs to scrape.
The capture above cost $0.000327 to fetch. Pricing is $1 per GB of pre-transformation bandwidth plus $0.001 per CPU minute, so a page like this one lands at a fraction of a cent. Failed requests are billed at $0.
- Free balance on signup
- No card required to test
- Balance never expires
Run it keyless, no account
More Science scrapers.
Science Scraper
Extract research papers, scientific data, and academic content from Science.
Cell Scraper
Extract research papers, scientific data, and academic content from Cell.
Thelancet Scraper
Extract research papers, scientific data, and academic content from Thelancet.
Start scraping newscientist.com.
You already have the call. A key raises the rate limit and turns on browser rendering, proxies, and concurrency. Balance never expires, and top-ups go through secure checkout.