The Economist Scraper
Spider read economist.com in 176 ms without a browser and returned 339 lines of clean markdown, including sections like "The restaurant business is changing beyond recognition", "How long can Iran weaponise Hormuz?" and "The world’s most, and least, liveable cities in 2026".
## Stories most read by subscribers### The restaurant business is changing beyond recognition### How long can Iran weaponise Hormuz?### The world’s most, and least, liveable cities in 2026## This week### This week’s most important political storiesMigrants returned to Morocco from Ceuta; Volodymyr Zelensky continues shake-up of senior officials—and more### This week’s most important business storiesSpaceX’s posts first set of earnings; Saudi Aramco warns of dwindling oil stocks—and more### The best of your correspondenceThe consequences of aid cuts, household income, Africa’s cities, Claudette Colvin, pubs, prediction markets, AI-generated text### A lighter look at events## World news### How AI-fuelled wealth is reshaping South Korea### Why the EU’s big covid-recovery fund lost steam### Americans are sick of Republicans and Democrats. Can independents win?### How poor countries are dealing with America’s AIDS cuts## Business, finance and economics### Hollywood is entering its AI era### How China gets better bang for its buck than America in AI### What will Kevin Warsh do if America’s economy breaks?### Forget gold and copper. Africa’s latest boom is in fruit## Culture### The terrifying threat of a genetically engineered plagueAnnie Jacobsen imagines the repercussions of a leak from a Russian laboratory### Border walls are symbols of power—and monuments to delusionA summer stroll along Hadrian’s Wall is also a rendezvous with history### Bold, brash and divisive: inside the Barstool Sports empireDave Portnoy has created a loyal audience by refusing to please everyone### Colson Whitehead concludes his three-part love letter to New York### How Tom Holland became the world’s highest-grossing young actorThe same call, in code.
The capture above came back as markdown. These examples add a key, so you get browser rendering, proxies, and concurrency on economist.com.
import { SpiderBrowser } from "spider-browser";
const spider = new SpiderBrowser({
apiKey: process.env.SPIDER_API_KEY!,
});
await spider.connect();
const page = spider.page!;
await page.goto("https://www.economist.com/finance-and-economics");
// No selectors, no schema. Spider reads the page and names the fields.
const data = await page.scrape();
console.log(data);
await spider.close();import { SpiderBrowser } from "spider-browser";
const spider = new SpiderBrowser({
apiKey: process.env.SPIDER_API_KEY!,
stealth: 2,
captcha: "solve",
});
await spider.connect();
const page = spider.page!;
await page.goto("https://www.economist.com/finance-and-economics");
await page.content(10000);
const data = await page.evaluate(`(() => {
const articles = [];
document.querySelectorAll("[data-test-id='Article'], .teaser").forEach(el => {
const headline = el.querySelector("h3, .teaser__headline")?.textContent?.trim();
const link = el.querySelector("a")?.href;
const rubric = el.querySelector(".teaser__rubric, .teaser__text")?.textContent?.trim();
const section = el.querySelector(".teaser__subheadline")?.textContent?.trim();
if (headline) articles.push({ headline, link, rubric, section });
});
return JSON.stringify({ total: articles.length, articles: articles.slice(0, 15) });
})()`);
console.log(JSON.parse(data));
await spider.close();Ready for volume? Get an API key →
Fields you can pull.
Spider names these from the page. The capture above came back as markdown; the same
call with return_format: "json" returns them as keys.
What economist.com costs to scrape.
The capture above cost $0.000956 to fetch. Pricing is $1 per GB of pre-transformation bandwidth plus $0.001 per CPU minute, so a page like this one lands at a fraction of a cent. Failed requests are billed at $0.
- Free balance on signup
- No card required to test
- Balance never expires
Run it keyless, no account
More News scrapers.
Google News Scraper
Extract news articles, headlines, publication sources, and trending stories from Google News.
BBC News Scraper
Extract news articles, headlines, and publication data from BBC News.
CNN Scraper
Extract news articles, headlines, and video content data from CNN.
Start scraping economist.com.
You already have the call. A key raises the rate limit and turns on browser rendering, proxies, and concurrency. Balance never expires, and top-ups go through secure checkout.