The Information Scraper
Spider read theinformation.com in 116 ms without a browser and returned 222 lines of clean markdown.
The Big Read: Sequoia Capital Goes All Out on AI Under New Leaders Save 25% to unlock this storyIn its motion to dismiss, the AI startup accused Apple of failing to provide evidence of specific trade secrets that OpenAI employees stole.](https://theinformation.com/briefings/openai-asks-judge-dismiss-apple-lawsuit)The Electric### Amid the EV Wreckage, Harbinger Motors Says Unsexy Van Chassis Pay Off[### Atlassian Stock Soars on Strong Cloud Revenue GrowthAtlassian CEO and cofounder Mike Cannon-Brookes said he planned to start buying as much as $250 million in shares, signaling his confidence in the stock.](https://theinformation.com/briefings/atlassian-stock-soars-strong-cloud-revenue-growth)[### Alphabet Draws Strong Demand for $25 Billion Debt Sale With Higher YieldsThe parent of Google offered a new-issue concession to attract buyers and move beyond a period in which investors had shown less appetite for tech company debt.](https://theinformation.com/briefings/alphabet-draws-strong-demand-25-billion-debt-sale-higher-yields)## Featured NewslettersThe Information's reporters Valida Pau and Julia Hornstein give you the inside scoop on tech deals and dealmakers.Five times/week### The BriefingGet smarter about the most important stories in tech, media and finance by following Silicon Valley’s most-read executive newsletter.Laura Bratton takes you inside how businesses are using AI to automate work.AI Agenda### OpenAI Acquired Patents from Altman-Backed AI Chip Startup Following Failed Acquisition[### OpenAI’s Smart Speaker Will Cost Over $300The first device in OpenAI’s new family of hardware devices is expected to be released next year.](https://theinformation.com/briefings/openais-smart-speaker-will-cost-300)[### Pinterest Hires New Content Executive Amid C-Suite ShakeupThe same call, in code.
The capture above came back as markdown. These examples add a key, so you get browser rendering, proxies, and concurrency on theinformation.com.
import { SpiderBrowser } from "spider-browser";
const spider = new SpiderBrowser({
apiKey: process.env.SPIDER_API_KEY!,
});
await spider.connect();
const page = spider.page!;
await page.goto("https://www.theinformation.com/");
// No selectors, no schema. Spider reads the page and names the fields.
const data = await page.scrape();
console.log(data);
await spider.close();import { SpiderBrowser } from "spider-browser";
const spider = new SpiderBrowser({
apiKey: process.env.SPIDER_API_KEY!,
stealth: 2,
captcha: "solve",
});
await spider.connect();
const page = spider.page!;
await page.goto("https://www.theinformation.com/");
await page.content(10000);
const data = await page.extractFields({
headline: "h1, h2.article-title",
author: ".byline a, .author-name",
date: "time[datetime], .date",
summary: ".article-dek, .summary",
body: ".article-body, .story-body",
tags: ".tag-list a, .article-tags a",
});
console.log(data);
await spider.close();Ready for volume? Get an API key →
Fields you can pull.
Spider names these from the page. The capture above came back as markdown; the same
call with return_format: "json" returns them as keys.
What theinformation.com costs to scrape.
The capture above cost $0.000885 to fetch. Pricing is $1 per GB of pre-transformation bandwidth plus $0.001 per CPU minute, so a page like this one lands at a fraction of a cent. Failed requests are billed at $0.
- Free balance on signup
- No card required to test
- Balance never expires
Run it keyless, no account
More News scrapers.
Google News Scraper
Extract news articles, headlines, publication sources, and trending stories from Google News.
BBC News Scraper
Extract news articles, headlines, and publication data from BBC News.
CNN Scraper
Extract news articles, headlines, and video content data from CNN.
Start scraping theinformation.com.
You already have the call. A key raises the rate limit and turns on browser rendering, proxies, and concurrency. Balance never expires, and top-ups go through secure checkout.