South China Morning Post Scraper
Spider read scmp.com in 116 ms without a browser and returned 384 lines of clean markdown, including sections like "Health & Environment", "Middle East" and "Iran seeks to bar US ships as Hormuz deal with Oman advances".
### Measures targeting a key material for solar panels and semiconductors add to trade tensions ahead of Xi Jinping’s expected US visit.## Health & Environment## As record heatwave hits Asia, fears of energy crisis and health risks mount### Asia’s power infrastructure may come under pressure due to high demand for air conditioning amid lingering concerns over energy supply.## Business ## Chairman of global tech brand TCL sees digital future in ‘Screen Universe’ In partership with:TCL## Middle East## Iran seeks to bar US ships as Hormuz deal with Oman advances### Other details include a proposed ban on cargo related to Israel and a fee structure covering services like insurance and environmental costs.## US sanctions Cuba’s military representative in Beijing over China procurement### Measures target officials and firms accused of obtaining military equipment from China and Russia for Cuba’s armed forces.## US presses China over alleged scam bosses despite growing police cooperation### Washington says Trump raised the issue with Xi as the FBI expands cooperation with Chinese police on cyberfraud.## Military## China confirms 2 deaths in Scarborough Shoal crash during Philippine ship chase### Beijing honours two coastguard personnel who died in a vessel collision in the South China Sea last year.## Will latest trade ‘speed bump’ slow China-US ties, or even stop Xi-Trump summit?### As Beijing and Washington trade curbs, analysts say only major action or breach of the other’s core interests can prevent summit.SERIES: Female icons in Chinese history## The Chinese sex worker who built an empire in America’s Old West### Ah Toy rose from new immigrant to madam running a chain of successful brothels, fighting racism, sexism and the authorities on the way.## China## Argentina extends US$19 billion China currency swap despite US pressureThe same call, in code.
The capture above came back as markdown. These examples add a key, so you get browser rendering, proxies, and concurrency on scmp.com.
import { SpiderBrowser } from "spider-browser";
const spider = new SpiderBrowser({
apiKey: process.env.SPIDER_API_KEY!,
});
await spider.connect();
const page = spider.page!;
await page.goto("https://www.scmp.com/news/china/diplomacy/article/3250000/china-us-relations");
// No selectors, no schema. Spider reads the page and names the fields.
const data = await page.scrape();
console.log(data);
await spider.close();import { SpiderBrowser } from "spider-browser";
const spider = new SpiderBrowser({
apiKey: process.env.SPIDER_API_KEY!,
stealth: 2,
});
await spider.connect();
const page = spider.page!;
await page.goto("https://www.scmp.com/news/china/diplomacy/article/3250000/china-us-relations");
const data = await page.extractFields({
headline: "h1.headline, h1[class*='ArticleHeader']",
author: ".author__name a, [class*='AuthorName'] a",
date: "time[datetime], .article-header__publish-date",
summary: ".article__summary, .article-header__subheadline",
body: ".article__body, [class*='ArticleBody']",
topics: ".article__topics a, .topic-tag a",
image: { selector: ".article__header-image img, figure img", attribute: "src" },
});
console.log(data);
await spider.close();Ready for volume? Get an API key →
Fields you can pull.
Spider names these from the page. The capture above came back as markdown; the same
call with return_format: "json" returns them as keys.
What scmp.com costs to scrape.
The capture above cost $0.006926 to fetch. Pricing is $1 per GB of pre-transformation bandwidth plus $0.001 per CPU minute, so a page like this one lands at a fraction of a cent. Failed requests are billed at $0.
- Free balance on signup
- No card required to test
- Balance never expires
Run it keyless, no account
More News scrapers.
Google News Scraper
Extract news articles, headlines, publication sources, and trending stories from Google News.
BBC News Scraper
Extract news articles, headlines, and publication data from BBC News.
CNN Scraper
Extract news articles, headlines, and video content data from CNN.
Start scraping scmp.com.
You already have the call. A key raises the rate limit and turns on browser rendering, proxies, and concurrency. Balance never expires, and top-ups go through secure checkout.