researchgate.net
Scrape researchgate.net
Get any researchgate.net page back as clean markdown, no account needed.
Get a free API key
Free balance on signup. No card.
No stored capture for researchgate.net yet. Press Run to fetch it live.
The same call, in code
The run above is the whole API. A key adds browser rendering, proxies, and concurrency on researchgate.net.
researchgate-scraper.ts
import { SpiderBrowser } from "spider-browser";
const spider = new SpiderBrowser({
apiKey: process.env.SPIDER_API_KEY!,
});
await spider.connect();
const page = spider.page!;
await page.goto("https://www.researchgate.net/search/publication?q=transformer+architecture");
// No selectors, no schema. Spider reads the page and names the fields.
const data = await page.scrape();
console.log(data);
await spider.close(); ready to run · spider-browser, no selectors npm i spider-browser
Fields and cost
You pay $1 per GB plus $0.001 per CPU minute, so most pages cost a fraction of a cent. Failed requests cost $0.
Paper titleAuthorsCitationsReadsJournalDOIAbstractFull-text availability