IEEE Xplore Scraper

Extract technical papers, conference proceedings, standards documents, and citation data from IEEE Xplore digital library. Built on spider-browser .

Get started Docs

target
ieeexplore.ieee.org: success rate
99.9%: latency
~4ms

Quick start

Extract data in minutes.

ieee-xplore-scraper.ts

import { SpiderBrowser } from "spider-browser";

const spider = new SpiderBrowser({
  apiKey: process.env.SPIDER_API_KEY!,
  stealth: 2,
});

await spider.connect();
const page = spider.page!;
await page.goto("https://ieeexplore.ieee.org/search/searchresult.jsp?queryText=deep+learning");
await page.content(10000);

const data = await page.evaluate(`(() => {
  const papers = [];
  document.querySelectorAll("ol, ul[class*='results'], section[class*='results']").forEach(el => {
    const title = el.querySelector("h3 a, .result-item-title")?.textContent?.trim();
    const authors = el.querySelector(".author, .result-item-authors")?.textContent?.trim();
    const venue = el.querySelector(".publisher-info-container, .result-item-publisher")?.textContent?.trim();
    const year = el.querySelector(".publisher-info-container .year")?.textContent?.trim();
    const citations = el.querySelector("[class*='citation-count']")?.textContent?.trim();
    if (title) papers.push({ title, authors, venue, year, citations });
  });
  return JSON.stringify({ total: papers.length, papers: papers.slice(0, 15) });
})()`);

console.log(JSON.parse(data));
await spider.close();

ready to run · spider-browser · TypeScript

Fetch API

One endpoint for ieeexplore.ieee.org.

Structured JSON from ieeexplore.ieee.org with a single POST. AI-resolved selectors, cached on the first call.

POST /fetch/ieeexplore.ieee.org/

Paper titleAuthorsAbstractConferenceDOICitations

Try it Fetch docs

cURL

curl -X POST https://api.spider.cloud/fetch/ieeexplore.ieee.org/ \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"return_format": "json"}'

Python

import requests

resp = requests.post(
    "https://api.spider.cloud/fetch/ieeexplore.ieee.org/",
    headers={
        "Authorization": "Bearer YOUR_API_KEY",
        "Content-Type": "application/json",
    },
    json={"return_format": "json"},
)
print(resp.json())

Node.js

const resp = await fetch("https://api.spider.cloud/fetch/ieeexplore.ieee.org/", {
  method: "POST",
  headers: {
    "Authorization": "Bearer YOUR_API_KEY",
    "Content-Type": "application/json",
  },
  body: JSON.stringify({ return_format: "json" }),
});
const data = await resp.json();
console.log(data);

Extraction

Fields you can pull.

Paper titleAuthorsAbstractConferenceDOICitationsPublished dateDocument type

Content

Paper extraction

Extract abstracts, citations, author data, and metadata from ieeexplore.ieee.org.

Parsing

Academic parsing

Clean extraction of LaTeX, references, and structured research data.

Scale

Bulk research

Process thousands of papers and citations for systematic reviews.

More Science & Research scrapers.

arxiv.org

arXiv Scraper

Extract preprint papers, abstracts, author lists, and citation metadata from arXiv open-access research repository.

pubmed.ncbi.nlm.nih.gov

PubMed Scraper

Extract biomedical literature, abstracts, MeSH terms, and citation data from PubMed National Library of Medicine database.

researchgate.net

ResearchGate Scraper

Extract researcher profiles, publication lists, citation metrics, and project data from ResearchGate academic network.

Start

Start scraping ieeexplore.ieee.org.

Grab an API key and call the endpoint above. The first request resolves the config; every request after hits cache.

Get started free All scrapers