Hugging Face Scraper
Extract ML model cards, dataset info, leaderboard data, and paper metadata from Hugging Face. Powered by spider-browser .
huggingface.co target
99.5% success rate
~4ms latency
Extract data in minutes
huggingface-scraper.ts
import { SpiderBrowser } from "spider-browser";
const spider = new SpiderBrowser({
apiKey: process.env.SPIDER_API_KEY!,
});
await spider.connect();
const page = spider.page!;
await page.goto("https://huggingface.co/models?sort=trending");
await page.content(10000);
const data = await page.evaluate(`(() => {
const models = [];
document.querySelectorAll("article.overview-card-wrapper").forEach(el => {
const name = el.querySelector("h4")?.textContent?.trim();
const downloads = el.querySelector("[title*='downloads']")?.textContent?.trim();
const likes = el.querySelector("[title*='likes']")?.textContent?.trim();
const updated = el.querySelector("time")?.getAttribute("datetime");
if (name) models.push({ name, downloads, likes, updated });
});
return JSON.stringify({ total: models.length, models: models.slice(0, 15) });
})()`);
console.log(JSON.parse(data));
await spider.close(); ✓ ready to run | spider-browser | TypeScript
Data you can extract
Model nameDownloadsLikesTagsLibraryLicenseAuthorLast updated
Rendering
React SPA handling
Full browser rendering for streaming content and dynamic React UI.
Content
Structured parsing
Extract code blocks, documentation, repository data, and metadata.
Waiting
Load completion
Smart network idle detection waits for dynamically loaded content to finish.
More AI & Developer scrapers
chatgpt.com
ChatGPT Scraper
Extract shared ChatGPT conversations, prompts, and AI-generated content from public links.
github.com
GitHub Scraper
Extract trending repositories, star counts, contributor data, and code snippets from GitHub.
stackoverflow.com
Stack Overflow Scraper
Extract questions, answers, vote counts, and tag data from Stack Overflow.
Start scraping huggingface.co
Get your API key and start extracting data in minutes.