Federal Register Scraper
Extract proposed rules, final rules, presidential documents, and agency notices from the Federal Register. Built on spider-browser .
- target
- federalregister.gov
- success rate
- 99.9%
- latency
- ~4ms
Extract data in minutes.
import { SpiderBrowser } from "spider-browser";
const spider = new SpiderBrowser({
apiKey: process.env.SPIDER_API_KEY!,
});
await spider.connect();
const page = spider.page!;
await page.goto("https://www.federalregister.gov/documents/search?conditions%5Btype%5D%5B%5D=RULE");
await page.content();
const data = await page.evaluate(`(() => {
const docs = [];
document.querySelectorAll(".document-wrapper").forEach(el => {
const title = el.querySelector("h5 a")?.textContent?.trim();
const agency = el.querySelector(".metadata .agency")?.textContent?.trim();
const date = el.querySelector(".metadata .date")?.textContent?.trim();
const type = el.querySelector(".metadata .type")?.textContent?.trim();
if (title) docs.push({ title, agency, date, type });
});
return JSON.stringify({ total: docs.length, docs: docs.slice(0, 10) });
})()`);
console.log(JSON.parse(data));
await spider.close(); One endpoint for federalregister.gov.
Structured JSON from federalregister.gov with a single POST. AI-resolved selectors, cached on the first call.
/fetch/federalregister.gov/ curl -X POST https://api.spider.cloud/fetch/federalregister.gov/ \
-H "Authorization: Bearer YOUR_API_KEY" \
-H "Content-Type: application/json" \
-d '{"return_format": "json"}' import requests
resp = requests.post(
"https://api.spider.cloud/fetch/federalregister.gov/",
headers={
"Authorization": "Bearer YOUR_API_KEY",
"Content-Type": "application/json",
},
json={"return_format": "json"},
)
print(resp.json()) const resp = await fetch("https://api.spider.cloud/fetch/federalregister.gov/", {
method: "POST",
headers: {
"Authorization": "Bearer YOUR_API_KEY",
"Content-Type": "application/json",
},
body: JSON.stringify({ return_format: "json" }),
});
const data = await resp.json();
console.log(data); Fields you can pull.
Public records
Extract filings, regulations, and public data from federalregister.gov.
Document extraction
Clean extraction of legal documents, PDFs, and structured public records.
Bulk processing
Process thousands of filings and regulatory documents concurrently.
More Government & Legal scrapers.
SEC EDGAR Government Scraper
Extract SEC filings, company financial reports, insider trading data, and regulatory submissions from EDGAR.
USPTO Scraper
Extract patent applications, trademark filings, examiner data, and prosecution history from USPTO.
Congress.gov Scraper
Extract bill text, voting records, committee reports, and legislative history from Congress.gov.
Start scraping federalregister.gov.
Grab an API key and call the endpoint above. The first request resolves the config; every request after hits cache.