Skip to main content gottem  — one API for every scraper.
Government & Legal
Verified

Federal Register Scraper

Extract proposed rules, final rules, presidential documents, and agency notices from the Federal Register. Built on spider-browser .

Get started Docs
target
federalregister.gov
success rate
99.9%
latency
~4ms
Quick start

Extract data in minutes.

federal-register-scraper.ts
import { SpiderBrowser } from "spider-browser";

const spider = new SpiderBrowser({
  apiKey: process.env.SPIDER_API_KEY!,
});

await spider.connect();
const page = spider.page!;
await page.goto("https://www.federalregister.gov/documents/search?conditions%5Btype%5D%5B%5D=RULE");
await page.content();

const data = await page.evaluate(`(() => {
  const docs = [];
  document.querySelectorAll(".document-wrapper").forEach(el => {
    const title = el.querySelector("h5 a")?.textContent?.trim();
    const agency = el.querySelector(".metadata .agency")?.textContent?.trim();
    const date = el.querySelector(".metadata .date")?.textContent?.trim();
    const type = el.querySelector(".metadata .type")?.textContent?.trim();
    if (title) docs.push({ title, agency, date, type });
  });
  return JSON.stringify({ total: docs.length, docs: docs.slice(0, 10) });
})()`);

console.log(JSON.parse(data));
await spider.close();
ready to run · spider-browser · TypeScript
Fetch API

One endpoint for federalregister.gov.

Structured JSON from federalregister.gov with a single POST. AI-resolved selectors, cached on the first call.

POST /fetch/federalregister.gov/
Document titleAgencyTypePublished dateCitationAbstract
cURL
curl -X POST https://api.spider.cloud/fetch/federalregister.gov/ \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"return_format": "json"}'
Python
import requests

resp = requests.post(
    "https://api.spider.cloud/fetch/federalregister.gov/",
    headers={
        "Authorization": "Bearer YOUR_API_KEY",
        "Content-Type": "application/json",
    },
    json={"return_format": "json"},
)
print(resp.json())
Node.js
const resp = await fetch("https://api.spider.cloud/fetch/federalregister.gov/", {
  method: "POST",
  headers: {
    "Authorization": "Bearer YOUR_API_KEY",
    "Content-Type": "application/json",
  },
  body: JSON.stringify({ return_format: "json" }),
});
const data = await resp.json();
console.log(data);
Extraction

Fields you can pull.

Document titleAgencyTypePublished dateCitationAbstractDocket numberComment deadline
Data

Public records

Extract filings, regulations, and public data from federalregister.gov.

Parsing

Document extraction

Clean extraction of legal documents, PDFs, and structured public records.

Scale

Bulk processing

Process thousands of filings and regulatory documents concurrently.

Related

More Government & Legal scrapers.

Start

Start scraping federalregister.gov.

Grab an API key and call the endpoint above. The first request resolves the config; every request after hits cache.