Regulations.gov Scraper

Extract proposed regulations, public comments, docket summaries, and agency rulemaking from Regulations.gov. Built on spider-browser .

Get started Docs

target
regulations.gov: success rate
99.9%: latency
~4ms

Quick start

Extract data in minutes.

regulations-gov-scraper.ts

import { SpiderBrowser } from "spider-browser";

const spider = new SpiderBrowser({
  apiKey: process.env.SPIDER_API_KEY!,
  stealth: 2,
});

await spider.connect();
const page = spider.page!;
await page.goto("https://www.regulations.gov/search?documentTypes=Rule&sortBy=postedDate&sortDirection=desc");
await page.content(10000);

const data = await page.extractFields({
  title: ".document-card .title a",
  agency: ".document-card .agency",
  date: ".document-card .posted-date",
  type: ".document-card .document-type",
});

console.log(data);
await spider.close();

ready to run · spider-browser · TypeScript

Fetch API

One endpoint for regulations.gov.

Structured JSON from regulations.gov with a single POST. AI-resolved selectors, cached on the first call.

POST /fetch/regulations.gov/

Document titleAgencyDocket IDDocument typePosted dateComment count

Try it Fetch docs

cURL

curl -X POST https://api.spider.cloud/fetch/regulations.gov/ \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"return_format": "json"}'

Python

import requests

resp = requests.post(
    "https://api.spider.cloud/fetch/regulations.gov/",
    headers={
        "Authorization": "Bearer YOUR_API_KEY",
        "Content-Type": "application/json",
    },
    json={"return_format": "json"},
)
print(resp.json())

Node.js

const resp = await fetch("https://api.spider.cloud/fetch/regulations.gov/", {
  method: "POST",
  headers: {
    "Authorization": "Bearer YOUR_API_KEY",
    "Content-Type": "application/json",
  },
  body: JSON.stringify({ return_format: "json" }),
});
const data = await resp.json();
console.log(data);

Extraction

Fields you can pull.

Document titleAgencyDocket IDDocument typePosted dateComment countStatusAbstract

Data

Public records

Extract filings, regulations, and public data from regulations.gov.

Parsing

Document extraction

Clean extraction of legal documents, PDFs, and structured public records.

Scale

Bulk processing

Process thousands of filings and regulatory documents concurrently.

More Government & Legal scrapers.

sec.gov

SEC EDGAR Government Scraper

Extract SEC filings, company financial reports, insider trading data, and regulatory submissions from EDGAR.

uspto.gov

USPTO Scraper

Extract patent applications, trademark filings, examiner data, and prosecution history from USPTO.

congress.gov

Congress.gov Scraper

Extract bill text, voting records, committee reports, and legislative history from Congress.gov.

Start

Start scraping regulations.gov.

Grab an API key and call the endpoint above. The first request resolves the config; every request after hits cache.

Get started free All scrapers