Federal Register Scraper
Spider read federalregister.gov in 127 ms without a browser and returned 141 lines of clean markdown.
This site displays a prototype of a “Web 2.0” version of the daily*Note: Documents older than 1994 are not searchable but can be found by FR citation.*Regulation for Federal Financial AssistanceNational Wildlife Refuge System; Request for Information on Implementation of Drain Tile SetbacksMedicaid Program; Community Engagement Requirement for Certain IndividualsEndangered and Threatened Wildlife and Plants; Grizzly Bear Listing on the List of Endangered and Threatened Wildlife With a Revised Section 4(d) Rule; Proposed Revision of the Protective Regulations Under Section 4(d)Organization, Functions, and Procedures; Public Notice and Comment for Standards, Criteria, and Guidance Applicable to Forest Service ProgramsExcepted Fertility BenefitsRevision of Regulations for Grazing Administration, Exclusive of AlaskaMedicare and Medicaid Programs; CY 2027 Payment Policies Under the Physician Fee Schedule and Other Changes to Part B Payment and Coverage Policies; Medicare Shared Savings Program Requirements; and Medicare Prescription Drug Inflation Rebate ProgramEstablishing the President's Military Spouse CommissionContinuation of the National Emergency With Respect to the Advancement by Countries of Concern in Sensitive Technologies and Products Critical for the Military, Intelligence, Surveillance, or Cyber-Enabled Capabilities of Such CountriesTo Facilitate Positive Adjustment to Competition From Imports of Quartz Surface ProductsReader Aids help people use FederalRegister.gov and understand the federal rulemaking process. Reader Aids information is not published in the *Federal Register*.Increase your understanding of the Federal Register eco-system andimprove your FederalRegister.gov skills with these helpful, unofficialeducational articles and videos. See more of our reader aidsRead Office of the Federal Register Announcements* Understanding Public Inspection* Commenting on Federal Register DocumentsThe same call, in code.
The capture above came back as markdown. These examples add a key, so you get browser rendering, proxies, and concurrency on federalregister.gov.
import { SpiderBrowser } from "spider-browser";
const spider = new SpiderBrowser({
apiKey: process.env.SPIDER_API_KEY!,
});
await spider.connect();
const page = spider.page!;
await page.goto("https://www.federalregister.gov/documents/search?conditions%5Btype%5D%5B%5D=RULE");
// No selectors, no schema. Spider reads the page and names the fields.
const data = await page.scrape();
console.log(data);
await spider.close();import { SpiderBrowser } from "spider-browser";
const spider = new SpiderBrowser({
apiKey: process.env.SPIDER_API_KEY!,
});
await spider.connect();
const page = spider.page!;
await page.goto("https://www.federalregister.gov/documents/search?conditions%5Btype%5D%5B%5D=RULE");
await page.content();
const data = await page.evaluate(`(() => {
const docs = [];
document.querySelectorAll(".document-wrapper").forEach(el => {
const title = el.querySelector("h5 a")?.textContent?.trim();
const agency = el.querySelector(".metadata .agency")?.textContent?.trim();
const date = el.querySelector(".metadata .date")?.textContent?.trim();
const type = el.querySelector(".metadata .type")?.textContent?.trim();
if (title) docs.push({ title, agency, date, type });
});
return JSON.stringify({ total: docs.length, docs: docs.slice(0, 10) });
})()`);
console.log(JSON.parse(data));
await spider.close();Ready for volume? Get an API key →
Fields you can pull.
Spider names these from the page. The capture above came back as markdown; the same
call with return_format: "json" returns them as keys.
What federalregister.gov costs to scrape.
The capture above cost $0.000095 to fetch. Pricing is $1 per GB of pre-transformation bandwidth plus $0.001 per CPU minute, so a page like this one lands at a fraction of a cent. Failed requests are billed at $0.
- Free balance on signup
- No card required to test
- Balance never expires
Run it keyless, no account
More Government & Legal scrapers.
SEC EDGAR Government Scraper
Extract SEC filings, company financial reports, insider trading data, and regulatory submissions from EDGAR.
USPTO Scraper
Extract patent applications, trademark filings, examiner data, and prosecution history from USPTO.
Congress.gov Scraper
Extract bill text, voting records, committee reports, and legislative history from Congress.gov.
Start scraping federalregister.gov.
You already have the call. A key raises the rate limit and turns on browser rendering, proxies, and concurrency. Balance never expires, and top-ups go through secure checkout.