FreightWaves Scraper

Extract freight market analytics, trucking spot rates, supply chain news, and carrier performance benchmarks from FreightWaves. Built on spider-browser .

Get started Docs

target
freightwaves.com: success rate
99.9%: latency
~4ms

Quick start

Extract data in minutes.

freightwaves-scraper.ts

import { SpiderBrowser } from "spider-browser";

const spider = new SpiderBrowser({
  apiKey: process.env.SPIDER_API_KEY!,
});

await spider.connect();
const page = spider.page!;
await page.goto("https://www.freightwaves.com/news");
await page.content();

const data = await page.evaluate(`(() => {
  const articles = [];
  document.querySelectorAll(".post-card, article.entry").forEach(el => {
    const title = el.querySelector("h2 a, .entry-title a")?.textContent?.trim();
    const author = el.querySelector(".author-name, .entry-author")?.textContent?.trim();
    const date = el.querySelector(".post-date, .entry-date")?.textContent?.trim();
    const summary = el.querySelector("p, .excerpt")?.textContent?.trim();
    const link = el.querySelector("h2 a, .entry-title a")?.href;
    if (title) articles.push({ title, author, date, summary, link });
  });
  return JSON.stringify({ total: articles.length, articles: articles.slice(0, 15) });
})()`);

console.log(JSON.parse(data));
await spider.close();

ready to run · spider-browser · TypeScript

Fetch API

One endpoint for freightwaves.com.

Structured JSON from freightwaves.com with a single POST. AI-resolved selectors, cached on the first call.

POST /fetch/freightwaves.com/

Article titleSpot rateLaneMarket trendAuthorCategory

Try it Fetch docs

cURL

curl -X POST https://api.spider.cloud/fetch/freightwaves.com/ \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"return_format": "json"}'

Python

import requests

resp = requests.post(
    "https://api.spider.cloud/fetch/freightwaves.com/",
    headers={
        "Authorization": "Bearer YOUR_API_KEY",
        "Content-Type": "application/json",
    },
    json={"return_format": "json"},
)
print(resp.json())

Node.js

const resp = await fetch("https://api.spider.cloud/fetch/freightwaves.com/", {
  method: "POST",
  headers: {
    "Authorization": "Bearer YOUR_API_KEY",
    "Content-Type": "application/json",
  },
  body: JSON.stringify({ return_format: "json" }),
});
const data = await resp.json();
console.log(data);

Extraction

Fields you can pull.

Article titleSpot rateLaneMarket trendAuthorCategoryPublished dateIndex value

Data

Tracking extraction

Extract shipment status, delivery estimates, and tracking details from freightwaves.com.

Rendering

Dynamic tracking

Handle real-time tracking maps and status update interfaces.

Scale

Bulk tracking

Process thousands of tracking numbers and shipment records concurrently.

More Logistics & Shipping scrapers.

ups.com

UPS Scraper

Extract package tracking statuses, delivery estimates, service rate comparisons, and drop-off location data from UPS.

fedex.com

FedEx Scraper

Extract shipment tracking details, transit timelines, rate quotes, and service center locations from FedEx.

usps.com

USPS Scraper

Extract mail tracking updates, postage rate calculators, ZIP code lookups, and post office location details from USPS.

Start

Start scraping freightwaves.com.

Grab an API key and call the endpoint above. The first request resolves the config; every request after hits cache.

Get started free All scrapers