Publicradio Scraper
Spider read publicradio.org in 1.6 s without a browser and returned 47 lines of clean markdown.
Recommended Gershwin RecordingsBy MPR Music Librarian Rex LevangThis discography is provided as an accompaniment to the feature: Who Could Ask for Anything More?: A Hundred Years of George Gershwin. Many of these recordings are available from the Public Radio MusicSource .The Broadway Shows | Gershwin by Gershwin**THE FIRST MUSICIAN TO RECORD** Gershwin's music was Gershwin himself: In 1916, the 18-year-old George made a piano roll of his song, "When You Want 'Em, You Can't Get 'Em, When You've Got 'Em, You Don't Want 'Em."Since then, Gershwin recordings have issued forth steadily, performed by everyone from Otto Klemperer to *Seinfeld'*s Jason Alexander. What follows is a highly selective list of basic recordings, with a leaning toward Gershwin's classical output - plus a few extras.**Concert Hall Works: Rhapsody in Blue; Concerto in F; An American in Paris**These are the three works on which Gershwin's fame in the concert hall rests. The classic name here is Leonard Bernstein, with his characteristic energy and spontaneity. These performances have been issued many times, e.g.: on Sony 63086.Bernstein didn't record the concerto, though, so for all three pieces on one disc (plus the *I Got Rhythm Variations*), go for another great advocate of Gershwin, Earl Wild (RCA 6519.)The *Rhapsody in Blue* is a special case. It was always known that the standard version for symphony orchestra had been preceded by an arrangement for Paul Whiteman's jazz band. But it wasn't till the 1970s that musicians started researching what that original version might have sounded like, and bringing it to life in performances.Which one is the "true" Gershwin? Well, both. But the jazz version, with its snappy tempos and saxes instead of violins, makes the old Rhapsody sound like a whole new piece. You can even get this version with Gershwin as the piano soloist, thanks to some technical hocus-pocus with piano rolls (with Michael Tilson Thomas; CBS 42240.)The same call, in code.
The capture above came back as markdown. These examples add a key, so you get browser rendering, proxies, and concurrency on publicradio.org.
import { SpiderBrowser } from "spider-browser";
const spider = new SpiderBrowser({
apiKey: process.env.SPIDER_API_KEY!,
});
await spider.connect();
const page = spider.page!;
await page.goto("https://publicradio.org");
// No selectors, no schema. Spider reads the page and names the fields.
const data = await page.scrape();
console.log(data);
await spider.close();import { Spider } from "@spider-cloud/spider-client";
const spider = new Spider({ apiKey: process.env.SPIDER_API_KEY! });
const result = await spider.scrapeUrl("https://www.publicradio.org", {
return_format: "markdown",
});
console.log(result);Ready for volume? Get an API key →
Fields you can pull.
Spider names these from the page. The capture above came back as markdown; the same
call with return_format: "json" returns them as keys.
What publicradio.org costs to scrape.
The capture above cost $0.000037 to fetch. Pricing is $1 per GB of pre-transformation bandwidth plus $0.001 per CPU minute, so a page like this one lands at a fraction of a cent. Failed requests are billed at $0.
- Free balance on signup
- No card required to test
- Balance never expires
Run it keyless, no account
More Music scrapers.
Start scraping publicradio.org.
You already have the call. A key raises the rate limit and turns on browser rendering, proxies, and concurrency. Balance never expires, and top-ups go through secure checkout.