Podcast Index Scraper
Spider read podcastindex.org in 116 ms in a headless browser and returned 49 lines of clean markdown, including sections like "Promise", "Operations" and "Financing".
# The Podcast Index is here to preserve, protect and extend the open, independent podcasting ecosystem.We do this by enabling developers to have access to an open, categorized index that will always be available for free, for any use.Try a new podcast app today and see how much better the experience can be.from: tägliche Frauenandacht (Russisch)### PromiseThe core, categorized index will always be available for free, for any use.### OperationsPodcast Index LLC is a software developer focused partnership that provides tools and data to anyone who aspires to create new and exciting Podcast experiences without the heavy lifting of indexing, aggregation and data management.### FinancingThe core Podcast Index is financed by its founders and stakeholders: Podcasters, Developers and Listeners.Corporate interests and advertising are antithetical to our business.Podcast Index LLC strives to grow by providing enhanced API services of value to developers and organizations.### Mission and GoalPreserve, protect and extend the open, independent podcasting ecosystem.Re-tool podcasting to a platform of value exchange that includes developers with podcasters and listeners.### Developer? Join the fun!**API Documentation** is online here.**Download the full podcast index** as a sqlite3 file. Query the entire database on your desktop using DB Browser for SQLite or similar. The file is produced Saturdays at 22:00 UTC (and uploaded a few hours later).**We build in the open.** Get active in the Github repos.**We have a Mastodon server for collaboration.** Join it here: Podcastindex.social**Follow us** on X - @podcastindexorg or our Mastodon server.**Shoot us an email** at: info@podcastindex.org### Help us out...**None of this is free.** If you get any value from this project, or if you just believe in it and want to help us out with hosting fees and paying the bills, a donation of any amount would be great.#### Paypal- Open podcastindex.org in a real browser
- Wait for the page to finish rendering
- Collect the repeated result blocks
.player-carousel-item
The same call, in code.
The capture above came back as markdown. These examples add a key, so you get browser rendering, proxies, and concurrency on podcastindex.org.
import { SpiderBrowser } from "spider-browser";
const spider = new SpiderBrowser({
apiKey: process.env.SPIDER_API_KEY!,
stealth: 2,
});
await spider.connect();
const page = spider.page!;
await page.goto("https://podcastindex.org/");
// Wait for the page to finish rendering
await page.waitForSelector(".player-carousel-item");
// No selectors, no schema. Spider reads the page and names the fields.
const data = await page.scrape();
console.log(data);
await spider.close();import { SpiderBrowser } from "spider-browser";
const spider = new SpiderBrowser({
apiKey: process.env.SPIDER_API_KEY!,
});
await spider.connect();
const page = spider.page!;
await page.goto("https://podcastindex.org/podcast/920666");
await page.content();
const data = await page.extractFields({
title: ".podcast-title",
author: ".podcast-author",
description: ".podcast-description",
categories: ".podcast-categories",
episodeCount: ".podcast-episode-count",
image: { selector: ".podcast-artwork img", attribute: "src" },
});
console.log(data);
await spider.close();Ready for volume? Get an API key →
Fields you can pull.
Spider names these from the page. The capture above came back as markdown; the same
call with return_format: "json" returns them as keys.
What podcastindex.org costs to scrape.
The capture above cost $0.000195 to fetch. Pricing is $1 per GB of pre-transformation bandwidth plus $0.001 per CPU minute, so a page like this one lands at a fraction of a cent. Failed requests are billed at $0.
- Free balance on signup
- No card required to test
- Balance never expires
Run it keyless, no account
More Music & Podcasts scrapers.
Spotify Music Scraper
Extract playlist tracks, artist profiles, album metadata, and popularity scores from Spotify open web player.
Apple Music Scraper
Extract album tracklists, artist discographies, playlist contents, and editorial notes from Apple Music catalog.
Deezer Scraper
Extract music catalogs, playlist data, artist bios, and chart rankings from Deezer streaming platform.
Start scraping podcastindex.org.
You already have the call. A key raises the rate limit and turns on browser rendering, proxies, and concurrency. Balance never expires, and top-ups go through secure checkout.