Brilliant Scraper
Spider read brilliant.org in 116 ms without a browser and returned 144 lines of clean markdown, including sections like "A world-class", "Built to make you think" and "Designed to keep".
# A world-classEvery session is visual and interactive. Instead of just memorizing, you play with concepts until they click. And you work through problems step-by-step, building your intuition along the way.### Built to make you *think*Like the best human tutors, Koji asks the right questions, provides visual guidance, and gets to the heart of where you’re getting stuck. It’s the difference between getting the answer and actually understanding it.### Adapts to exactly where you areKoji tracks what you’ve mastered and where you’re stuck, then builds practice around the gaps. He speeds up when you’re ready, and slows down when you need it.### Designed to keepBrilliant is designed to feel like a challenge, not a chore. Streaks, levels, and daily goals motivate you to build on your progress and keep moving forward.## From grade 5 to college and beyond### Covered subjects### Always on yourSay goodbye to trial-and-error hiring, driving across town, and fitting another thing into your schedule. Koji is there Sunday night before the test, Saturday morning for fun, and the quiet 20 minutes before dinner.### Built by top learningOur curriculum is crafted by award-winning teachers, subject-matter experts, and learning designers from top institutions.## Students, parents, andI wasn’t getting the slope unit in class, but it finally clicked after 20 minutes talking to Koji!I didn’t expect him to learn this fast. He explained how to write algorithms at dinner tonight.I learned the basics of Trigonometry in 12 days, I just got into a flow. I’m best in my class now.She’ll get stuck on a problem and then yell, ‘Never mind, Mom, I got it!’ How great is that?They enthusiastically do it outside of class. I had 8th graders say, ‘This makes me want to do more math!’## The best tutor you’ll ever haveDecomposition and AbstractionDo not sell my personal informationThe same call, in code.
The capture above came back as markdown. These examples add a key, so you get browser rendering, proxies, and concurrency on brilliant.org.
import { SpiderBrowser } from "spider-browser";
const spider = new SpiderBrowser({
apiKey: process.env.SPIDER_API_KEY!,
});
await spider.connect();
const page = spider.page!;
await page.goto("https://brilliant.org/courses/");
// No selectors, no schema. Spider reads the page and names the fields.
const data = await page.scrape();
console.log(data);
await spider.close();import { SpiderBrowser } from "spider-browser";
const spider = new SpiderBrowser({
apiKey: process.env.SPIDER_API_KEY!,
});
await spider.connect();
const page = spider.page!;
await page.goto("https://brilliant.org/courses/");
await page.content(10000);
const data = await page.evaluate(`(() => {
const courses = [];
document.querySelectorAll(".course-card").forEach(el => {
const title = el.querySelector(".course-card-title")?.textContent?.trim();
const subject = el.querySelector(".course-card-subject")?.textContent?.trim();
const description = el.querySelector(".course-card-description")?.textContent?.trim();
const lessons = el.querySelector(".lesson-count")?.textContent?.trim();
if (title) courses.push({ title, subject, description, lessons });
});
return JSON.stringify({ total: courses.length, courses: courses.slice(0, 15) });
})()`);
console.log(JSON.parse(data));
await spider.close();Ready for volume? Get an API key →
Fields you can pull.
Spider names these from the page. The capture above came back as markdown; the same
call with return_format: "json" returns them as keys.
What brilliant.org costs to scrape.
The capture above cost $0.000341 to fetch. Pricing is $1 per GB of pre-transformation bandwidth plus $0.001 per CPU minute, so a page like this one lands at a fraction of a cent. Failed requests are billed at $0.
- Free balance on signup
- No card required to test
- Balance never expires
Run it keyless, no account
More Education scrapers.
Coursera Scraper
Extract course listings, instructor data, ratings, and enrollment info from Coursera.
Udemy Scraper
Extract course listings, pricing, instructor reviews, and curriculum data from Udemy.
Amazon Books Scraper
Extract bestseller book data, ratings, pricing, and author info from Amazon Books.
Start scraping brilliant.org.
You already have the call. A key raises the rate limit and turns on browser rendering, proxies, and concurrency. Balance never expires, and top-ups go through secure checkout.