USP Brasil Scraper
Spider read usp.br in 1.1 s without a browser and returned 1,668 lines of clean markdown, including sections like "Visualization", "Random Dot Stereogram" and "Creating a Random Dot Stereogram".
### > Visualization> The visualization of a stereogram requires an unusual skill:> each eye must be targeted to distinct places on the image. This> is unusual to our brains. That is the reason some people hardly(or can not) see stereograms.> There are two ways to visualize stereograms:> The target of each eye (left and right) is shown:|> regular visualization - no stereogram|> divergent visualization of a stereogram|> convergent visualization of a stereogram(cross)> Once one gets the divergent or convergent visualization, he/shehas a clear view of 3D surfaces.* > Transparent media (stereogram on a plastic film)* > Reference point between the eyes and stereogram (put apen in the half way from your eyes to the stereogram)## Random Dot Stereogram> Our brain is able to perceive the 3D information of the environment.> The main reason for that are small differences between each eye> image. Both images are captured with a small difference (the> distance between our eyes). This results in very small shifts on> each retina projection image, hard to notice. But althoughsmall, those differences give us the 3D sensation.### > Creating a Random Dot Stereogram> The easiest way to learn how a stereogram works is to create> one. Next, the recipe to generate a random dot stereogram> (adapted from Bela Julesz article). There is also a second> approach, based on "ASCII Stereogram". With the ASCII> Stereogram, it is easier to understand the disparity shifts. Youcan see both as stereograms, if you have skill enough.|**> Steps to generate a stereogram:> ABCDEFGHI> JKLMNOPQR> STUVWXYZ0> 123456789> 0ZYXWVUTS> RQPONMLKJIHGFEDCBA|> (b) Duplicate the image and put side byside> ABCDEFGHI ABCDEFGHI> JKLMNOPQR JKLMNOPQR> STUVWXYZ0 STUVWXYZ0> 123456789 123456789> 0ZYXWVUTS 0ZYXWVUTS> RQPONMLKJ RQPONMLKJIHGFEDCBA IHGFEDCBA> ABCDEFGHI ABCDEFGHI> JKLMNOPQR JKLMNOPQRSTU> UTS> RQPONMLKJ RQPONMLKJIHGFEDCBA IHGFEDCBAThe same call, in code.
The capture above came back as markdown. These examples add a key, so you get browser rendering, proxies, and concurrency on usp.br.
import { SpiderBrowser } from "spider-browser";
const spider = new SpiderBrowser({
apiKey: process.env.SPIDER_API_KEY!,
});
await spider.connect();
const page = spider.page!;
await page.goto("https://www.usp.br");
// No selectors, no schema. Spider reads the page and names the fields.
const data = await page.scrape();
console.log(data);
await spider.close();import { SpiderBrowser } from "spider-browser";
const spider = new SpiderBrowser({
apiKey: process.env.SPIDER_API_KEY!,
});
await spider.connect();
const page = spider.page!;
await page.goto("https://www.usp.br");
const data = await page.extractFields({
image: "img, .image",
links: "a[href^="/"], a[href^="/author/"], a[href^="/category/"], a[href^="/tag/"], a[href^="/post/"]",
main_content: "main > *",
});
console.log(data);
await spider.close();Ready for volume? Get an API key →
Fields you can pull.
Spider names these from the page. The capture above came back as markdown; the same
call with return_format: "json" returns them as keys.
What usp.br costs to scrape.
The capture above cost $0.000064 to fetch. Pricing is $1 per GB of pre-transformation bandwidth plus $0.001 per CPU minute, so a page like this one lands at a fraction of a cent. Failed requests are billed at $0.
- Free balance on signup
- No card required to test
- Balance never expires
Run it keyless, no account
More Education scrapers.
Coursera Scraper
Extract course listings, instructor data, ratings, and enrollment info from Coursera.
Udemy Scraper
Extract course listings, pricing, instructor reviews, and curriculum data from Udemy.
Amazon Books Scraper
Extract bestseller book data, ratings, pricing, and author info from Amazon Books.
Start scraping usp.br.
You already have the call. A key raises the rate limit and turns on browser rendering, proxies, and concurrency. Balance never expires, and top-ups go through secure checkout.