Onyphe Scraper
Spider read onyphe.net in 171 ms without a browser and returned 29 lines of clean markdown, including the section "Frequently asked questions".
## Frequently asked questions.We are conducting Internet-scale network scanning to provide information for cyber defense purposes. We scan the full IPv4 address space and part of IPv6 address space just like Shodan, Censys, LeakIX or ShadowServer are doing. We are in no way targeting you specifically, you are just part of what is connected on the Internet.We are in the Attack Surface Discovery (ASD), Attack Surface Management (ASM) & Cyber Threat Intelligence (CTI) markets. Our intent is to allow our customers to have the most complete view possible on their Internet facing assets. Our purpose is to identify initial access vectors before bad guys so our customers can fix their vulnerabilities before it is too late.* ### How ethical are you at such activities?We know Internet scanning activities may not be very-well perceived. That's why we want to bring together all actors to create a set of rules, or commandments, to do such in the most ethical way possible. Find out more in our write-up Our 10 Commandments for Ethical Internet Scanning. You may also be interested by a keynote given by our CEO at CTI Summit 2022.* ### What is the list of your scanners IP addresses?Here is the complete list of our scanners network ranges:* 91.196.152.0/24, 91.231.89.0/24, 195.184.76.0/24, 91.230.168.0/24, 94.231.206.0/24, 2a14:f100::/29, 2001:41d0:33a:a00::400/124, 2001:41d0:33d:9200::400/124, 51.254.49.96/28Alternatively, you can download the list in text format:You can do so in different ways. You could send us an email at [abuse[at]onyphe{dot}io](mailto:abuse[at]onyphe{dot}io) giving us your list of network blocks to be excluded from scanning. You could also block all our probes at your network perimeter, here is the list of our scanning network ranges:* ### What kind of probing are you actually doing?The same call, in code.
The capture above came back as markdown. These examples add a key, so you get browser rendering, proxies, and concurrency on onyphe.net.
import { SpiderBrowser } from "spider-browser";
const spider = new SpiderBrowser({
apiKey: process.env.SPIDER_API_KEY!,
});
await spider.connect();
const page = spider.page!;
await page.goto("https://onyphe.net");
// No selectors, no schema. Spider reads the page and names the fields.
const data = await page.scrape();
console.log(data);
await spider.close();import { Spider } from "@spider-cloud/spider-client";
const spider = new Spider({ apiKey: process.env.SPIDER_API_KEY! });
const result = await spider.scrapeUrl("https://www.onyphe.net", {
return_format: "markdown",
});
console.log(result);Ready for volume? Get an API key →
Fields you can pull.
Spider names these from the page. The capture above came back as markdown; the same
call with return_format: "json" returns them as keys.
What onyphe.net costs to scrape.
The capture above cost $0.000038 to fetch. Pricing is $1 per GB of pre-transformation bandwidth plus $0.001 per CPU minute, so a page like this one lands at a fraction of a cent. Failed requests are billed at $0.
- Free balance on signup
- No card required to test
- Balance never expires
Run it keyless, no account
More Directories scrapers.
Spotify Main Page Scraper
Extract structured data from Spotify Main Page with automated CSS selectors.
Roblox Landing Page Scraper
Roblox landing page metadata and cookie banner information.
Mozilla Homepage Data Scraper
A scraper for extracting all useful data from the Mozilla homepage, including site metadata, navigation, and content.
Start scraping onyphe.net.
You already have the call. A key raises the rate limit and turns on browser rendering, proxies, and concurrency. Balance never expires, and top-ups go through secure checkout.