← Latest products

Trying to fix the web scraping industry's benchmark problem

Compare web access APIs (web unblockers / scrape APIs) head-to-head against a fixed suite of ~90 real-world, hard-to-scrape URLs. We've been trying to evaluate web scraping companies, but when you look at their benchmarks, you can't verify anything, and they mostly exist to prove the company is successful.

Open source

30 stars · GitHubexternal site

Visit github.comexternal site

Reactions (1)

Similar products

by description similarity

  1. I made a Chrome extension that can scrape any website with one click

    easyscraper.com

    The easiest web scraper you'll ever use. Easy Scraper is a Chrome extension that can scrape any website with one click. No coding required.

    Hacker News31 pts

  2. Scrappy

    github.com

    Open-source browser scraper written in Go

    Hacker News10 pts

  3. I'm making an AI scraper called FetchFox

    fetchfoxai.com

    I'm Marcell, and I'm working on FetchFox ( https://fetchfoxai.com ).

    Hacker News105 pts

  4. I built an SDK that scrambles HTML so scrapers get garbage

    obscrd.dev

    Built this because I got tired of AI crawlers reading my HTML in plain text while robots.txt did nothing.

    Hacker News16 pts

  5. APIRank.dev

    apirank.dev

    We crawled and ranked public APIs from the internet

    Hacker News176 pts