CockroachCrawler–1 package for crawling,browsers,PDF,extraction,and MCP
Give AI agents bounded eyes on the public web: crawl, search, and normalize evidence without an unrestricted browser.
Open source
Reactions (1)
Similar products
by description similarity
Obscura
github.comV8-powered headless browser for scraping and AI agents
Robots.txt generator for blocking AI crawlers
aisearchwatch.comA browser designed for agent
An experimental AntiBot
github.comAntiCrawl reverse proxy for the web
Jevcrawl
github.comA web crawler for AI agents with no LLM in the crawl loop