← Latest products

Pipet

CLI tool for scraping and extracting data online, with pipes. Swiss-army tool for scraping and extracting data from online assets, made for hackers. I often find myself in situations where I need to extract some data from a website, either as one time thing or periodically (and then watch for changes).

CLIOpen source

4,772 stars · GitHubexternal site

Visit github.comexternal site

Reactions (1)

Similar products

by description similarity

  1. I built an open-source data copy tool called ingestr

    github.com

    ingestr is a CLI tool to copy data between any databases with a single command seamlessly.

    Hacker News156 pts

  2. I built an open-source data pipeline tool in Go

    github.com

    Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.

    Hacker News200 pts

  3. Open-Source Document Extraction Tool

    github.com

    Open-source spreadsheets platform for deep research and document processing

    Hacker News13 pts

  4. Free API to extract PDF data

    news.ycombinator.com

    Part of the processing pipeline is extracting data from PDFs as raw text or a raster image.

    Hacker News13 pts

  5. Pypipe

    github.com

    A Python command-line tool for pipeline processing

    Hacker News213 pts