← Latest products

SemHash

Fast Semantic Text Deduplication for Cleaner Datasets. Fast Multimodal Semantic Deduplication & Filtering. We’ve just open-sourced SemHash, a lightweight package for semantic text deduplication.

Open source

979 stars · GitHubexternal site

Visit github.comexternal site

Reactions (1)

Similar products

by description similarity

  1. Semlib

    github.com

    Semantic Data Processing

    Hacker News63 pts

  2. Semantic Grep

    github.com

    A Word2Vec-powered search tool

    Hacker News356 pts

  3. Biblos

    github.com

    Semantic Bible Embedded Vector Search and Claude LLM

    Hacker News136 pts

  4. Chonky

    github.com

    a neural approach for text semantic chunking

    Hacker News169 pts

  5. Chonky

    huggingface.co

    a neural text semantic chunking goes multilingual

    Hacker News43 pts