← Trending

Tangerine Index lists products launched since ChatGPT and people's reactions to them.

kvpress

github.com

LLM KV cache compression made easy

Open source

Visit github.comexternal siteGitHub1,245 starsexternal site

Reactions (1)

Similar products

by description similarity

  1. KVBoost

    chunk-level KV cache reuse for HuggingFace, 5–48x faster TTFT

    pythongiant.github.iolatest reaction

    Hacker News
    20 pts
    GitHub
    No reaction

  2. Cachegrand

    a fast Redis-compatible KV-store, v0.2.1 released

    cachegrand.iolatest reaction

    Hacker News
    12 pts
    GitHub
    No reaction

  3. FlyDB

    The high-performance kv storage engine based on bitcask paper made in golang

    github.comOpen sourcelatest reaction

    Hacker News
    No reaction
    GitHub
    1,221 stars

  4. Taliesin

    bit-exact KV-cache restore, 21x faster, cross-GPU verified

    medium.comlatest reaction

    Hacker News
    10 pts
    GitHub
    No reaction

  5. We Beat MLPerf

    Modern Storage for KV Offload and LLM Training

    theopenlake.comlatest reaction

    Hacker News
    35 pts
    GitHub
    No reaction