← Trending

Tangerine Index lists products launched since ChatGPT and people's reactions to them.

kvcached

github.com

Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

Open source

Visit github.comexternal siteGitHub2,032 starsexternal site

Reactions (1)

Similar products

by description similarity

  1. Taliesin

    bit-exact KV-cache restore, 21x faster, cross-GPU verified

    medium.comlatest reaction

    Hacker News
    10 pts
    GitHub
    No reaction

  2. KVBoost

    chunk-level KV cache reuse for HuggingFace, 5–48x faster TTFT

    pythongiant.github.iolatest reaction

    Hacker News
    20 pts
    GitHub
    No reaction

  3. kvpress

    LLM KV cache compression made easy

    github.comOpen sourcelatest reaction

    Hacker News
    No reaction
    GitHub
    1,245 stars

  4. softgpu

    SW and HW accelerated GPU driver for Windows 9x Virtual Machines

    github.comOpen sourcelatest reaction

    Hacker News
    No reaction
    GitHub
    1,179 stars

  5. Eyot

    A programming language where the GPU is just another thread

    cowleyforniastudios.comlatest reaction

    Hacker News
    79 pts
    GitHub
    No reaction