← Latest products

Cachet

A drop-in semantic cache for LLM APIs, 100% local, in Rust. A transparent, 100%-local semantic cache for LLM APIs — drop-in proxy, one line to integrate, written in Rust.

Open source

3 stars · GitHubexternal site

Visit github.comexternal site

Reactions (1)

Similar products

by description similarity

  1. Semcache

    github.com

    I built a semantic cache in Rust

    Hacker News5 pts

  2. Cachekit

    github.com

    High performance caching policies library in Rust

    Hacker News47 pts

  3. GPTCache

    github.com

    Redis for LLMs

    Hacker News7 pts

  4. LLM

    github.com

    a Rust Crate/CLI for CPU Inference of LLMs (LLaMA, GPT-NeoX, etc.)

    Hacker News45 pts

  5. Offeryn

    github.com

    Build Tools for LLMs in Rust, with Model Context Protocol

    Hacker News7 pts