← Latest products

Semcache

I built a semantic cache in Rust. Semantic caching layer for your LLM applications. Reuse responses and reduce token usage. Have a look at my semantic caching project!

Open source

99 stars · GitHubexternal site

Visit github.comexternal site

Reactions (1)

Similar products

by description similarity

  1. Cachet

    github.com

    A drop-in semantic cache for LLM APIs, 100% local, in Rust

    Hacker News5 pts

  2. GPTCache

    github.com

    Redis for LLMs

    Hacker News7 pts

  3. Cachekit

    github.com

    High performance caching policies library in Rust

    Hacker News47 pts

  4. Offeryn

    github.com

    Build Tools for LLMs in Rust, with Model Context Protocol

    Hacker News7 pts

  5. An LLM response cache that's aware of dynamic data

    blog.butter.dev

    In this blog post, we discuss how Butter automatically caches templates corresponding to the messages in LLM interactions.

    Hacker News17 pts