← 최신 프로덕트

Semcache

I built a semantic cache in Rust. Semantic caching layer for your LLM applications. Reuse responses and reduce token usage. Have a look at my semantic caching project!

오픈소스

99 스타 · GitHub외부 사이트

github.com 방문외부 사이트

반응 (1)

비슷한 프로덕트

설명이 비슷한 순

  1. Cachet

    github.com

    A drop-in semantic cache for LLM APIs, 100% local, in Rust

    Hacker News5점

  2. GPTCache

    github.com

    Redis for LLMs

    Hacker News7점

  3. Cachekit

    github.com

    High performance caching policies library in Rust

    Hacker News47점

  4. Offeryn

    github.com

    Build Tools for LLMs in Rust, with Model Context Protocol

    Hacker News7점

  5. An LLM response cache that's aware of dynamic data

    blog.butter.dev

    In this blog post, we discuss how Butter automatically caches templates corresponding to the messages in LLM interactions.

    Hacker News17점