← 최신 프로덕트

GPTCache

Redis for LLMs. Semantic cache for LLMs. Fully integrated with LangChain and llama_index. That's why we built GPTCache - a semantic cache for autoregressive LMs - atop the vector database Milvus and SQLite.

오픈소스

8,219 스타 · GitHub외부 사이트

github.com 방문외부 사이트

반응 (1)

비슷한 프로덕트

설명이 비슷한 순

  1. Semcache

    github.com

    I built a semantic cache in Rust

    Hacker News5점

  2. Cachet

    github.com

    A drop-in semantic cache for LLM APIs, 100% local, in Rust

    Hacker News5점

  3. Agent-cache

    news.ycombinator.com

    Multi-tier LLM/tool/session caching for Valkey and Redis

    Hacker News18점

  4. LLM

    github.com

    a Rust Crate/CLI for CPU Inference of LLMs (LLaMA, GPT-NeoX, etc.)

    Hacker News45점

  5. An LLM response cache that's aware of dynamic data

    blog.butter.dev

    In this blog post, we discuss how Butter automatically caches templates corresponding to the messages in LLM interactions.

    Hacker News17점