GPTCache
Redis for LLMs. Semantic cache for LLMs. Fully integrated with LangChain and llama_index. That's why we built GPTCache - a semantic cache for autoregressive LMs - atop the vector database Milvus and SQLite.
Open source
Reactions (1)
Similar products
by description similarity
Semcache
github.comI built a semantic cache in Rust
Cachet
github.comA drop-in semantic cache for LLM APIs, 100% local, in Rust
Agent-cache
news.ycombinator.comMulti-tier LLM/tool/session caching for Valkey and Redis
LLM
github.coma Rust Crate/CLI for CPU Inference of LLMs (LLaMA, GPT-NeoX, etc.)
An LLM response cache that's aware of dynamic data
blog.butter.devIn this blog post, we discuss how Butter automatically caches templates corresponding to the messages in LLM interactions.