Butter
A Behavior Cache for LLMs. We built Butter, an LLM proxy that makes agent systems deterministic by caching and replaying responses, so automations behave consistently across runs.
Reactions (1)
Similar products
by description similarity
Butter
docs.butter.deva muscle memory cache for LLMs
An LLM response cache that's aware of dynamic data
blog.butter.devIn this blog post, we discuss how Butter automatically caches templates corresponding to the messages in LLM interactions.
BAML
github.comA new programming language to get structured data from LLMs
Mutahunter
mutahunter.aiFast, language agnostic, software testing using LLM agents
Wasp
wasp.shthe first full-stack framework powered by an LLM