← 최신 프로덕트

An LLM response cache that's aware of dynamic data

In this blog post, we discuss how Butter automatically caches templates corresponding to the messages in LLM interactions. Raymond here from Butter.dev, an LLM response cache built as a chat-completions proxy.

blog.butter.dev 방문외부 사이트

반응 (1)

비슷한 프로덕트

설명이 비슷한 순

  1. Butter

    docs.butter.dev

    a muscle memory cache for LLMs

    Hacker News23점

  2. Butter

    butter.dev

    A Behavior Cache for LLMs

    Hacker News50점

  3. Reduce ChatGPT costs 10x with distributed cache for LLMs

    edgematic.dev

    We're building a caching solution for LLMs (ChatGPT, Claude).

    Hacker News22점

  4. A lightweight LLM proxy to get structured results from most LLMs

    l1m.io

    After struggling with complex prompt engineering and unreliable parsing, we built L1M, a simple API that lets you extract structured data from unstructured text and images.

    Hacker News13점

  5. CasCache

    github.com

    multi-generational cache with optimistic concurrency control

    Hacker News20점