← 최신 프로덕트

Llmbuffer

Python library for cache-optimized LLM conversation history. LLM conversation buffer with cache optimization and dynamic context. I was not getting good cache utilization when including dynamic context in agent threads.

라이브러리오픈소스

4 스타 · GitHub외부 사이트

github.com 방문외부 사이트

반응 (1)

비슷한 프로덕트

설명이 비슷한 순

  1. Reduce ChatGPT costs 10x with distributed cache for LLMs

    edgematic.dev

    We're building a caching solution for LLMs (ChatGPT, Claude).

    Hacker News22점

  2. An LLM response cache that's aware of dynamic data

    blog.butter.dev

    In this blog post, we discuss how Butter automatically caches templates corresponding to the messages in LLM interactions.

    Hacker News17점

  3. I made a state machine framework for guided conversations with LLMs

    github.com

    GoalChain for goal-orientated LLM conversation flows

    Hacker News19점

  4. GPTCache

    github.com

    Redis for LLMs

    Hacker News7점

  5. Cachet

    github.com

    A drop-in semantic cache for LLM APIs, 100% local, in Rust

    Hacker News5점