Llmswap
Python package to reduce LLM API costs by 50-90% with caching. I built llmswap to solve a problem I kept hitting in hackathons - burning through API credits while testing the same prompts repeatedly during development.
반응 (1)
비슷한 프로덕트
설명이 비슷한 순
MonkeyPatch
github.comCheap, fast and predictable LLM functions in Python
We're building a caching solution for LLMs (ChatGPT, Claude).
If agent's tools are exposed as functions/objects in a Python REPL (as opposed to JSON schemas) they perform better, I linked the explainer article we wrote, but if you want to jump straight in check out the docs!
A tool to benchmark LLM APIs (OpenAI
llmapitest.comClaude, local/self-hosted)
An unmetered LLM API–$6/month
yolo-auto.comno token tracking, no limits