A tool to benchmark LLM APIs (OpenAI
Claude, local/self-hosted). I recently built a small open-source tool to benchmark different LLM API endpoints — including OpenAI, Claude, and self-hosted models (like llama.cpp).
셀프 호스팅
반응 (1)
비슷한 프로덕트
설명이 비슷한 순
LocalScore
localscore.aiLocal LLM Benchmark
This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient LLM GPU selections and cost-effective AI models. LLM provider price comparison, gpu benchmarks to price per token calculation, gpu benchmark table
LLM
github.coma Rust Crate/CLI for CPU Inference of LLMs (LLaMA, GPT-NeoX, etc.)
Open Responses
news.ycombinator.comDrop-In OpenAI Responses API Alternative for Any LLM
For Any LLM