A tool to benchmark LLM APIs (OpenAI
Claude, local/self-hosted). llm api test - Compare and analyze AI model performance. I recently built a small open-source tool to benchmark different LLM API endpoints — including OpenAI, Claude, and self-hosted models (like llama.cpp).
Self-hosted
Reactions (1)
Similar products
by description similarity
This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient LLM GPU selections and cost-effective AI models. LLM provider price comparison, gpu benchmarks to price per token calculation, gpu benchmark table
LocalScore
localscore.aiLocal LLM Benchmark
LLM Playground
retool.comcompare results side by side
LLM
github.coma Rust Crate/CLI for CPU Inference of LLMs (LLaMA, GPT-NeoX, etc.)
Open Responses
news.ycombinator.comDrop-In OpenAI Responses API Alternative for Any LLM