Selfhostllm.org
Plan GPU capacity for self-hosting LLMs. Calculate GPU memory requirements and max concurrent requests for self-hosted LLM inference. Support for Llama, Qwen, DeepSeek, Mistral and more. Plan your AI infrastructure efficiently. A simple calculator that estimates how many concurrent requests your GPU can handle for a given LLM, with shareable results.
셀프 호스팅
반응 (1)
비슷한 프로덕트
설명이 비슷한 순
Can your GPU run this LLM?
github.comCalculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization
Open-source calculator for "will my GPU run this LLM?"
jaeseok614.github.ioLLMKube
github.comKubernetes for Local LLMs with GPU Acceleration
LLM Inference Calculator
llm-inference-calculator-delta.vercel.appEstimate VRAM, Latency, and Throughput
This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient LLM GPU selections and cost-effective AI models. LLM provider price comparison, gpu benchmarks to price per token calculation, gpu benchmark table