Open-source calculator for "will my GPU run this LLM?"
Reactions (1)
Similar products
by description similarity
Can your GPU run this LLM?
github.comCalculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization
I made a GPU VRAM calculator for transformer-based models
vram.asmirnov.xyzSelfhostllm.org
selfhostllm.orgPlan GPU capacity for self-hosting LLMs
LLM Inference Calculator
llm-inference-calculator-delta.vercel.appEstimate VRAM, Latency, and Throughput
wc-GPU
github.comThe Unix util `wc` running on a GPU