Can your GPU run this LLM?
Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization.
Open source
Reactions (1)
Similar products
by description similarity
This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient LLM GPU selections and cost-effective AI models. LLM provider price comparison, gpu benchmarks to price per token calculation, gpu benchmark table
High-efficiency LLM inference engine in C++/CUDA. Run Llama 70B on RTX 3090.
Can I run this LLM? (locally)
can-i-run-this-llm-blue.vercel.appOne of the most frequent questions one faces while running LLMs locally is: I have xx RAM and yy GPU, Can I run zz LLM model ?
80% faster
github.com50% less memory, 0% loss of accuracy Llama finetuning
Simple UI for LLM Model Finetuning