Can I run this LLM? (locally)
One of the most frequent questions one faces while running LLMs locally is: I have xx RAM and yy GPU, Can I run zz LLM model ?
반응 (1)
비슷한 프로덕트
설명이 비슷한 순
Can your GPU run this LLM?
github.comCalculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization
Lemonade
github.comRun LLMs Locally with GPU and NPU Acceleration
BrowserAI
github.comRun LLMs directly in browser using WebGPU (open source)
LocalScore
localscore.aiLocal LLM Benchmark
ranked by benchmarks