Open-source calculator for "will my GPU run this LLM?"

비슷한 프로덕트

설명이 비슷한 순

1. Can your GPU run this LLM?

   github.com

   Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization

   HNHacker News15점

2. I made a GPU VRAM calculator for transformer-based models

   vram.asmirnov.xyz

   HNHacker News135점

3. Selfhostllm.org

   selfhostllm.org

   Plan GPU capacity for self-hosting LLMs

   HNHacker News7점

4. LLM Inference Calculator

   llm-inference-calculator-delta.vercel.app

   Estimate VRAM, Latency, and Throughput

   HNHacker News6점

5. wc-GPU

   github.com

   The Unix util `wc` running on a GPU

   HNHacker News15점