Tangerine Index lists products launched since ChatGPT and people's reactions to them.
club-3090
github.com
Community recipes for serving LLMs on RTX 3090/4090/5090 CUDA gpus. Multi-engine (vLLM, sglang, llama.cpp and other custom engines) and model-agnostic. Currently shipping Qwen3.8-27B Qwen3.6 35B Gemma 4 26B Gemma 4 31B configs for 1×/2×/4x/8x cards.
Open source
Reactions (1)
Similar products
by description similarity
Llama 3.1 70B on a single RTX 3090 via NVMe-to-GPU bypassing the CPU
High-efficiency LLM inference engine in C++/CUDA. Run Llama 70B on RTX 3090.
LLMKube
Kubernetes for Local LLMs with GPU Acceleration
Can your GPU run this LLM?
Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization
GPTQModel
LLM model quantization (compression) toolkit with HW acceleration support for Nvidia (CUDA), AMD (ROCm), Intel GPU (XPU), Huawei Ascent (NPU), and Intel/AMD/Apple CPU via HF, vLLM, and SGLang.
OS Megakernel that match M5 Max Tok/w at 2x the Throughput on RTX 3090
LLM speculative inference server for heterogeneous hardware & consumer GPUs
