← Trending

Tangerine Index lists products launched since ChatGPT and people's reactions to them.

GPTQModel

github.com

LLM model quantization (compression) toolkit with HW acceleration support for Nvidia (CUDA), AMD (ROCm), Intel GPU (XPU), Huawei Ascent (NPU), and Intel/AMD/Apple CPU via HF, vLLM, and SGLang.

Open source

Visit github.comexternal siteGitHub1,289 starsexternal site

Install and connect

From the official MCP Registry, Homebrew, npm, PyPI, and crates.io. Matched by repository or domain once a day.

Reactions (1)

Similar products

by description similarity

  1. Can your GPU run this LLM?

    Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization

    Hacker News15 ptsGitHub1,403 starsgithub.comOpen source2 reactionslatest reaction

  2. exllamav3

    An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs

    GitHub1,805 starsgithub.comLibraryOpen sourcelatest reaction

  3. LLMKube

    Kubernetes for Local LLMs with GPU Acceleration

    Hacker News5 ptsGitHub253 starsgithub.comSelf-hostedOpen source2 reactionslatest reaction

  4. Minimal LLM Post-Training Experiments on an 8GB GPU (SFT, DPO, GRPO)

    Minimal, readable LLM post-training experiments on one 8GB GPU. Measures forgetting, seed variance, and RL emergence.

    Hacker News21 ptsGitHub32 starsgithub.comOpen source2 reactionslatest reaction

  5. hai-platform

    一种任务级GPU算力分时调度的高性能深度学习训练平台

    GitHub764 starsgithub.comOpen sourcelatest reaction