← Trending

Tangerine Index lists products launched since ChatGPT and people's reactions to them.

basalt

github.com

Local inference engine for Qwen3.8-Flash-Next on NVIDIA Blackwell

Open source

Visit github.comexternal siteGitHub774 starsexternal site

Reactions (1)

Similar products

by description similarity

  1. exllamav2

    A fast inference library for running LLMs locally on modern consumer-class GPUs

    GitHub4,652 starsgithub.comLibraryOpen sourcelatest reaction

  2. nixl

    NVIDIA Inference Xfer Library (NIXL)

    GitHub1,360 starsgithub.comLibraryOpen sourcelatest reaction

  3. exllamav3

    An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs

    GitHub1,802 starsgithub.comLibraryOpen sourcelatest reaction

  4. airllm

    AirLLM 2.8T LLM inference with single 4GB GPU

    GitHub41,958 starsgithub.comOpen sourcelatest reaction

  5. cache-dit

    A PyTorch-native inference engine with cache, parallelism, quantization and cpu offload for 100+ DiTs.

    GitHub1,303 starsgithub.comOpen sourcelatest reaction