← Trending

Tangerine Index lists products launched since ChatGPT and people's reactions to them.

rwkv.cpp

github.com

INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model

Open source

Visit github.comexternal siteGitHub1,590 starsexternal site

Reactions (1)

Similar products

by description similarity

  1. gemma.cpp

    lightweight, standalone C++ inference engine for Google's Gemma models.

    github.comOpen sourcelatest reaction

    Hacker News
    No reaction
    GitHub
    7,079 stars

  2. Genie-TTS

    GPT-SoVITS ONNX Inference Engine & Model Converter

    github.comOpen sourcelatest reaction

    Hacker News
    No reaction
    GitHub
    1,840 stars

  3. T-MAC

    Low-bit LLM inference on CPU/NPU with lookup table

    github.comOpen sourcelatest reaction

    Hacker News
    No reaction
    GitHub
    1,005 stars

  4. cache-dit

    A PyTorch-native inference engine with cache, parallelism, quantization and cpu offload for 100+ DiTs.

    github.comOpen sourcelatest reaction

    Hacker News
    No reaction
    GitHub
    1,302 stars

  5. Gemma 3 inference in pure C++ with Metal acceleration

    Pure C++23 LLM inference for Apple Silicon chips

    github.comDesktopOpen source2 reactionslatest reaction

    Hacker News
    6 pts
    GitHub
    23 stars