← Trending

Tangerine Index lists products launched since ChatGPT and people's reactions to them.

gemma.cpp

github.com

lightweight, standalone C++ inference engine for Google's Gemma models.

Open source

Visit github.comexternal siteGitHub7,079 starsexternal site

Reactions (1)

Similar products

by description similarity

  1. Gemma 3 inference in pure C++ with Metal acceleration

    Pure C++23 LLM inference for Apple Silicon chips

    github.comDesktopOpen source2 reactionslatest reaction

    Hacker News
    6 pts
    GitHub
    23 stars

  2. We made our own inference engine for Apple Silicon

    A high-performance inference engine for AI models

    github.comOpen source2 reactionslatest reaction

    Hacker News
    186 pts
    GitHub
    3,236 stars

  3. Genie-TTS

    GPT-SoVITS ONNX Inference Engine & Model Converter

    github.comOpen sourcelatest reaction

    Hacker News
    No reaction
    GitHub
    1,840 stars

  4. cache-dit

    A PyTorch-native inference engine with cache, parallelism, quantization and cpu offload for 100+ DiTs.

    github.comOpen sourcelatest reaction

    Hacker News
    No reaction
    GitHub
    1,302 stars

  5. Pruna AI

    Inference Optimization Engine

    news.ycombinator.comlatest reaction

    Hacker News
    6 pts
    GitHub
    No reaction