← Trending

Tangerine Index lists products launched since ChatGPT and people's reactions to them.

Revibing nanochat's inference model in C++ with ggml

github.com

nanochat's inference engine re-vibed in C++ with GGML.

Open source

Visit github.comexternal siteGitHub2 starsexternal site

In the makers' words

Recently I wanted to see if I could vibe some serious C++ code.

Reactions (2)

Similar products

by description similarity

  1. minigpt4.cpp

    Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML)

    Hacker News102 ptsGitHub571 starsgithub.comOpen source2 reactionslatest reaction

  2. Tiny-vLLM

    high performance LLM inference engine in C++ and CUDA

    Hacker News205 ptsGitHub1,185 starsgithub.comOpen source2 reactionslatest reaction

  3. CrispASR

    C++ ggml runtime hub for multilingual ASR and TTS models: Cohere Transcribe, Parakeet TDT, Voxtral, Canary 1B v2, etc, plus universal forced alignment, and more

    GitHub804 starsgithub.comOpen sourcelatest reaction

  4. gemma.cpp

    lightweight, standalone C++ inference engine for Google's Gemma models.

    Hacker News422 ptsGitHub7,081 starsgithub.comOpen source2 reactionslatest reaction

  5. Gemma 3 inference in pure C++ with Metal acceleration

    Pure C++23 LLM inference for Apple Silicon chips

    Hacker News6 ptsGitHub23 starsgithub.comDesktopOpen source3 reactionslatest reaction