← Trending

Tangerine Index lists products launched since ChatGPT and people's reactions to them.

pegainfer

github.com

Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

Open source

Visit github.comexternal siteGitHub738 starsexternal site

Reactions (1)

Similar products

by description similarity

  1. FlashQwen

    A from-scratch CUDA inference engine for Qwen3

    Hacker News5 ptsgithub.comOpen sourcelatest reaction

  2. An educational Local Qwen3 LLM Inference project written in Rust

    An educational Rust project for exporting and running inference on Qwen3 LLM family

    Hacker News15 ptsGitHub44 starsgithub.comOpen source2 reactionslatest reaction

  3. OpenArc

    Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS, Embedding and Rerank models over OpenAI endpoints.

    Hacker News17 ptsGitHub547 starsgithub.comOpen source2 reactionslatest reaction

  4. Genie-TTS

    GPT-SoVITS ONNX Inference Engine & Model Converter

    GitHub1,843 starsgithub.comOpen sourcelatest reaction

  5. We made our own inference engine for Apple Silicon

    A high-performance inference engine for AI models

    Hacker News186 ptsGitHub3,246 starsgithub.comOpen source2 reactionslatest reaction