Gemma 3 inference in pure C++ with Metal acceleration

비슷한 프로덕트

설명이 비슷한 순

1. We made our own inference engine for Apple Silicon

   github.com

   A high-performance inference engine for AI models

   HNHacker News186점

2. Tiny-vLLM

   github.com

   high performance LLM inference engine in C++ and CUDA

   HNHacker News205점

3. Kairo

   github.com

   Fail-closed LLM inference routing from RTX 5090 measurements

   HNHacker News5점

4. Llmbridge

   github.com

   a C++ LLM gateway with sub-millisecond overhead

   HNHacker News5점

5. An educational Local Qwen3 LLM Inference project written in Rust

   github.com

   An educational Rust project for exporting and running inference on Qwen3 LLM family

   HNHacker News15점