Gemma 3 inference in pure C++ with Metal acceleration
Pure C++23 LLM inference for Apple Silicon chips.
DesktopOpen source
Reactions (1)
Similar products
by description similarity
A high-performance inference engine for AI models
Tiny-vLLM
github.comhigh performance LLM inference engine in C++ and CUDA
Kairo
github.comFail-closed LLM inference routing from RTX 5090 measurements
Llmbridge
github.coma C++ LLM gateway with sub-millisecond overhead
An educational Rust project for exporting and running inference on Qwen3 LLM family