We made our own inference engine for Apple Silicon
A high-performance inference engine for AI models. We wrote our inference engine on Rust, it is faster than llama cpp in all of the use cases.
Open source
Reactions (1)
Similar products
by description similarity
Spice.ai OSS 1.0
spiceai.orgdata query and AI-inference engine built in Rust
An educational Rust project for exporting and running inference on Qwen3 LLM family
Inferencer
inferencer.comRun and deeply control local AI models (macOS release)
Token Economics Calculator for AI inference hardware
tensordyne.aiWe build AI inference systems and chips on logarithmic math.
AnamDB
github.comAn AI-native, differentiable Datalog engine written in Rust