← 최신 프로덕트

We made our own inference engine for Apple Silicon

A high-performance inference engine for AI models. We wrote our inference engine on Rust, it is faster than llama cpp in all of the use cases.

오픈소스

3,146 스타 · GitHub외부 사이트

github.com 방문외부 사이트

반응 (1)

비슷한 프로덕트

설명이 비슷한 순

  1. Spice.ai OSS 1.0

    spiceai.org

    data query and AI-inference engine built in Rust

    Hacker News26점

  2. An educational Local Qwen3 LLM Inference project written in Rust

    github.com

    An educational Rust project for exporting and running inference on Qwen3 LLM family

    Hacker News15점

  3. Inferencer

    inferencer.com

    Run and deeply control local AI models (macOS release)

    Hacker News15점

  4. Token Economics Calculator for AI inference hardware

    tensordyne.ai

    We build AI inference systems and chips on logarithmic math.

    Hacker News13점

  5. AnamDB

    github.com

    An AI-native, differentiable Datalog engine written in Rust

    Hacker News11점