← Latest products

Rapid-MLX

Run local LLMs on Mac, 2-3x faster than alternatives. Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server for Apple Silicon, built on MLX, focused on reliable tool calling for coding agents. Up to 4× faster than Apple's MLX (mlx-lm) on the same weights.

DesktopOpen source

4,089 stars · GitHubexternal site

Visit github.comexternal site

Reactions (1)

Similar products

by description similarity

  1. 50+ LLMs on 2 GPUs with 2-Second Swapping? We built AI-Native Runtime

    github.com

    InferX: Inference as a Service Platform

    Hacker News5 pts

  2. Sageling

    sageling.ai

    a local AI agent for Mac, Qwen 3.5 9B in-process via MLX

    Hacker News7 pts

  3. macOS GUI for running LLMs locally

    avapls.com

    I finally believe it's ready for its first release.

    Hacker News58 pts

  4. Run 500B+ Parameter LLMs Locally on a Mac Mini

    github.com

    By combining 1.58-bit ternary quantization, dynamic sparsity with Top-K pruning and MoE routing, and mmap-based layer streaming, OpenGraviton can run models far larger than your system RAM—even on a Mac Mini.

    Hacker News17 pts

  5. SwiftAI

    github.com

    open-source library to easily build LLM features on iOS/macOS

    Hacker News74 pts