← 최신 프로덕트

Rapid-MLX

Run local LLMs on Mac, 2-3x faster than alternatives. Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server for Apple Silicon, built on MLX, focused on reliable tool calling for coding agents. Up to 4× faster than Apple's MLX (mlx-lm) on the same weights.

데스크톱오픈소스

4,089 스타 · GitHub외부 사이트

github.com 방문외부 사이트

반응 (1)

비슷한 프로덕트

설명이 비슷한 순

  1. 50+ LLMs on 2 GPUs with 2-Second Swapping? We built AI-Native Runtime

    github.com

    InferX: Inference as a Service Platform

    Hacker News5점

  2. Sageling

    sageling.ai

    a local AI agent for Mac, Qwen 3.5 9B in-process via MLX

    Hacker News7점

  3. macOS GUI for running LLMs locally

    avapls.com

    I finally believe it's ready for its first release.

    Hacker News58점

  4. Run 500B+ Parameter LLMs Locally on a Mac Mini

    github.com

    By combining 1.58-bit ternary quantization, dynamic sparsity with Top-K pruning and MoE routing, and mmap-based layer streaming, OpenGraviton can run models far larger than your system RAM—even on a Mac Mini.

    Hacker News17점

  5. SwiftAI

    github.com

    open-source library to easily build LLM features on iOS/macOS

    Hacker News74점