← Trending

Tangerine Index lists products launched since ChatGPT and people's reactions to them.

mlx-serve

github.com

Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with chat, music, voice, video generation.

DesktopOpen source

Visit github.comexternal siteGitHub2,404 starsexternal site

Reactions (1)

Similar products

by description similarity

  1. SwiftLM

    ⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.

    GitHub797 starsgithub.comMobileOpen sourcelatest reaction

  2. Rapid-MLX

    Run local LLMs on Mac, 2-3x faster than alternatives

    Hacker News9 ptsGitHub4,112 starsgithub.comDesktopOpen source2 reactionslatest reaction

  3. Apple MLX

    An array framework for machine learning on Apple silicon

    Product Hunt129 votespypi.orgLibrarylatest reaction

  4. swama

    High-performance MLX-based LLM inference engine for macOS with native Swift implementation

    GitHub593 starsgithub.comOpen sourcelatest reaction

  5. candle-vllm

    Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.

    GitHub739 starsgithub.comOpen sourcelatest reaction