← Latest products

Run an 80B Qwen in 4.3 GB of RAM on a Mac

and a 35B on an iPhone. Swiftlet is a Swift and Metal runtime that runs large Qwen Mixture-of-Experts models locally on Apple devices by streaming expert weights from storage, enabling 35B and 80B models to run with low RAM, including on iPhone.

Open source

665 stars · GitHubexternal site

Visit github.comexternal site

Reactions (1)

Similar products

by description similarity

  1. Running 104GB Qwen3.8-Flash-Next on 48GB Mac with at ~12 tok/s

    github.com

    Run a 105 GB AI model on a Mac that can't hold it. Qwen3.8-Flash-Next 4-bit, streamed from SSD on 16–64 GB Apple Silicon Macs. Fully native Swift, MLX and Metal. Offline, no Python. CLI, Swift library, and Ollama/OpenAI/Anthropic APIs. Works with Claude Code and Codex.

    Hacker News240 pts

  2. Swift-Qwen3.8-27B

    huggingface.co

    -58.3% thinking, x1.95 speed, accuracy of xhigh

    Hacker News33 pts

  3. Open-source engine running Gemma 4 26B in 2 GB RAM on any M-series Mac

    github.com

    Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

    Hacker News919 pts

  4. Run Qwen3-Next-80B on 8GB GPU at 1tok/2s throughput

    github.com

    Hacker News123 pts

  5. SwiftAI

    github.com

    open-source library to easily build LLM features on iOS/macOS

    Hacker News74 pts