← 최신 프로덕트

Run an 80B Qwen in 4.3 GB of RAM on a Mac

and a 35B on an iPhone. Swiftlet is a Swift and Metal runtime that runs large Qwen Mixture-of-Experts models locally on Apple devices by streaming expert weights from storage, enabling 35B and 80B models to run with low RAM, including on iPhone.

오픈소스

665 스타 · GitHub외부 사이트

github.com 방문외부 사이트

반응 (1)

비슷한 프로덕트

설명이 비슷한 순

  1. Running 104GB Qwen3.8-Flash-Next on 48GB Mac with at ~12 tok/s

    github.com

    Run a 105 GB AI model on a Mac that can't hold it. Qwen3.8-Flash-Next 4-bit, streamed from SSD on 16–64 GB Apple Silicon Macs. Fully native Swift, MLX and Metal. Offline, no Python. CLI, Swift library, and Ollama/OpenAI/Anthropic APIs. Works with Claude Code and Codex.

    Hacker News240점

  2. Swift-Qwen3.8-27B

    huggingface.co

    -58.3% thinking, x1.95 speed, accuracy of xhigh

    Hacker News33점

  3. Open-source engine running Gemma 4 26B in 2 GB RAM on any M-series Mac

    github.com

    Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

    Hacker News919점

  4. Run Qwen3-Next-80B on 8GB GPU at 1tok/2s throughput

    github.com

    Hacker News123점

  5. SwiftAI

    github.com

    open-source library to easily build LLM features on iOS/macOS

    Hacker News74점