← Latest products

Samosa Chat

Run Qwen3.6-35B-A3B Locally on a 16 GB Mac. Run large models like Qwen3.6-35B-A3B locally on a 16 GB RAM machine.

Open source

55 stars · GitHubexternal site

Visit github.comexternal site

Reactions (1)

Similar products

by description similarity

  1. Running 104GB Qwen3.8-Flash-Next on 48GB Mac with at ~12 tok/s

    github.com

    Run a 105 GB AI model on a Mac that can't hold it. Qwen3.8-Flash-Next 4-bit, streamed from SSD on 16–64 GB Apple Silicon Macs. Fully native Swift, MLX and Metal. Offline, no Python. CLI, Swift library, and Ollama/OpenAI/Anthropic APIs. Works with Claude Code and Codex.

    Hacker News240 pts

  2. Run an 80B Qwen in 4.3 GB of RAM on a Mac, and a 35B on an iPhone

    github.com

    Swiftlet is a Swift and Metal runtime that runs large Qwen Mixture-of-Experts models locally on Apple devices by streaming expert weights from storage, enabling 35B and 80B models to run with low RAM, including on iPhone.

    Hacker News312 pts

  3. Run Qwen3-Next-80B on 8GB GPU at 1tok/2s throughput

    github.com

    Hacker News123 pts

  4. I fine-tuned Qwen 3.5 (0.8B–4B) on a Mac for text-to-SQL

    github.com

    2B beats 12B

    Hacker News7 pts

  5. Qwen 3.5 running on a $300 Android phone

    github.com

    on-device, open source

    Hacker News124 pts