← Latest products

Capy-flash

a 125B MoE model on two 16 GB consumer GPUs. Qwen3.8-Flash-Next (MoE) and Qwen3.8-27B on one or two 16 GB RTX 50-series GPUs: experts offloaded to CPU, two-GPU tensor parallel. 64 GB of RAM is enough for Flash-Next. Formerly ninfer-tp2.

Open source

129 stars · GitHubexternal site

Visit github.comexternal site

Reactions (1)

Similar products

by description similarity

  1. Qwen3.8-Flash-Next

    qwen.ai

    The open-weight preview of Qwen4

    Product Hunt317 votes

  2. Running 104GB Qwen3.8-Flash-Next on 48GB Mac with at ~12 tok/s

    github.com

    Run a 105 GB AI model on a Mac that can't hold it. Qwen3.8-Flash-Next 4-bit, streamed from SSD on 16–64 GB Apple Silicon Macs. Fully native Swift, MLX and Metal. Offline, no Python. CLI, Swift library, and Ollama/OpenAI/Anthropic APIs. Works with Claude Code and Codex.

    Hacker News240 pts

  3. MiMo-V2-Flash

    mimo.xiaomi.com

    Ultra-fast 309B MoE model for coding & agents

    Product Hunt241 votes

  4. Run Qwen3-Next-80B on 8GB GPU at 1tok/2s throughput

    github.com

    Hacker News123 pts

  5. Warp

    github.com

    Run DeepSeek v4.1 Flash with 5 GB of RAM at 3.77 tok/s

    Hacker News16 pts