← Latest products

RunNburn

Run a 295B Moe from a 98GB GGUF on a 64GB RAM Desktop. Memory-aware GGUF inference runtime with OpenAI-compatible serving. runNburn is an Apache-2.0 Rust inference engine for quantized GGUF models that are too big for your fast memory.

Open source

28 stars · GitHubexternal site

Visit github.comexternal site

Reactions (1)

Similar products

by description similarity

  1. Shimmy

    github.com

    5MB privacy-first, local alternative to Ollama (680MB)

    Hacker News14 pts

  2. Cuts Long Horizon Inference Costs by 50% via external KV Cache Offload

    github.com

    OpenLake is a high performance storage engine for efficient LLM inference and GPU Training

    Hacker News22 pts

  3. OpenGraviton

    opengraviton.github.io

    Run 500B+ parameter models on a consumer Mac Mini

    Hacker News13 pts

  4. Getting GLM 5.2 running on my slow computer

    github.com

    Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

    Hacker News937 pts

  5. Warp

    github.com

    Run DeepSeek v4.1 Flash with 5 GB of RAM at 3.77 tok/s

    Hacker News16 pts