← 최신 프로덕트

RunNburn

Run a 295B Moe from a 98GB GGUF on a 64GB RAM Desktop. Memory-aware GGUF inference runtime with OpenAI-compatible serving. runNburn is an Apache-2.0 Rust inference engine for quantized GGUF models that are too big for your fast memory.

오픈소스

28 스타 · GitHub외부 사이트

github.com 방문외부 사이트

반응 (1)

비슷한 프로덕트

설명이 비슷한 순

  1. Shimmy

    github.com

    5MB privacy-first, local alternative to Ollama (680MB)

    Hacker News14점

  2. Cuts Long Horizon Inference Costs by 50% via external KV Cache Offload

    github.com

    OpenLake is a high performance storage engine for efficient LLM inference and GPU Training

    Hacker News22점

  3. OpenGraviton

    opengraviton.github.io

    Run 500B+ parameter models on a consumer Mac Mini

    Hacker News13점

  4. Getting GLM 5.2 running on my slow computer

    github.com

    Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

    Hacker News937점

  5. Warp

    github.com

    Run DeepSeek v4.1 Flash with 5 GB of RAM at 3.77 tok/s

    Hacker News16점