← 최신 프로덕트

Run 500B+ Parameter LLMs Locally on a Mac Mini

By combining 1.58-bit ternary quantization, dynamic sparsity with Top-K pruning and MoE routing, and mmap-based layer streaming, OpenGraviton can run models far larger than your system RAM—even on a Mac Mini.

오픈소스

56 스타 · GitHub외부 사이트

github.com 방문외부 사이트

반응 (1)

비슷한 프로덕트

설명이 비슷한 순

  1. OpenGraviton

    opengraviton.github.io

    Run 500B+ parameter models on a consumer Mac Mini

    Hacker News13점

  2. Ollama

    github.com

    Run LLMs on your Mac

    Hacker News284점

  3. 80% faster

    github.com

    50% less memory, 0% loss of accuracy Llama finetuning

    Hacker News385점

  4. KVSplit

    github.com

    Run 2-3x longer contexts on Apple Silicon

    Hacker News272점

  5. Bodhi App

    github.com

    Run Open Source/Weights HuggingFace LLMs Locally

    Hacker News21점