← 최신 프로덕트

The fastest way to run Mixtral 8x7B on Apple Silicon Macs

I’d originally launched my app: Private LLM[1][2] on HN around 10 months ago, with a single RedPajama Chat 3B model.

news.ycombinator.com 방문외부 사이트

반응 (1)

비슷한 프로덕트

설명이 비슷한 순

  1. Rapid-MLX

    github.com

    Run local LLMs on Mac, 2-3x faster than alternatives

    Hacker News9점

  2. Alpaca.cpp

    github.com

    Run an Instruction-Tuned Chat-Style LLM on a MacBook

    Hacker News673점

  3. I built an on-device LLM based chatbot for iPhones

    news.ycombinator.com

    I’ve been playing around with local LLMs for the past couple of months and decided to build something that can run on an iPhone.

    Hacker News20점

  4. Xybrid

    github.com

    run LLM and speech locally in your app (no back end, Rust)

    Hacker News6점

  5. We made glhf.chat

    glhf.chat

    run almost any open-source LLM, including 405B

    Hacker News161점