← Latest products

The fastest way to run Mixtral 8x7B on Apple Silicon Macs

I’d originally launched my app: Private LLM[1][2] on HN around 10 months ago, with a single RedPajama Chat 3B model.

Visit news.ycombinator.comexternal site

Reactions (1)

Similar products

by description similarity

  1. Rapid-MLX

    github.com

    Run local LLMs on Mac, 2-3x faster than alternatives

    Hacker News9 pts

  2. Alpaca.cpp

    github.com

    Run an Instruction-Tuned Chat-Style LLM on a MacBook

    Hacker News673 pts

  3. I built an on-device LLM based chatbot for iPhones

    news.ycombinator.com

    I’ve been playing around with local LLMs for the past couple of months and decided to build something that can run on an iPhone.

    Hacker News20 pts

  4. Xybrid

    github.com

    run LLM and speech locally in your app (no back end, Rust)

    Hacker News6 pts

  5. We made glhf.chat

    glhf.chat

    run almost any open-source LLM, including 405B

    Hacker News161 pts