← Latest products

Alpaca.cpp

Run an Instruction-Tuned Chat-Style LLM on a MacBook. Locally run an Instruction-Tuned Chat-Style LLM.

Open source

10,103 stars · GitHubexternal site

Visit github.comexternal site

Reactions (1)

Similar products

by description similarity

  1. Minute

    github.com

    Offline meeting notes on macOS with Whisper and llama.cpp

    Hacker News12 pts

  2. STT –> LLM –> TTS pipeline in C

    github.com

    Pure C wrapper library to use llama.cpp with Linux and Windows as simple as possible.

    Hacker News11 pts

  3. Local LLM Notepad

    github.com

    run a GPT-style model from a USB stick

    Hacker News40 pts

  4. IncarnaMind-Chat with your multiple docs using LLMs

    github.com

    From messy files to a checked report. A free, open-source desktop app for macOS, Windows and Linux: write and analyse with AI from your own files, check each sentence and figure against them, and export to Word. Meeting notes too. Works with ChatGPT, Claude, Gemini or a local model through Ollama.

    Hacker News57 pts

  5. The fastest way to run Mixtral 8x7B on Apple Silicon Macs

    news.ycombinator.com

    I’d originally launched my app: Private LLM[1][2] on HN around 10 months ago, with a single RedPajama Chat 3B model.

    Hacker News18 pts