← Latest products

Bodhi App

Run Open Source/Weights HuggingFace LLMs Locally. Run Open Source/Open Weight LLMs locally with OpenAI compatible APIs. While we currently support M2 Macs, we plan to support other platforms as our community grows.

Open source

139 stars · GitHubexternal site

Visit github.comexternal site

Reactions (1)

Similar products

by description similarity

  1. SwiftAI

    github.com

    open-source library to easily build LLM features on iOS/macOS

    Hacker News74 pts

  2. Ollama

    github.com

    Run LLMs on your Mac

    Hacker News284 pts

  3. BrowserAI

    github.com

    Run LLMs directly in browser using WebGPU (open source)

    Hacker News85 pts

  4. Run 500B+ Parameter LLMs Locally on a Mac Mini

    github.com

    By combining 1.58-bit ternary quantization, dynamic sparsity with Top-K pruning and MoE routing, and mmap-based layer streaming, OpenGraviton can run models far larger than your system RAM—even on a Mac Mini.

    Hacker News17 pts

  5. A tool to benchmark LLM APIs (OpenAI

    llmapitest.com

    Claude, local/self-hosted)

    Hacker News55 pts