← Latest products

Self hosting a modern LLM stack

Selfhost modern LLM stacks. Run the whole fleet from your terminal.

CLISelf-hostedOpen source

104 stars · GitHubexternal site

Visit github.comexternal site

Reactions (1)

Similar products

by description similarity

  1. Run LLMs in Docker for any language without prebuilding containers

    github.com

    I've been looking for a way to run LLMs safely without needing to approve every command.

    Hacker News26 pts

  2. Millwright

    github.com

    Rust-based, self-hosted LLM router

    Hacker News15 pts

  3. Pantry

    github.com

    Brew/Docker for LLMs

    Hacker News5 pts

  4. LLMOne

    github.com

    Deploy LLMs from bare metal to production in hours

    Hacker News5 pts

  5. Running LLMs in one line of Python without Docker

    lepton.ai

    We're Yangqing, Xiang and JJ from lepton.ai.

    Hacker News68 pts