← Latest products

Pantry

Brew/Docker for LLMs. Actor based multi-llm registry + runner. Started this a few months ago because I wanted a better test runner for an entirely different LLM-based project, then got completely nerdsniped by making LLMs as easy as possible to hotswap into other projects.

Open source

20 stars · GitHubexternal site

Visit github.comexternal site

Reactions (1)

Similar products

by description similarity

  1. LLMOne

    github.com

    Deploy LLMs from bare metal to production in hours

    Hacker News5 pts

  2. LLM

    github.com

    a Rust Crate/CLI for CPU Inference of LLMs (LLaMA, GPT-NeoX, etc.)

    Hacker News45 pts

  3. Run LLMs in Docker for any language without prebuilding containers

    github.com

    I've been looking for a way to run LLMs safely without needing to approve every command.

    Hacker News26 pts

  4. Docker Model Runner Integrates vLLM for High-Throughput Inference

    github.com

    Docker Model Runner

    Hacker News18 pts

  5. Llmpm

    llmpm.co

    NPM for LLMs

    Hacker News6 pts