← 최신 프로덕트

Pantry

Brew/Docker for LLMs. Actor based multi-llm registry + runner. Started this a few months ago because I wanted a better test runner for an entirely different LLM-based project, then got completely nerdsniped by making LLMs as easy as possible to hotswap into other projects.

오픈소스

20 스타 · GitHub외부 사이트

github.com 방문외부 사이트

반응 (1)

비슷한 프로덕트

설명이 비슷한 순

  1. LLMOne

    github.com

    Deploy LLMs from bare metal to production in hours

    Hacker News5점

  2. LLM

    github.com

    a Rust Crate/CLI for CPU Inference of LLMs (LLaMA, GPT-NeoX, etc.)

    Hacker News45점

  3. Run LLMs in Docker for any language without prebuilding containers

    github.com

    I've been looking for a way to run LLMs safely without needing to approve every command.

    Hacker News26점

  4. Docker Model Runner Integrates vLLM for High-Throughput Inference

    github.com

    Docker Model Runner

    Hacker News18점

  5. Llmpm

    llmpm.co

    NPM for LLMs

    Hacker News6점