← 최신 프로덕트

Llmbridge

a C++ LLM gateway with sub-millisecond overhead. A sub-millisecond, drop-in OpenAI-compatible LLM gateway in C++.

오픈소스

8 스타 · GitHub외부 사이트

github.com 방문외부 사이트

반응 (1)

비슷한 프로덕트

설명이 비슷한 순

  1. LLMRouter

    github.com

    first LLM routing library with 300 stars in 24h

    Hacker News5점

  2. ChainFactory

    github.com

    Run Structured LLM Inference with Easy Parallelism

    Hacker News8점

  3. I built an open-source AI data layer that connects any LLM to any data

    github.com

    Chat with your data - with memory, rules, and observability built in. Deploy in 2 minutes

    Hacker News18점

  4. Tiny-vLLM

    github.com

    high performance LLM inference engine in C++ and CUDA

    Hacker News205점

  5. I built a tool to quickly connect APIs to LLMs like OpenAI models

    interlify.com

    Hacker News5점