← Latest products

Llmbridge

a C++ LLM gateway with sub-millisecond overhead. A sub-millisecond, drop-in OpenAI-compatible LLM gateway in C++.

Open source

8 stars · GitHubexternal site

Visit github.comexternal site

Reactions (1)

Similar products

by description similarity

  1. LLMRouter

    github.com

    first LLM routing library with 300 stars in 24h

    Hacker News5 pts

  2. ChainFactory

    github.com

    Run Structured LLM Inference with Easy Parallelism

    Hacker News8 pts

  3. I built an open-source AI data layer that connects any LLM to any data

    github.com

    Chat with your data - with memory, rules, and observability built in. Deploy in 2 minutes

    Hacker News18 pts

  4. Tiny-vLLM

    github.com

    high performance LLM inference engine in C++ and CUDA

    Hacker News205 pts

  5. I built a tool to quickly connect APIs to LLMs like OpenAI models

    interlify.com

    Hacker News5 pts