← Latest products

Kairo

Fail-closed LLM inference routing from RTX 5090 measurements.

Open source

1 stars · GitHubexternal site

Visit github.comexternal site

Reactions (1)

Similar products

by description similarity

  1. ChainFactory

    github.com

    Run Structured LLM Inference with Easy Parallelism

    Hacker News8 pts

  2. LLMRouter

    github.com

    first LLM routing library with 300 stars in 24h

    Hacker News5 pts

  3. Open-source AMDGCN kernels for optimizing LLM inference

    github.com

    Hacker News5 pts

  4. Llmbridge

    github.com

    a C++ LLM gateway with sub-millisecond overhead

    Hacker News5 pts

  5. Gemma 3 inference in pure C++ with Metal acceleration

    github.com

    Pure C++23 LLM inference for Apple Silicon chips

    Hacker News6 pts