← Latest products

LLM-Gateway

Zero-Trust LLM Gateway. Zero trust LLM gateway. OpenAI-compatible proxy with semantic routing and load balancing across OpenAI, Anthropic, Ollama, vLLM, and any compatible backend. Identity-based access, virtual API keys, and end-to-end encryption via OpenZiti. I built an OpenAI-compatible LLM gateway that routes requests to OpenAI, Anthropic, Ollama, vLLM, llama-server, SGLang...

Self-hostedOpen source

102 stars · GitHubexternal site

Visit github.comexternal site

Reactions (1)

Similar products

by description similarity

  1. Alternative Open-Source Openrouter

    llmgateway.io

    Open-source LLM API gateway: route requests to 250+ models from 40+ providers, including OpenAI, Anthropic and Google, through one OpenAI-compatible API.

    Hacker News5 pts

  2. I built a backend so simple that it fits in a YAML file

    manifest.build

    Open Source LLM Gateway 🦚

    Hacker News102 pts

  3. GPT Router

    github.com

    Open-Source API Gateway for LLMs (OpenAI, Anthropic, etc.)

    Hacker News15 pts

  4. Turn your Google accounts into a free

    github.com

    load-balanced LLM API gateway

    Hacker News7 pts

  5. LiteLLM -Open-Source Library for Anthropic,Azure,OpenAI

    litellm.ai

    etc. API Calls

    Hacker News5 pts