← 최신 프로덕트

LLM-Gateway

Zero-Trust LLM Gateway. Zero trust LLM gateway. OpenAI-compatible proxy with semantic routing and load balancing across OpenAI, Anthropic, Ollama, vLLM, and any compatible backend. Identity-based access, virtual API keys, and end-to-end encryption via OpenZiti. I built an OpenAI-compatible LLM gateway that routes requests to OpenAI, Anthropic, Ollama, vLLM, llama-server, SGLang...

셀프 호스팅오픈소스

103 스타 · GitHub외부 사이트

github.com 방문외부 사이트

반응 (1)

비슷한 프로덕트

설명이 비슷한 순

  1. Alternative Open-Source Openrouter

    llmgateway.io

    Open-source LLM API gateway: route requests to 250+ models from 40+ providers, including OpenAI, Anthropic and Google, through one OpenAI-compatible API.

    Hacker News5점

  2. I built a backend so simple that it fits in a YAML file

    manifest.build

    Open Source LLM Gateway 🦚

    Hacker News102점

  3. GPT Router

    github.com

    Open-Source API Gateway for LLMs (OpenAI, Anthropic, etc.)

    Hacker News15점

  4. Turn your Google accounts into a free

    github.com

    load-balanced LLM API gateway

    Hacker News7점

  5. LiteLLM -Open-Source Library for Anthropic,Azure,OpenAI

    litellm.ai

    etc. API Calls

    Hacker News5점