← 최신 프로덕트

liteLLM Proxy Server

50+ LLM Models, Error Handling, Caching. The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]. TLDR: It has one API endpoint /chat/completions and standardizes input/output for 50+ LLM models + handles logging, error tracking, caching, streaming What can liteLLM proxy do?

라이브러리오픈소스

62,465 스타 · GitHub외부 사이트

github.com 방문외부 사이트

반응 (2)

비슷한 프로덕트

설명이 비슷한 순

  1. An open-source AI Gateway with integrated guardrails

    github.com

    A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.

    Hacker News37점

  2. GPT Router

    github.com

    Open-Source API Gateway for LLMs (OpenAI, Anthropic, etc.)

    Hacker News15점

  3. I built an open-source AI data layer that connects any LLM to any data

    github.com

    Chat with your data - with memory, rules, and observability built in. Deploy in 2 minutes

    Hacker News18점

  4. Reducing LLM input tokens by 70%

    adola.app

    Run GPT-OSS, Qwen, Llama, and DeepSeek through one OpenAI-compatible API with streaming and clear usage-based pricing.

    Hacker News56점

  5. A tool to benchmark LLM APIs (OpenAI

    llmapitest.com

    Claude, local/self-hosted)

    Hacker News55점