← 최신 프로덕트

GPT Router

Open-Source API Gateway for LLMs (OpenAI, Anthropic, etc.). Smoothly Manage Multiple LLMs (OpenAI, Anthropic, Azure) and Image Models (Dall-E, SDXL), Speed Up Responses, and Ensure Non-Stop Reliability. Universal API for 30+ LLMs, Vision and Image Models Smart Fallbacks based on latency and uptime Automatic Retries Supports streaming Since embracing OpenAI GPT-3 in production in 2020, we at Writesonic have been serving millions of users and faced the typical scaling pains with generative AI models:.

오픈소스

454 스타 · GitHub외부 사이트

github.com 방문외부 사이트

반응 (1)

비슷한 프로덕트

설명이 비슷한 순

  1. I built an OSS alternative to Azure OpenAI services

    github.com

    🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports OpenAI, Azure OpenAI, Anthropic, vLLM, and open-source LLMs.

    Hacker News200점

  2. Reducing LLM input tokens by 70%

    adola.app

    Run GPT-OSS, Qwen, Llama, and DeepSeek through one OpenAI-compatible API with streaming and clear usage-based pricing.

    Hacker News56점

  3. A fully open-source (Apache 2.0)implementation of llama

    github.com

    Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

    Hacker News158점

  4. AnyLM

    anylm.app

    ChatGPT-Like UI for Local LLMs

    Hacker News13점

  5. Ollama

    github.com

    Run LLMs on your Mac

    Hacker News284점