← Latest products

GPT Router

Open-Source API Gateway for LLMs (OpenAI, Anthropic, etc.). Smoothly Manage Multiple LLMs (OpenAI, Anthropic, Azure) and Image Models (Dall-E, SDXL), Speed Up Responses, and Ensure Non-Stop Reliability. Universal API for 30+ LLMs, Vision and Image Models Smart Fallbacks based on latency and uptime Automatic Retries Supports streaming Since embracing OpenAI GPT-3 in production in 2020, we at Writesonic have been serving millions of users and faced the typical scaling pains with generative AI models:.

Open source

454 stars · GitHubexternal site

Visit github.comexternal site

Reactions (1)

Similar products

by description similarity

  1. I built an OSS alternative to Azure OpenAI services

    github.com

    🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports OpenAI, Azure OpenAI, Anthropic, vLLM, and open-source LLMs.

    Hacker News200 pts

  2. Reducing LLM input tokens by 70%

    adola.app

    Run GPT-OSS, Qwen, Llama, and DeepSeek through one OpenAI-compatible API with streaming and clear usage-based pricing.

    Hacker News56 pts

  3. A fully open-source (Apache 2.0)implementation of llama

    github.com

    Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

    Hacker News158 pts

  4. AnyLM

    anylm.app

    ChatGPT-Like UI for Local LLMs

    Hacker News13 pts

  5. Ollama

    github.com

    Run LLMs on your Mac

    Hacker News284 pts