← Latest products

Millwright

Rust-based, self-hosted LLM router. Self-hosted LLM router. Cost effective, deterministic, and fast. Secure and private by default. Ramp Router, Vercel’s AI Gateway), I saw the need for a self hosted solution focused on cost savings, transparency, and performance.

Self-hostedOpen source

46 stars · GitHubexternal site

Visit github.comexternal site

Reactions (1)

Similar products

by description similarity

  1. Foreman

    github.com

    a self-hosted LLM gateway for cost aware model routing

    Hacker News15 pts

  2. ClawRouter

    github.com

    Open-source LLM router that saves 78% on inference costs

    Hacker News12 pts

  3. liteLLM Proxy Server

    github.com

    50+ LLM Models, Error Handling, Caching

    Hacker News140 pts

  4. Arch-Router

    news.ycombinator.com

    1.5B model for LLM routing by preferences, not benchmarks

    Hacker News66 pts

  5. Torrix

    github.com

    self hosted, LLM Observability,(no Postgres, no Redis)

    Hacker News74 pts