← 최신 프로덕트

Millwright

Rust-based, self-hosted LLM router. Self-hosted LLM router. Cost effective, deterministic, and fast. Secure and private by default. Ramp Router, Vercel’s AI Gateway), I saw the need for a self hosted solution focused on cost savings, transparency, and performance.

셀프 호스팅오픈소스

46 스타 · GitHub외부 사이트

github.com 방문외부 사이트

반응 (1)

비슷한 프로덕트

설명이 비슷한 순

  1. Foreman

    github.com

    a self-hosted LLM gateway for cost aware model routing

    Hacker News15점

  2. ClawRouter

    github.com

    Open-source LLM router that saves 78% on inference costs

    Hacker News12점

  3. liteLLM Proxy Server

    github.com

    50+ LLM Models, Error Handling, Caching

    Hacker News140점

  4. Arch-Router

    news.ycombinator.com

    1.5B model for LLM routing by preferences, not benchmarks

    Hacker News66점

  5. Torrix

    github.com

    self hosted, LLM Observability,(no Postgres, no Redis)

    Hacker News74점