← Trending

Tangerine Index lists products launched since ChatGPT and people's reactions to them.

guidellm

github.com

Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs

Open source

Visit github.comexternal siteGitHub1,760 starsexternal site

Reactions (1)

Similar products

by description similarity

  1. vllm

    A high-throughput and memory-efficient inference and serving engine for LLMs

    github.comOpen sourcelatest reaction

    GitHub
    96,511 stars

  2. optillm

    Optimizing inference proxy for LLMs

    github.comOpen sourcelatest reaction

    GitHub
    4,338 stars

  3. sonar

    Large-scale LLM inference engine

    github.comOpen sourcelatest reaction

    GitHub
    1,905 stars

  4. rtp-llm

    RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

    github.comOpen sourcelatest reaction

    GitHub
    1,394 stars

  5. web-llm

    High-performance In-browser LLM Inference Engine

    github.comOpen sourcelatest reaction

    GitHub
    19,361 stars