← Trending

Tangerine Index lists products launched since ChatGPT and people's reactions to them.

mistral.rs

github.com

Fast, flexible LLM inference

Open source

Visit github.comexternal siteGitHub7,817 starsexternal site

Reactions (1)

Similar products

by description similarity

  1. sonar

    Large-scale LLM inference engine

    github.comOpen sourcelatest reaction

    GitHub
    1,905 stars

  2. vllm

    A high-throughput and memory-efficient inference and serving engine for LLMs

    github.comOpen sourcelatest reaction

    GitHub
    96,511 stars

  3. optillm

    Optimizing inference proxy for LLMs

    github.comOpen sourcelatest reaction

    GitHub
    4,338 stars

  4. rtp-llm

    RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

    github.comOpen sourcelatest reaction

    GitHub
    1,394 stars

  5. web-llm

    High-performance In-browser LLM Inference Engine

    github.comOpen sourcelatest reaction

    GitHub
    19,361 stars