← Trending

Tangerine Index lists products launched since ChatGPT and people's reactions to them.

xllm

github.com

A high-performance inference engine for LLM, VLM, DiT and REC models, optimized for diverse AI accelerators. It is hosted in OpenAtom Foundation.

Open source

Visit github.comexternal siteGitHub1,618 starsexternal site

Reactions (1)

Similar products

by description similarity

  1. InferenceX

    Open Source AI Accelerator Research Platform Standard / 开源推理研究平台

    github.comOpen sourcelatest reaction

    GitHub
    2,002 stars

  2. rtp-llm

    RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

    github.comOpen sourcelatest reaction

    GitHub
    1,394 stars

  3. 1Cat-vLLM

    V100 / SM70-focused vLLM engineering fork for modern LLM inference.

    github.comOpen sourcelatest reaction

    GitHub
    1,477 stars

  4. vllm

    A high-throughput and memory-efficient inference and serving engine for LLMs

    github.comOpen sourcelatest reaction

    GitHub
    96,511 stars

  5. tokenspeed

    TokenSpeed is a speed-of-light LLM inference engine.

    github.comOpen sourcelatest reaction

    GitHub
    2,885 stars