← Trending

Tangerine Index lists products launched since ChatGPT and people's reactions to them.

catwalk

github.com

🐈 A collection of LLM inference providers and models

Open source

Visit github.comexternal siteGitHub822 starsexternal site

Reactions (1)

Similar products

by description similarity

  1. sonar

    Large-scale LLM inference engine

    GitHub1,905 starsgithub.comOpen sourcelatest reaction

  2. guidellm

    Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs

    GitHub1,762 starsgithub.comOpen sourcelatest reaction

  3. rtp-llm

    RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

    GitHub1,394 starsgithub.comOpen sourcelatest reaction

  4. optillm

    Optimizing inference proxy for LLMs

    GitHub4,338 starsgithub.comOpen sourcelatest reaction

  5. dotLLM

    LLM inference engine written in .NET

    GitHub528 starsgithub.comOpen sourcelatest reaction