← Trending

Tangerine Index lists products launched since ChatGPT and people's reactions to them.

ZhiLight

github.com

A highly optimized LLM inference acceleration engine for Llama and its variants.

Open source

Visit github.comexternal siteGitHub906 starsexternal site

Reactions (1)

Similar products

by description similarity

  1. swama

    High-performance MLX-based LLM inference engine for macOS with native Swift implementation

    GitHub593 starsgithub.comOpen sourcelatest reaction

  2. vllm

    A high-throughput and memory-efficient inference and serving engine for LLMs

    GitHub96,543 starsgithub.comOpen sourcelatest reaction

  3. 1Cat-vLLM

    V100 / SM70-focused vLLM engineering fork for modern LLM inference.

    GitHub1,479 starsgithub.comOpen sourcelatest reaction

  4. sonar

    Large-scale LLM inference engine

    GitHub1,905 starsgithub.comOpen sourcelatest reaction

  5. LlamaFactory

    Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

    GitHub75,935 starsgithub.comOpen sourcelatest reaction