← Trending

Tangerine Index lists products launched since ChatGPT and people's reactions to them.

swama

github.com

High-performance MLX-based LLM inference engine for macOS with native Swift implementation

Open source

Visit github.comexternal siteGitHub593 starsexternal site

Reactions (1)

Similar products

by description similarity

  1. ZhiLight

    A highly optimized LLM inference acceleration engine for Llama and its variants.

    GitHub906 starsgithub.comOpen sourcelatest reaction

  2. vllm

    A high-throughput and memory-efficient inference and serving engine for LLMs

    GitHub96,543 starsgithub.comOpen sourcelatest reaction

  3. TinyChatEngine

    TinyChatEngine: On-Device LLM Inference Library

    GitHub971 starsgithub.comLibraryOpen sourcelatest reaction

  4. web-llm

    High-performance In-browser LLM Inference Engine

    GitHub19,365 starsgithub.comOpen sourcelatest reaction

  5. 1Cat-vLLM

    V100 / SM70-focused vLLM engineering fork for modern LLM inference.

    GitHub1,479 starsgithub.comOpen sourcelatest reaction