← Trending

Tangerine Index lists products launched since ChatGPT and people's reactions to them.

TinyChatEngine

github.com

TinyChatEngine: On-Device LLM Inference Library

LibraryOpen source

Visit github.comexternal siteGitHub971 starsexternal site

Reactions (1)

Similar products

by description similarity

  1. 1Cat-vLLM

    V100 / SM70-focused vLLM engineering fork for modern LLM inference.

    GitHub1,479 starsgithub.comOpen sourcelatest reaction

  2. sonar

    Large-scale LLM inference engine

    GitHub1,905 starsgithub.comOpen sourcelatest reaction

  3. TileRT

    Tile-Based Runtime for Ultra-Low-Latency LLM Inference

    GitHub1,887 starsgithub.comOpen sourcelatest reaction

  4. vllm

    A high-throughput and memory-efficient inference and serving engine for LLMs

    GitHub96,543 starsgithub.comOpen sourcelatest reaction

  5. web-llm

    High-performance In-browser LLM Inference Engine

    GitHub19,365 starsgithub.comOpen sourcelatest reaction