← Trending

Tangerine Index lists products launched since ChatGPT and people's reactions to them.

TensorRT-Edge-LLM

github.com

High-performance, light-weight C++ LLM and VLM Inference Software for Physical AI

Open source

Visit github.comexternal siteGitHub625 starsexternal site

Install and connect

From the official MCP Registry, Homebrew, npm, PyPI, and crates.io. Matched by repository or domain once a day.

Reactions (1)

Similar products

by description similarity

  1. 1Cat-vLLM

    V100 / SM70-focused vLLM engineering fork for modern LLM inference.

    GitHub1,487 starsgithub.comOpen sourcelatest reaction

  2. xllm

    A high-performance inference engine for LLM, VLM and DiT models, optimized for diverse AI accelerators. It is hosted in OpenAtom Foundation.

    GitHub1,618 starsgithub.comOpen sourcelatest reaction

  3. TensorFold

    LLM Inference Engine for Metal, CUDA and Vulkan.

    GitHub1,713 starsgithub.comOpen sourcelatest reaction

  4. tokenspeed

    TokenSpeed is a speed-of-light LLM inference engine.

    GitHub2,900 starsgithub.comOpen sourcelatest reaction

  5. rtp-llm

    RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

    GitHub1,394 starsgithub.comOpen sourcelatest reaction