← Trending

Tangerine Index lists products launched since ChatGPT and people's reactions to them.

Qwen-TensorRT-LLM

github.com

Open source

Visit github.comexternal siteGitHub618 starsexternal site

Reactions (1)

Similar products

by description similarity

  1. TensorRT-LLM

    TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

    GitHub15,046 starsgithub.comOpen sourcelatest reaction

  2. einx

    Universal Notation for Tensor Operations in Python

    GitHub534 starsgithub.comOpen sourcelatest reaction

  3. LLGTRT

    TensorRT-LLM+Rust server w/ OpenAI-compat and Structured Output

    Hacker News6 ptsGitHub73 starsgithub.comOpen source2 reactionslatest reaction

  4. TurboQuant

    New LLM compression algorithm by Google

    Hacker News576 ptsProduct Hunt291 votesresearch.google3 reactionslatest reaction

  5. FlashQwen

    A from-scratch CUDA inference engine for Qwen3

    Hacker News5 ptsgithub.comOpen sourcelatest reaction