← Trending

Tangerine Index lists products launched since ChatGPT and people's reactions to them.

speculators

github.com

A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM

LibraryOpen source

Visit github.comexternal siteGitHub946 starsexternal site

Install and connect

From the official MCP Registry, Homebrew, npm, PyPI, and crates.io. Matched by repository or domain once a day.

Reactions (1)

Similar products

by description similarity

  1. LLMSpeculativeSampling

    Fast inference from large lauguage models via speculative decoding

    GitHub926 starsgithub.comOpen sourcelatest reaction

  2. 1Cat-vLLM

    V100 / SM70-focused vLLM engineering fork for modern LLM inference.

    GitHub1,484 starsgithub.comOpen sourcelatest reaction

  3. vllm

    A high-throughput and memory-efficient inference and serving engine for LLMs

    Hacker News108 ptsGitHub96,591 starsgithub.comOpen source3 reactionslatest reaction

  4. SpecForge

    Train speculative decoding models effortlessly and port them smoothly to SGLang serving.

    GitHub1,274 starsgithub.comOpen sourcelatest reaction

  5. index-tts-vllm

    Added vLLM support to IndexTTS for faster inference.

    GitHub1,245 starsgithub.comOpen sourcelatest reaction