← Trending

Tangerine Index lists products launched since ChatGPT and people's reactions to them.

SpecForge

github.com

Train speculative decoding models effortlessly and port them smoothly to SGLang serving.

Open source

Visit github.comexternal siteGitHub1,274 starsexternal site

Install and connect

From the official MCP Registry, Homebrew, npm, PyPI, and crates.io. Matched by repository or domain once a day.

Reactions (1)

Similar products

by description similarity

  1. speculators

    A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM

    GitHub946 starsgithub.comLibraryOpen sourcelatest reaction

  2. LLMSpeculativeSampling

    Fast inference from large lauguage models via speculative decoding

    GitHub926 starsgithub.comOpen sourcelatest reaction

  3. sglang

    SGLang is a high-performance serving framework for large language models and multimodal models.

    GitHub38,610 starsgithub.comLibraryOpen sourcelatest reaction

  4. bitcode

    A binary encoder/decoder for Rust

    GitHub676 starsgithub.comOpen sourcelatest reaction

  5. MiniChain

    A tiny library for coding with large language models.

    GitHub1,229 starsgithub.comLibraryOpen sourcelatest reaction