← 트렌딩
Tangerine Index는 ChatGPT 이후 나온 프로덕트와 사람들의 반응을 싣습니다.
LLMSpeculativeSampling
github.com
Fast inference from large lauguage models via speculative decoding
오픈소스
비슷한 프로덕트
설명이 비슷한 순
speculators
A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM
chitu
High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.
LLMs following grammar for general-purpose PLs
Efficient and general syntactical decoding for Large Language Models
SpecForge
Train speculative decoding models effortlessly and port them smoothly to SGLang serving.
mistral.rs
Fast, flexible LLM inference
