← 트렌딩
Tangerine Index는 ChatGPT 이후 나온 프로덕트와 사람들의 반응을 싣습니다.
TinyChatEngine
github.com
TinyChatEngine: On-Device LLM Inference Library
라이브러리오픈소스
비슷한 프로덕트
설명이 비슷한 순
1Cat-vLLM
V100 / SM70-focused vLLM engineering fork for modern LLM inference.
sonar
Large-scale LLM inference engine
TileRT
Tile-Based Runtime for Ultra-Low-Latency LLM Inference
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
web-llm
High-performance In-browser LLM Inference Engine
