← 트렌딩
Tangerine Index는 ChatGPT 이후 나온 프로덕트와 사람들의 반응을 싣습니다.
basalt
github.com
Local inference engine for Qwen3.8-Flash-Next on NVIDIA Blackwell
오픈소스
반응 (1)
비슷한 프로덕트
설명이 비슷한 순
exllamav2
A fast inference library for running LLMs locally on modern consumer-class GPUs
nixl
NVIDIA Inference Xfer Library (NIXL)
exllamav3
An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs
airllm
AirLLM 2.8T LLM inference with single 4GB GPU
cache-dit
A PyTorch-native inference engine with cache, parallelism, quantization and cpu offload for 100+ DiTs.