Warp
Run DeepSeek v4.1 Flash with 5 GB of RAM at 3.77 tok/s. Run the full 2.78-trillion-parameter Kimi K3 model, DeepSeek V4.1 Flash or GLM-5.3-Flash beyond available RAM by streaming activated weights directly from NVMe. A dependency-free, embeddable C inference engine.
오픈소스
반응 (2)
비슷한 프로덕트
설명이 비슷한 순
Text Generation model. Download, explore files and run it on Hugging Face.
RunAnywhere (YC W26)
github.comFaster AI Inference on Apple Silicon
sllm
sllm.cloudSplit a GPU node with other developers, unlimited tokens
Cactus Needle 3
cactuscompute.com8-29MB automation models can match DeepSeek V4 Flash
A new engine to run Kimi K3 on a laptop
news.ycombinator.comKimi K3 has 2.78 trillion parameters and ships as 1.42 TB of weights.