Warp
Run DeepSeek v4.1 Flash with 5 GB of RAM at 3.77 tok/s. Run the full 2.78-trillion-parameter Kimi K3 model, DeepSeek V4.1 Flash or GLM-5.3-Flash beyond available RAM by streaming activated weights directly from NVMe. A dependency-free, embeddable C inference engine.
Open source
Reactions (2)
Similar products
by description similarity
Text Generation model. Download, explore files and run it on Hugging Face.
RunAnywhere (YC W26)
github.comFaster AI Inference on Apple Silicon
sllm
sllm.cloudSplit a GPU node with other developers, unlimited tokens
Cactus Needle 3
cactuscompute.com8-29MB automation models can match DeepSeek V4 Flash
A new engine to run Kimi K3 on a laptop
news.ycombinator.comKimi K3 has 2.78 trillion parameters and ships as 1.42 TB of weights.