← 최신 프로덕트

Warp

Run DeepSeek v4.1 Flash with 5 GB of RAM at 3.77 tok/s. Run the full 2.78-trillion-parameter Kimi K3 model, DeepSeek V4.1 Flash or GLM-5.3-Flash beyond available RAM by streaming activated weights directly from NVMe. A dependency-free, embeddable C inference engine.

오픈소스

2,525 스타 · GitHub외부 사이트

github.com 방문외부 사이트

반응 (1)

비슷한 프로덕트

설명이 비슷한 순

  1. I shrank DeepSeek V4 Flash to 57GB and it wrote a compiler on my Mac

    huggingface.co

    Text Generation model. Download, explore files and run it on Hugging Face.

    Hacker News21점

  2. sllm

    sllm.cloud

    Split a GPU node with other developers, unlimited tokens

    Hacker News188점

  3. Cactus Needle 3

    cactuscompute.com

    8-29MB automation models can match DeepSeek V4 Flash

    Hacker News537점

  4. Running 104GB Qwen3.8-Flash-Next on 48GB Mac with at ~12 tok/s

    github.com

    Run a 105 GB AI model on a Mac that can't hold it. Qwen3.8-Flash-Next 4-bit, streamed from SSD on 16–64 GB Apple Silicon Macs. Fully native Swift, MLX and Metal. Offline, no Python. CLI, Swift library, and Ollama/OpenAI/Anthropic APIs. Works with Claude Code and Codex.

    Hacker News240점

  5. KTransformers:671B DeepSeek-R1 on a Single Machine-286 tokens/s Prefill

    github.com

    A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations

    Hacker News20점