← Latest products

Shimmy

5MB privacy-first, local alternative to Ollama (680MB). ⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.

Open source

6,004 stars · GitHubexternal site

Visit github.comexternal site

Reactions (1)

Similar products

by description similarity

  1. Timber

    github.com

    Ollama for classical ML models, 336x faster than Python

    Hacker News207 pts

  2. RunNburn

    github.com

    Run a 295B Moe from a 98GB GGUF on a 64GB RAM Desktop

    Hacker News11 pts

  3. Cuq

    github.com

    Formal Verification of Rust GPU Kernels

    Hacker News94 pts

  4. Cuts Long Horizon Inference Costs by 50% via external KV Cache Offload

    github.com

    OpenLake is a high performance storage engine for efficient LLM inference and GPU Training

    Hacker News22 pts

  5. Magnitude

    github.com

    Open-source AI browser automation framework

    Hacker News179 pts