← Latest products

Cactus

Ollama for Smartphones. Quantization, kernels, runtime and inference engine for mobiles, wearables, smart home and robots. Ollama enables deploying LLMs models locally on laptops and edge severs, Cactus enables deploying on phones.

LibraryMobileOpen source

6,171 stars · GitHubexternal site

Visit github.comexternal site

Reactions (1)

Similar products

by description similarity

  1. Timber

    github.com

    Ollama for classical ML models, 336x faster than Python

    Hacker News207 pts

  2. A fully open-source (Apache 2.0)implementation of llama

    github.com

    Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

    Hacker News158 pts

  3. Cloud-native Stack for Ollama

    github.com

    Build locally and push to deploy

    Hacker News21 pts

  4. LLMxRay an open-source observability tool for LLMs

    github.com

    LLMxRay — Local LLM Observatory. Full observability interface for Ollama: chat, streaming, reasoning, RAG, introspection, metrics.

    Hacker News11 pts

  5. Shimmy

    github.com

    5MB privacy-first, local alternative to Ollama (680MB)

    Hacker News14 pts