← 최신 프로덕트

Cactus

Ollama for Smartphones. Quantization, kernels, runtime and inference engine for mobiles, wearables, smart home and robots. Ollama enables deploying LLMs models locally on laptops and edge severs, Cactus enables deploying on phones.

라이브러리모바일오픈소스

6,171 스타 · GitHub외부 사이트

github.com 방문외부 사이트

반응 (1)

비슷한 프로덕트

설명이 비슷한 순

  1. Timber

    github.com

    Ollama for classical ML models, 336x faster than Python

    Hacker News207점

  2. A fully open-source (Apache 2.0)implementation of llama

    github.com

    Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

    Hacker News158점

  3. Cloud-native Stack for Ollama

    github.com

    Build locally and push to deploy

    Hacker News21점

  4. LLMxRay an open-source observability tool for LLMs

    github.com

    LLMxRay — Local LLM Observatory. Full observability interface for Ollama: chat, streaming, reasoning, RAG, introspection, metrics.

    Hacker News11점

  5. Shimmy

    github.com

    5MB privacy-first, local alternative to Ollama (680MB)

    Hacker News14점