← Latest products

BaseRT

6.4x faster than llama.cpp, 3.9x faster than MLX. BaseRT is the fastest LLM runtime on Apple Silicon. Install it with one command and run local models on your own device. BaseRT is the fastest LLM runtime on Apple Silicon.

Visit basecompute.coexternal site

Reactions (1)

Similar products

by description similarity

  1. Rapid-MLX

    github.com

    Run local LLMs on Mac, 2-3x faster than alternatives

    Hacker News9 pts

  2. I run 30B 22tok/s, 109tok/s not novel,6GB/16GB RAM overcoming llama.cpp

    github.com

    Run a 110B on a 2016 PC with 16 GB RAM. Know your tok/s before you download. Placement beats budget: predicts speed + memory fit for any GGUF on your exact hardware, self-calibrates, emits the exact llama.cpp command — or 'quantprobe auto' does it all. Falsification-tested laws; misses published at full size. pip install quantprobe

    Hacker News5 pts

  3. The fastest way to run Mixtral 8x7B on Apple Silicon Macs

    news.ycombinator.com

    I’d originally launched my app: Private LLM[1][2] on HN around 10 months ago, with a single RedPajama Chat 3B model.

    Hacker News18 pts

  4. Turbo Base64 library. AVX512 Faster than memcpy and any other base64

    github.com

    Turbo Base64 - Fastest Base64 SIMD:SSE/AVX2/AVX512/Neon/Altivec - Faster than memcpy!

    Hacker News5 pts

  5. Apples2Oranges. Ollama with hardware telemetry.On device LLM playground

    github.com

    LLM Comparison + Hardware Telemetry Playground for Small Language Models and On-Device AI

    Hacker News5 pts