← 최신 프로덕트

BaseRT

6.4x faster than llama.cpp, 3.9x faster than MLX. BaseRT is the fastest LLM runtime on Apple Silicon. Install it with one command and run local models on your own device. BaseRT is the fastest LLM runtime on Apple Silicon.

basecompute.co 방문외부 사이트

반응 (1)

비슷한 프로덕트

설명이 비슷한 순

  1. Rapid-MLX

    github.com

    Run local LLMs on Mac, 2-3x faster than alternatives

    Hacker News9점

  2. I run 30B 22tok/s, 109tok/s not novel,6GB/16GB RAM overcoming llama.cpp

    github.com

    Run a 110B on a 2016 PC with 16 GB RAM. Know your tok/s before you download. Placement beats budget: predicts speed + memory fit for any GGUF on your exact hardware, self-calibrates, emits the exact llama.cpp command — or 'quantprobe auto' does it all. Falsification-tested laws; misses published at full size. pip install quantprobe

    Hacker News5점

  3. The fastest way to run Mixtral 8x7B on Apple Silicon Macs

    news.ycombinator.com

    I’d originally launched my app: Private LLM[1][2] on HN around 10 months ago, with a single RedPajama Chat 3B model.

    Hacker News18점

  4. Turbo Base64 library. AVX512 Faster than memcpy and any other base64

    github.com

    Turbo Base64 - Fastest Base64 SIMD:SSE/AVX2/AVX512/Neon/Altivec - Faster than memcpy!

    Hacker News5점

  5. Apples2Oranges. Ollama with hardware telemetry.On device LLM playground

    github.com

    LLM Comparison + Hardware Telemetry Playground for Small Language Models and On-Device AI

    Hacker News5점