← Latest products

Goku

WASM (wllama)-powered LLM inference and model manager.

Visit userfrom1995.github.ioexternal site

Reactions (1)

Similar products

by description similarity

  1. Open-source AMDGCN kernels for optimizing LLM inference

    github.com

    Hacker News5 pts

  2. Speeding up LLM inference 2x times (possibly)

    asciinema.org

    Here's a project I've been working on for the last few months.

    Hacker News419 pts

  3. BonzAI

    bonzai.sh

    self-sovereign, local LLM inference in the browser

    Hacker News5 pts

  4. An RDMA/Infiniband Distributed Cache for Fast Inference and Training

    github.com

    A high-performance RDMA distributed file system for fast LLM Inference and GPU Training.

    Hacker News13 pts

  5. Jlama

    github.com

    A fast Java inference engine for GPT and Llama models

    Hacker News7 pts