Open-source AMDGCN kernels for optimizing LLM inference

Similar products

by description similarity

1. Goku

   userfrom1995.github.io

   WASM (wllama)-powered LLM inference and model manager

   HNHacker News9 pts

2. Speeding up LLM inference 2x times (possibly)

   asciinema.org

   Here's a project I've been working on for the last few months.

   HNHacker News419 pts

3. A Node Editor for LLMs with Semantic Kernel

   docs.anyassistant.ai

   HNHacker News8 pts

4. BonzAI

   bonzai.sh

   self-sovereign, local LLM inference in the browser

   HNHacker News5 pts

5. An RDMA/Infiniband Distributed Cache for Fast Inference and Training

   github.com

   A high-performance RDMA distributed file system for fast LLM Inference and GPU Training.

   HNHacker News13 pts