Open-source AMDGCN kernels for optimizing LLM inference

비슷한 프로덕트

설명이 비슷한 순

1. Goku

   userfrom1995.github.io

   WASM (wllama)-powered LLM inference and model manager

   HNHacker News9점

2. Speeding up LLM inference 2x times (possibly)

   asciinema.org

   Here's a project I've been working on for the last few months.

   HNHacker News419점

3. A Node Editor for LLMs with Semantic Kernel

   docs.anyassistant.ai

   HNHacker News8점

4. BonzAI

   bonzai.sh

   self-sovereign, local LLM inference in the browser

   HNHacker News5점

5. An RDMA/Infiniband Distributed Cache for Fast Inference and Training

   github.com

   A high-performance RDMA distributed file system for fast LLM Inference and GPU Training.

   HNHacker News13점