Goku

비슷한 프로덕트

설명이 비슷한 순

1. Open-source AMDGCN kernels for optimizing LLM inference

   github.com

   HNHacker News5점

2. Speeding up LLM inference 2x times (possibly)

   asciinema.org

   Here's a project I've been working on for the last few months.

   HNHacker News419점

3. BonzAI

   bonzai.sh

   self-sovereign, local LLM inference in the browser

   HNHacker News5점

4. An RDMA/Infiniband Distributed Cache for Fast Inference and Training

   github.com

   A high-performance RDMA distributed file system for fast LLM Inference and GPU Training.

   HNHacker News13점

5. Jlama

   github.com

   A fast Java inference engine for GPT and Llama models

   HNHacker News7점