An RDMA/Infiniband Distributed Cache for Fast Inference and Training

비슷한 프로덕트

설명이 비슷한 순

1. Cuts Long Horizon Inference Costs by 50% via external KV Cache Offload

   github.com

   OpenLake is a high performance storage engine for efficient LLM inference and GPU Training

   HNHacker News22점

2. Speeding up LLM inference 2x times (possibly)

   asciinema.org

   Here's a project I've been working on for the last few months.

   HNHacker News419점

3. UnisonDB

   github.com

   B+Tree DB with sub-second replication to 100+ nodes

   HNHacker News15점

4. Distributed Llama

   github.com

   Run LLMs on multiple devices in parallel

   HNHacker News12점

5. Cachegrand

   cachegrand.io

   a fast Redis-compatible KV-store, v0.2.1 released

   HNHacker News12점