Whisper at 1.58 bits with custom kernels for edge inference

Similar products

by description similarity

1. Open-source AMDGCN kernels for optimizing LLM inference

   github.com

   HNHacker News5 pts

2. KaniTTS

   huggingface.co

   Open-source high-fidelity TTS with just 450M params

   HNHacker News5 pts

3. Inferbench

   inferbench.com

   collect/share datapoints on GPU's inference performance

   HNHacker News7 pts

4. An RDMA/Infiniband Distributed Cache for Fast Inference and Training

   github.com

   A high-performance RDMA distributed file system for fast LLM Inference and GPU Training.

   HNHacker News13 pts

5. Phobos

   joa-ebert.com

   A tiny scale-free kernel language with tile-DAG support

   HNHacker News11 pts