Lossless compressor that can shrink llama3 to 68%

비슷한 프로덕트

설명이 비슷한 순

1. UltraCompress

   github.com

   first mathematically lossless 5-bit LLM compression

   HNHacker News6점

2. Cssfact

   github.com

   Lossy CSS compressor based on binary matrix factorization

   HNHacker News7점

3. Kanzi

   github.com

   fast lossless data compression

   HNHacker News15점

4. Finetune Llama-3.1 2x faster in a Colab

   colab.research.google.com

   Just added Llama-3.1 support!

   HNHacker News16점

5. Open-source load balancer for llama.cpp

   github.com

   Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.

   HNHacker News151점