Lossless compressor that can shrink llama3 to 68%
Open source
Link not responding (checked )
Reactions (1)
Similar products
by description similarity
UltraCompress
github.comfirst mathematically lossless 5-bit LLM compression
Cssfact
github.comLossy CSS compressor based on binary matrix factorization
Kanzi
github.comfast lossless data compression
Finetune Llama-3.1 2x faster in a Colab
colab.research.google.comJust added Llama-3.1 support!
Open-source load balancer for llama.cpp
github.comOpen-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.