Bonsai
A Competitive Ternary Weight LLM. Introducing Bonsai 0.5B, one of the first ternary-weight LLMs to rival full-precision models of similar size, such as Qwen 2.5 0.5B and MobileLLM 0.5B.
Open source
Reactions (1)
Similar products
by description similarity
Running PrismML's Bonsai inside DRAM by breaking DDR4 timing rules
news.ycombinator.comThe excitement surrounding PrismML’s 1-bit/ternary Bonsai models has the industry closely watching how smartphone giants, particularly Apple, will implement LLMs on edge devices.
Bonsai 1.7B ternary model at 442T/s on M4 Max
agents2agents.aiA drop-in optimized inference build of Bonsai 1.7B for Apple Silicon. ~42% faster decode (tg128) and ~9% faster prefill (pp512) on M-series GPUs. All Metal kernels written and tuned by ata, our autonomous engineering agent.
1-Bit Bonsai
prismml.comthe First Commercially Viable 1-Bit LLMs
Data Bonsai
github.coma Python package to clean your data with LLMs
Small LLM with Large Power
github.com