Bonsai
A Competitive Ternary Weight LLM. Introducing Bonsai 0.5B, one of the first ternary-weight LLMs to rival full-precision models of similar size, such as Qwen 2.5 0.5B and MobileLLM 0.5B.
오픈소스
반응 (1)
비슷한 프로덕트
설명이 비슷한 순
Running PrismML's Bonsai inside DRAM by breaking DDR4 timing rules
news.ycombinator.comThe excitement surrounding PrismML’s 1-bit/ternary Bonsai models has the industry closely watching how smartphone giants, particularly Apple, will implement LLMs on edge devices.
Bonsai 1.7B ternary model at 442T/s on M4 Max
agents2agents.aiA drop-in optimized inference build of Bonsai 1.7B for Apple Silicon. ~42% faster decode (tg128) and ~9% faster prefill (pp512) on M-series GPUs. All Metal kernels written and tuned by ata, our autonomous engineering agent.
1-Bit Bonsai
prismml.comthe First Commercially Viable 1-Bit LLMs
Data Bonsai
github.coma Python package to clean your data with LLMs
Small LLM with Large Power
github.com