Reactions (1)
Similar products
by description similarity
Running PrismML's Bonsai inside DRAM by breaking DDR4 timing rules
news.ycombinator.comThe excitement surrounding PrismML’s 1-bit/ternary Bonsai models has the industry closely watching how smartphone giants, particularly Apple, will implement LLMs on edge devices.
Bonsai 1.7B ternary model at 442T/s on M4 Max
agents2agents.aiA drop-in optimized inference build of Bonsai 1.7B for Apple Silicon. ~42% faster decode (tg128) and ~9% faster prefill (pp512) on M-series GPUs. All Metal kernels written and tuned by ata, our autonomous engineering agent.
Picohsm
picokeys.coma $5 open-source hsm
Wasp
wasp.shthe first full-stack framework powered by an LLM
Anki-LLM
github.comBulk process and generate Anki flashcards with LLMs