Cactus Hybrid
We taught Gemma 4 to know when it's wrong. On-device models that know when they're wrong: every answer carries a confidence score for cloud handoff. A small, on-device model is fast and private, but sometimes wrong, but frontier models are getting expensive pretty fast.
오픈소스
반응 (1)
비슷한 프로덕트
설명이 비슷한 순
Cactus (YC S25)
github.comAI inference on smartphones
ChonkLM
chonklm.comTiny language models running offline in the browser
General Instinct (YC P26)
general-instinct.comFrontier models on edge devices
Bonsai 1.7B ternary model at 442T/s on M4 Max
agents2agents.aiA drop-in optimized inference build of Bonsai 1.7B for Apple Silicon. ~42% faster decode (tg128) and ~9% faster prefill (pp512) on M-series GPUs. All Metal kernels written and tuned by ata, our autonomous engineering agent.
I benchmarked Gemma 4 E2B
aiexplr.comthe 2B model beat the 12B on multi-turn