ChonkLM
Tiny language models running offline in the browser. Tiny language models, running offline in your browser. On-device inference in 2 minutes. I had been looking to try These are only so useful in a multi-turn conversation but it's still interesting to see what you can pack in a I tried using ONNX versions earlier, but there were too many quirks of using them with language models and the TPS wasn't too impressive.
Reactions (1)
Similar products
by description similarity
Z80-μLM
github.coma 'Conversational AI' That Fits in 40KB
Token Classification model with 0.3B parameters. Download, explore files and run it on Hugging Face.
A ~9M parameter LLM that talks like a small fish.
Run AI models directly in the browser
private-ai-chat.vercel.appno server or internet required
SmolCopilot
github.com360M LLM writing assistant in the browser