I wrote a 1-bit WebGPU runtime to run a 1.7B LLM in the browser
Drop in one script tag and your visitors get a private voice and text AI assistant that runs entirely in their browser. No backend, no API keys, no per-message cost. Open source.

Reactions (1)
Similar products
by description similarity
WebGPU enables local LLM in the browser
andreinwald.github.iodemo site with AI chat
Run AI models directly in the browser
private-ai-chat.vercel.appno server or internet required
Fully private LLM chatbot that runs entirely with a browser with no server needed. Supports Mistral and LLama 3.
BrowserAI
github.comRun LLMs directly in browser using WebGPU (open source)
No-Code
browseragent.devPrivate AI Agents – Build and Run Locally