I wrote a 1-bit WebGPU runtime to run a 1.7B LLM in the browser
Drop in one script tag and your visitors get a private voice and text AI assistant that runs entirely in their browser. No backend, no API keys, no per-message cost. Open source.

반응 (1)
비슷한 프로덕트
설명이 비슷한 순
WebGPU enables local LLM in the browser
andreinwald.github.iodemo site with AI chat
Run AI models directly in the browser
private-ai-chat.vercel.appno server or internet required
Fully private LLM chatbot that runs entirely with a browser with no server needed. Supports Mistral and LLama 3.
TTSLab
ttslab.devA voice AI agent and TTS lab running in the browser via WebGPU
BrowserAI
github.comRun LLMs directly in browser using WebGPU (open source)