Plock
Use a local LLM from anywhere in your OS. From anywhere you can type, query and stream the output of any script (e.g. an LLM). After seeing a cool demo of a hack on Twitter, I built a cross platform version of it that works well and uses streaming.
Open source
Reactions (1)
Similar products
by description similarity
Built a simple web app that tells you which open-source LLMs will work on your hardware.
LLMpeg
github.comUses an llm to generate ffmpeg commands
Xybrid
github.comrun LLM and speech locally in your app (no back end, Rust)
Modern LLM providers can stream their responses. This is great for user experience — instead of a loading spinner, users see the response being generated in real time. They can also call external functions (also called "tools"): search your database
BrowserAI
github.comRun LLMs directly in browser using WebGPU (open source)