Inferencer
Run and deeply control local AI models (macOS release). Run AI models locally with full control and privacy. Inspect token probabilities, serve models over network, stream large models with memory offloading and more. Private inference app that lets you see the token entropy, explore and change the token probabilities.
Reactions (1)
Similar products
by description similarity
A high-performance inference engine for AI models
NCompass Technologies
ncompass.techyet another AI Inference API, but hear us out
Pip install inference
github.comopen source computer vision deployment
Run AI chat
github.comimage gen, vision, and voice offline on your Mac
I built Otis
triangllabs.aia minimal AI agent that runs local models out of the box