Lifeboat
2-6x more concurrent agent sessions per GPU, no quantization. Lifeboat — downloads for macOS, Windows and Linux, plus Docker and Kubernetes install instructions. Run language models on your own hardware behind an OpenAI-compatible API.
Open source
Reactions (1)
Similar products
by description similarity
Ollama
github.comRun LLMs on your Mac
CLRK
github.coman open-source agent runtime with gVisor and MitM guardrails
Docker-whisper
github.comSelf-hosted Whisper speech-to-text server (OpenAI API)
Containarium
github.comself-hosted sandbox for AI agents, MCP-native
Runs AI coding agents inside isolated Docker containers