Lifeboat
2-6x more concurrent agent sessions per GPU, no quantization. Lifeboat — downloads for macOS, Windows and Linux, plus Docker and Kubernetes install instructions. Run language models on your own hardware behind an OpenAI-compatible API.
오픈소스
반응 (1)
비슷한 프로덕트
설명이 비슷한 순
Ollama
github.comRun LLMs on your Mac
CLRK
github.coman open-source agent runtime with gVisor and MitM guardrails
Docker-whisper
github.comSelf-hosted Whisper speech-to-text server (OpenAI API)
Containarium
github.comself-hosted sandbox for AI agents, MCP-native
Runs AI coding agents inside isolated Docker containers