Low-latency local LLM runner via OpenJDK Panama FFM (Java 22)
Unified native AI runtime for Java 17+, Java 22+ (Panama FFM), Android & C++. Run GGUF LLMs, Vision, Video, Whisper ASR, TTS & Embeddings in-process. I wanted to run AI from inside the JVM.
모바일오픈소스
반응 (1)
비슷한 프로덕트
설명이 비슷한 순
Lemonade
github.comRun LLMs Locally with GPU and NPU Acceleration
Sandboxes for AI agents. Securely run untrusted, LLM-generated code in isolated Firecracker microVM sandboxes that scale from one to thousands — with snapshot, suspend/resume, and durable orchestration.
Open-Source MCP Server for Context and AI Tools
news.ycombinator.comLarge Language Models (LLMs) are powerful, but they’re limited by fixed context windows and outdated knowledge.
VLM, VLA, Wan
GPT Router
github.comOpen-Source API Gateway for LLMs (OpenAI, Anthropic, etc.)