← Latest products

Low-latency local LLM runner via OpenJDK Panama FFM (Java 22)

Unified native AI runtime for Java 17+, Java 22+ (Panama FFM), Android & C++. Run GGUF LLMs, Vision, Video, Whisper ASR, TTS & Embeddings in-process. I wanted to run AI from inside the JVM.

MobileOpen source

19 stars · GitHubexternal site

Visit github.comexternal site

Reactions (1)

Similar products

by description similarity

  1. Lemonade

    github.com

    Run LLMs Locally with GPU and NPU Acceleration

    Hacker News15 pts

  2. Open-source real time data framework for LLM applications

    getindexify.ai

    Sandboxes for AI agents. Securely run untrusted, LLM-generated code in isolated Firecracker microVM sandboxes that scale from one to thousands — with snapshot, suspend/resume, and durable orchestration.

    Hacker News92 pts

  3. Open-Source MCP Server for Context and AI Tools

    news.ycombinator.com

    Large Language Models (LLMs) are powerful, but they’re limited by fixed context windows and outdated knowledge.

    Hacker News43 pts

  4. LoongForge-A high-performance training framework for LLM

    github.com

    VLM, VLA, Wan

    Hacker News10 pts

  5. GPT Router

    github.com

    Open-Source API Gateway for LLMs (OpenAI, Anthropic, etc.)

    Hacker News15 pts