← 최신 프로덕트

Jinfer

AI inference engine for the JVM. AI in a jar. Run LLMs, vision, embeddings, and text-to-speech on the JVM at native speed. No Python runtime, ONNX bridges, or Docker sidecars. And so, Quixotic AI was born.

qxotic.ai 방문외부 사이트

반응 (1)

비슷한 프로덕트

설명이 비슷한 순

  1. 50+ LLMs on 2 GPUs with 2-Second Swapping? We built AI-Native Runtime

    github.com

    InferX: Inference as a Service Platform

    Hacker News5점

  2. We made our own inference engine for Apple Silicon

    github.com

    A high-performance inference engine for AI models

    Hacker News186점

  3. Low-latency local LLM runner via OpenJDK Panama FFM (Java 22)

    github.com

    Unified native AI runtime for Java 17+, Java 22+ (Panama FFM), Android & C++. Run GGUF LLMs, Vision, Video, Whisper ASR, TTS & Embeddings in-process.

    Hacker News38점

  4. Jlama

    github.com

    A fast Java inference engine for GPT and Llama models

    Hacker News7점

  5. Marvin

    github.com

    build AI functions that use an LLM as a runtime

    Hacker News127점