← 최신 프로덕트

Jlama

A fast Java inference engine for GPT and Llama models. Jlama is a modern LLM inference engine for Java.

오픈소스

1,310 스타 · GitHub외부 사이트

github.com 방문외부 사이트

반응 (1)

비슷한 프로덕트

설명이 비슷한 순

  1. A fully open-source (Apache 2.0)implementation of llama

    github.com

    Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

    Hacker News158점

  2. Llmtop

    github.com

    Htop for LLM Inference Clusters (vLLM, SGLang, Ollama, llama)

    Hacker News5점

  3. Goku

    userfrom1995.github.io

    WASM (wllama)-powered LLM inference and model manager

    Hacker News9점

  4. We made our own inference engine for Apple Silicon

    github.com

    A high-performance inference engine for AI models

    Hacker News186점

  5. Timber

    github.com

    Ollama for classical ML models, 336x faster than Python

    Hacker News207점