← 최신 프로덕트

Lemonade

Run LLMs Locally with GPU and NPU Acceleration. Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk. Lemonade is an open-source SDK and local LLM server focused on making it easy to run and experiment with large language models (LLMs) on your own PC, with special acceleration paths for NPUs (Ryzen™ AI) and GPUs (Strix Halo and Radeon™).

오픈소스

6,037 스타 · GitHub외부 사이트

github.com 방문외부 사이트

반응 (1)

비슷한 프로덕트

설명이 비슷한 순

  1. Infinity Arcade–Open-source local LLM showcase for generating games

    github.com

    Let's have some retro gaming fun with AI! Join the discord: https://discord.gg/5xXzkMu8Zk

    Hacker News10점

  2. Can I run this LLM? (locally)

    can-i-run-this-llm-blue.vercel.app

    One of the most frequent questions one faces while running LLMs locally is: I have xx RAM and yy GPU, Can I run zz LLM model ?

    Hacker News42점

  3. Can your GPU run this LLM?

    github.com

    Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization

    Hacker News15점

  4. Low-latency local LLM runner via OpenJDK Panama FFM (Java 22)

    github.com

    Unified native AI runtime for Java 17+, Java 22+ (Panama FFM), Android & C++. Run GGUF LLMs, Vision, Video, Whisper ASR, TTS & Embeddings in-process.

    Hacker News38점

  5. 80% faster

    github.com

    50% less memory, 0% loss of accuracy Llama finetuning

    Hacker News385점