← Latest products

Lemonade

Run LLMs Locally with GPU and NPU Acceleration. Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk. Lemonade is an open-source SDK and local LLM server focused on making it easy to run and experiment with large language models (LLMs) on your own PC, with special acceleration paths for NPUs (Ryzen™ AI) and GPUs (Strix Halo and Radeon™).

Open source

6,037 stars · GitHubexternal site

Visit github.comexternal site

Reactions (1)

Similar products

by description similarity

  1. Infinity Arcade–Open-source local LLM showcase for generating games

    github.com

    Let's have some retro gaming fun with AI! Join the discord: https://discord.gg/5xXzkMu8Zk

    Hacker News10 pts

  2. Can I run this LLM? (locally)

    can-i-run-this-llm-blue.vercel.app

    One of the most frequent questions one faces while running LLMs locally is: I have xx RAM and yy GPU, Can I run zz LLM model ?

    Hacker News42 pts

  3. Can your GPU run this LLM?

    github.com

    Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization

    Hacker News15 pts

  4. Low-latency local LLM runner via OpenJDK Panama FFM (Java 22)

    github.com

    Unified native AI runtime for Java 17+, Java 22+ (Panama FFM), Android & C++. Run GGUF LLMs, Vision, Video, Whisper ASR, TTS & Embeddings in-process.

    Hacker News38 pts

  5. 80% faster

    github.com

    50% less memory, 0% loss of accuracy Llama finetuning

    Hacker News385 pts