← Latest products

L88

A Local RAG System on 8GB VRAM (Need Architecture Feedback). Repo: https://github.com/Hundred-Trillion/L88-Full I’m running this on 8GB VRAM and a strong CPU (128GB RAM).

Visit news.ycombinator.comexternal site

Reactions (1)

Similar products

by description similarity

  1. E80

    github.com

    an 8-bit CPU in structural VHDL

    Hacker News34 pts

  2. LocalScore

    localscore.ai

    Local LLM Benchmark

    Hacker News124 pts

  3. Run Llama3.1 405B on a 8GB VRAM challenge [video]

    youtube.com

    How to run Llama3.1 405B on a 8GB VRAM

    Hacker News19 pts

  4. RISC-V core written in 600 lines of C89

    github.com

    32-bit RISC-V CPU in ~800 lines of C89

    Hacker News190 pts

  5. Fine-tune an 8B model on a 4 GB laptop GPU

    github.com

    Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

    Hacker News139 pts