A tiny LLM running at 21,000 tok/s on a $250 FPGA (Live Demo)

Similar products

by description similarity

1. Small LLM with Large Power

   github.com

   HNHacker News14 pts

2. Llmspeed

   llmspeed.dev

   feel how fast a local LLM runs before you buy the hardware

   HNHacker News331 pts

3. A nibble-oriented CPU in Verilog to build a scientific calculator

   github.com

   From FPGA Gates to Scientific Calculator

   HNHacker News119 pts

4. rpgGPT

   rpg-gpt.vercel.app

   RPG with LLM-Powered NPCs

   HNHacker News29 pts

5. 10x better performance from the Coding Harnesses with LLM-wiki

   llm-wiki.net

   HNHacker News16 pts