← Latest products

Llama Running on a Microcontroller

A "large" language model running on a microcontroller.

Open source

562 stars · GitHubexternal site

Visit github.comexternal site

Reactions (1)

Similar products

by description similarity

  1. Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

    Hacker News158 pts

  2. Hacker News107 pts

  3. I wrote a small local tool to transcribe audio notes (Whisper/Parakeet).

    Hacker News31 pts

  4. Mu

    mu.xyz

    a new Micro app platform

    Hacker News19 pts

  5. Llama2.ipynb

    github.com

    Ipython notebook copy of Andrej Karpathy's llama2.c

    Hacker News12 pts