← Latest products

less than 650 LOC trainable GPT only using NumPy

Absolute minimalistic implementation of a GPT-like transformer using only numpy (<650 lines).

Open source

251 stars · GitHubexternal site

Visit github.comexternal site

Reactions (1)

Similar products

by description similarity

  1. FemtoGPT

    github.com

    Pure Rust implementation of a GPT language model

    Hacker News19 pts

  2. TinyGPT

    github.com

    A Simple, Educational Deep Learning Library

    Hacker News13 pts

  3. TurboGPT

    github.com

    train 22KiB transformer in 13s

    Hacker News56 pts

  4. Curated Transformers

    github.com

    PyTorch LLMs with less code duplication

    Hacker News10 pts

  5. TRiP

    github.com

    a complete transformer engine in C built from scratch just by me

    Hacker News38 pts