← Latest products

Coinductive guide to inductive transformer heads [pdf]

Open source

6 stars · GitHubexternal site

Visit github.comexternal site

Reactions (1)

Similar products

by description similarity

  1. Curated Transformers

    github.com

    PyTorch LLMs with less code duplication

    Hacker News10 pts

  2. Transformer Math Explorer

    simonramstedt.com

    Interactive, source-backed reference for transformer architectures and their research lineage, with drillable dataflow graphs from GPT-2 through the released Kimi K3 architecture.

    Hacker News5 pts

  3. Swapple

    swapple.fuglede.dk

    a little daily puzzle on linear reversible circuit synthesis

    Hacker News72 pts

  4. TRiP

    github.com

    a complete transformer engine in C built from scratch just by me

    Hacker News38 pts

  5. less than 650 LOC trainable GPT only using NumPy

    github.com

    Absolute minimalistic implementation of a GPT-like transformer using only numpy (<650 lines).

    Hacker News90 pts