An interactive transformer “debugger” been working on in my free time
Visual Transformer Mechanistic Analysis Tool. My focus has been shifting towards the ML alignment space recently, and in particular the ability to translate large transformer models into human understandable circuits and algorithms.
Open source
Reactions (1)
Similar products
by description similarity
Transformer Math Explorer
simonramstedt.comInteractive, source-backed reference for transformer architectures and their research lineage, with drillable dataflow graphs from GPT-2 through the released Kimi K3 architecture.
Curated Transformers
github.comPyTorch LLMs with less code duplication
TRiP
github.coma complete transformer engine in C built from scratch just by me
Trim Transformer
github.comA transformer for physics models
Transformers Crash Course
github.comA collection of tutorials and notebooks explaining transformer models in deep learning.