I built a tiny LLM to demystify how language models work
A ~9M parameter LLM that talks like a small fish. Built a ~9M param LLM from scratch to understand how they actually work.
Open source
Reactions (1)
Similar products
by description similarity
GoalChain for goal-orientated LLM conversation flows
Speeding up LLM inference 2x times (possibly)
asciinema.orgHere's a project I've been working on for the last few months.
Smolmodels
github.comopen-source tool to build ML models using natural language
How LLMs Work
ynarwal.github.ioInteractive visual guide based on Karpathy's lecture
Language Model Builder (an app to learn about and build models)
languagemodelbuilder.com