I ran a language model on a PS2
Running a large language model on a PlayStation 2. The Emotion Engine has 32 MB of RAM total, so the trick is streaming weights from CD-ROM one matrix at a time during the forward pass — only activations, KV cache and embeddings live in RAM.
Open source
Reactions (1)
Similar products
by description similarity
Explore large language models in 512MB of RAM
A memory framework for Large Language Models and Agents.
A language model that lives in a boot sector
An LLM Running on a PS Vita
github.comA small storytelling LLM running on the PS Vita
A Julia framework for building interactive 3D experiances