← 최신 프로덕트

I ran a language model on a PS2

Running a large language model on a PlayStation 2. The Emotion Engine has 32 MB of RAM total, so the trick is streaming weights from CD-ROM one matrix at a time during the forward pass — only activations, KV cache and embeddings live in RAM.

오픈소스

52 스타 · GitHub외부 사이트

github.com 방문외부 사이트

반응 (1)

비슷한 프로덕트

설명이 비슷한 순

  1. Explore large language models with 512MB of RAM

    github.com

    Explore large language models in 512MB of RAM

    Hacker News138점

  2. A tool to give large language models better memory

    github.com

    A memory framework for Large Language Models and Agents.

    Hacker News11점

  3. A language model that lives in a boot sector

    github.com

    A language model that lives in a boot sector

    Hacker News103점

  4. An LLM Running on a PS Vita

    github.com

    A small storytelling LLM running on the PS Vita

    Hacker News5점

  5. Game Engine in Julia with 400KB Exports (Vs Unity's 200MB)

    github.com

    A Julia framework for building interactive 3D experiances

    Hacker News5점