An LLM Running on a PS Vita
A small storytelling LLM running on the PS Vita. Runs showed that the 260K model ran at ~120 tok/s and at 15M ran at 1.8 tok/s, which probably could be a bit higher if it weren't a single threaded application.
오픈소스
반응 (1)
비슷한 프로덕트
설명이 비슷한 순
I ran a language model on a PS2
github.comRunning a large language model on a PlayStation 2
Unified native AI runtime for Java 17+, Java 22+ (Panama FFM), Android & C++. Run GGUF LLMs, Vision, Video, Whisper ASR, TTS & Embeddings in-process.
NanoRL
github.comRL training for LLMs in ~1,800 lines
Documents the style side of the short-story Creative Writing LLM benchmark: we generated many short stories with a range of LLMs, then analyzed those stories for stylistic fingerprints and within-model diversity. This study focuses on how models write, how their outputs differ, and how varied each model is across its own stories.