Minimal LLM Post-Training Experiments on an 8GB GPU (SFT
DPO, GRPO). Minimal, readable LLM post-training experiments on one 8GB GPU. Measures forgetting, seed variance, and RL emergence.
Open source
Reactions (1)
Similar products
by description similarity
The implementation of Test Time Diffusion paper by Google with some tweaks to run on 24gb gpu
Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
Free Inference Engineer and Model Training Roadmap
inferquest.orgFree, gamified roadmaps for LLM engineering: an Inference Engineering path (KV caches, CUDA kernels, production vLLM serving) and a Model Training path (pretraining on a budget, scaling laws, SFT/DPO/GRPO) — 185 tasks with auto-verified milestones instead of a paper certificate.
OpenGraviton
opengraviton.github.ioRun 500B+ parameter models on a consumer Mac Mini
Mini-AGI
github.comDynamic continual learning model trained on 8GB VRAM