Unfat
a library to easily train and distill LoRAs for LLMs. Tool for training and distilling LoRAs. After using a combination of Unsloth and Axolotl a lot , and finding it generally painful to figure out the right performance tuning for things like batch sizing and multi-GPU sharding, I wrote a small Python lib that sets up known-good LoRA training configurations for Llama 3.1 8B and 70B Instruct,.
LibraryOpen source
Reactions (1)
Similar products
by description similarity
Zipslicer
github.coma library for loading LLM checkpoints on consumer hardware
VLM, VLA, Wan
I use unsloth in the backend and the training is done on H100s which I rent programmatically from Runpod.
A complete end-to-end pipeline for LLM interpretability with sparse autoencoders (SAEs) using Llama 3.2, written in pure PyTorch and fully reproducible.
LLM
github.coma Rust Crate/CLI for CPU Inference of LLMs (LLaMA, GPT-NeoX, etc.)