80% faster
50% less memory, 0% loss of accuracy Llama finetuning. Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more. I'm just sharing a project I've been working on during the LLM Efficiency Challenge - you can now finetune Llama with QLoRA 5x faster than Huggingface's original implementation on your own local GPU.
Self-hostedOpen source
Reactions (1)
Similar products
by description similarity
Finetune Llama-3.1 2x faster in a Colab
colab.research.google.comJust added Llama-3.1 support!
Finetune Llama-3 2x faster in a Colab notebook
colab.research.google.comSimple UI for LLM Model Finetuning
Finetune Llama 3.2 Vision in a Colab
colab.research.google.comJust added vision finetuning support in Unsloth!
Can your GPU run this LLM?
github.comCalculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization