← 최신 프로덕트

Unfat

a library to easily train and distill LoRAs for LLMs. Tool for training and distilling LoRAs. After using a combination of Unsloth and Axolotl a lot , and finding it generally painful to figure out the right performance tuning for things like batch sizing and multi-GPU sharding, I wrote a small Python lib that sets up known-good LoRA training configurations for Llama 3.1 8B and 70B Instruct,.

라이브러리오픈소스

10 스타 · GitHub외부 사이트

github.com 방문외부 사이트

반응 (1)

비슷한 프로덕트

설명이 비슷한 순

  1. Zipslicer

    github.com

    a library for loading LLM checkpoints on consumer hardware

    Hacker News38점

  2. LoongForge-A high-performance training framework for LLM

    github.com

    VLM, VLA, Wan

    Hacker News10점

  3. I built a website where you can easily fine-tune Llama 3.1 models

    tunellama.com

    I use unsloth in the backend and the training is done on H100s which I rent programmatically from Runpod.

    Hacker News8점

  4. Llama 3.2 Interpretability with Sparse Autoencoders

    github.com

    A complete end-to-end pipeline for LLM interpretability with sparse autoencoders (SAEs) using Llama 3.2, written in pure PyTorch and fully reproducible.

    Hacker News579점

  5. LLM

    github.com

    a Rust Crate/CLI for CPU Inference of LLMs (LLaMA, GPT-NeoX, etc.)

    Hacker News45점