← Latest products

Recurser lib reduces GPT2-XL VRAM usage by 25% and runs it on Colab

Reduce VRAM usage on transformer models.

Open source

9 stars · GitHubexternal site

Visit github.comexternal site

Reactions (1)

Similar products

by description similarity

  1. I made a GPU VRAM calculator for transformer-based models

    vram.asmirnov.xyz

    Hacker News135 pts

  2. OSS implementation of Test Time Diffusion that runs on a 24gb GPU

    github.com

    The implementation of Test Time Diffusion paper by Google with some tweaks to run on 24gb gpu

    Hacker News21 pts

  3. Goralim

    github.com

    a rate limiting pkg for Go to handle distributed workloads

    Hacker News69 pts

  4. Taliesin

    medium.com

    bit-exact KV-cache restore, 21x faster, cross-GPU verified

    Hacker News10 pts

  5. Finetune Llama-3 2x faster in a Colab notebook

    colab.research.google.com

    Hacker News45 pts