Recurser lib reduces GPT2-XL VRAM usage by 25% and runs it on Colab
Reduce VRAM usage on transformer models.
오픈소스
반응 (1)
비슷한 프로덕트
설명이 비슷한 순
I made a GPU VRAM calculator for transformer-based models
vram.asmirnov.xyzThe implementation of Test Time Diffusion paper by Google with some tweaks to run on 24gb gpu
Goralim
github.coma rate limiting pkg for Go to handle distributed workloads
Taliesin
medium.combit-exact KV-cache restore, 21x faster, cross-GPU verified
Finetune Llama-3 2x faster in a Colab notebook
colab.research.google.com