Zipslicer
a library for loading LLM checkpoints on consumer hardware. A library for incremental loading of large PyTorch checkpoints. This is a low-level opensource library I developed for my own use and decided to share, as it makes it possible to process large checkpoints of neural networks without renting high-RAM instances, on a regular PC.
LibraryOpen source
Reactions (1)
Similar products
by description similarity
A blazing fast concurrent zip archiver and extractor.
ChainForge
chainforge.aia visual tool for prompt engineering and LLM evaluation
LLM
github.coma Rust Crate/CLI for CPU Inference of LLMs (LLaMA, GPT-NeoX, etc.)
Pantry
github.comBrew/Docker for LLMs
Anki-LLM
github.comBulk process and generate Anki flashcards with LLMs