Zipslicer
a library for loading LLM checkpoints on consumer hardware. A library for incremental loading of large PyTorch checkpoints. This is a low-level opensource library I developed for my own use and decided to share, as it makes it possible to process large checkpoints of neural networks without renting high-RAM instances, on a regular PC.
라이브러리오픈소스
반응 (1)
비슷한 프로덕트
설명이 비슷한 순
A blazing fast concurrent zip archiver and extractor.
ChainForge
chainforge.aia visual tool for prompt engineering and LLM evaluation
LLM
github.coma Rust Crate/CLI for CPU Inference of LLMs (LLaMA, GPT-NeoX, etc.)
Anki-LLM
github.comBulk process and generate Anki flashcards with LLMs
Pykoi
cambioml.coma Python library for LLM data collection and fine tuning