Keep your PyTorch model in VRAM by hot swapping code
Pytorch script hot swap: Change code without unloading your LLM from VRAM.
오픈소스
반응 (1)
비슷한 프로덕트
설명이 비슷한 순
GoTorch
news.ycombinator.comA Go Implementation of PyTorch
Paravirtual NVIDIA GPU for KVM guests — run unmodified CUDA, PyTorch and Vulkan inside a VM at host parity, on a GPU the host keeps using. No passthrough, no vGPU licence. Experimental.
Reimplementing PyTorch from scratch (MLP
github.comCNN) to learn the internals
LeanRL
github.comFast PyTorch RL with Torch.compile and CUDA Graphs
TurboPilot
github.comCopilot clone runs code completion LLM on your CPU