NightRun
bare metal LLM inference, no OS, boots from USB. Boot your PC straight into an LLM. Rust, UEFI-resident, no operating system underneath.
Open source
Reactions (1)
Similar products
by description similarity
Xybrid
github.comrun LLM and speech locally in your app (no back end, Rust)
Nix on Windows –- proof-of-concept demo
github.comHow puffnfresh, my coworker, made a single command to download, assemble, and boot the VM image is arguably as cool as the port itself!
LLM
github.coma Rust Crate/CLI for CPU Inference of LLMs (LLaMA, GPT-NeoX, etc.)
Plock
github.comUse a local LLM from anywhere in your OS
Can I run this LLM? (locally)
can-i-run-this-llm-blue.vercel.appOne of the most frequent questions one faces while running LLMs locally is: I have xx RAM and yy GPU, Can I run zz LLM model ?