LLM
a Rust Crate/CLI for CPU Inference of LLMs (LLaMA, GPT-NeoX, etc.). [Unmaintained, see README] An ecosystem of Rust libraries for working with large language models. I'm one of the maintainers of `llm`.
CLIOpen source
Reactions (1)
Similar products
by description similarity
LLM-Term
github.comSimple Rust-based CLI assist tool
Reame
github.coma CPU inference server that gets faster as it runs
A tool to benchmark LLM APIs (OpenAI
llmapitest.comClaude, local/self-hosted)
Tiny-vLLM
github.comhigh performance LLM inference engine in C++ and CUDA
GPTLint
github.coman OSS standard for LLM-based code review