LLM
a Rust Crate/CLI for CPU Inference of LLMs (LLaMA, GPT-NeoX, etc.). [Unmaintained, see README] An ecosystem of Rust libraries for working with large language models. I'm one of the maintainers of `llm`.
CLI오픈소스
반응 (1)
비슷한 프로덕트
설명이 비슷한 순
LLM-Term
github.comSimple Rust-based CLI assist tool
Reame
github.coma CPU inference server that gets faster as it runs
A tool to benchmark LLM APIs (OpenAI
llmapitest.comClaude, local/self-hosted)
Tiny-vLLM
github.comhigh performance LLM inference engine in C++ and CUDA
GPTLint
github.coman OSS standard for LLM-based code review