Llm.f90 fast
hackable transformer implementation in Fortran. LLM inference in Fortran. I submitted an earlier version of this a few months ago (as llama2.f90).
Open source
Reactions (1)
Similar products
by description similarity
LLM
github.coma Rust Crate/CLI for CPU Inference of LLMs (LLaMA, GPT-NeoX, etc.)
Tiny-vLLM
github.comhigh performance LLM inference engine in C++ and CUDA
ChainFactory
github.comRun Structured LLM Inference with Easy Parallelism
Llmtop
github.comHtop for LLM Inference Clusters (vLLM, SGLang, Ollama, llama)
Reame
github.coma CPU inference server that gets faster as it runs