Llm.f90 fast
hackable transformer implementation in Fortran. LLM inference in Fortran. I submitted an earlier version of this a few months ago (as llama2.f90).
오픈소스
반응 (1)
비슷한 프로덕트
설명이 비슷한 순
LLM
github.coma Rust Crate/CLI for CPU Inference of LLMs (LLaMA, GPT-NeoX, etc.)
Tiny-vLLM
github.comhigh performance LLM inference engine in C++ and CUDA
ChainFactory
github.comRun Structured LLM Inference with Easy Parallelism
Llmtop
github.comHtop for LLM Inference Clusters (vLLM, SGLang, Ollama, llama)
Reame
github.coma CPU inference server that gets faster as it runs