An educational Local Qwen3 LLM Inference project written in Rust
An educational Rust project for exporting and running inference on Qwen3 LLM family.
오픈소스
반응 (1)
비슷한 프로덕트
설명이 비슷한 순
A high-performance inference engine for AI models
Speeding up LLM inference 2x times (possibly)
asciinema.orgHere's a project I've been working on for the last few months.
Spice.ai OSS 1.0
spiceai.orgdata query and AI-inference engine built in Rust
AnamDB
github.comAn AI-native, differentiable Datalog engine written in Rust
Free Inference Engineer and Model Training Roadmap
inferquest.orgFree, gamified roadmaps for LLM engineering: an Inference Engineering path (KV caches, CUDA kernels, production vLLM serving) and a Model Training path (pretraining on a budget, scaling laws, SFT/DPO/GRPO) — 185 tasks with auto-verified milestones instead of a paper certificate.