An educational Local Qwen3 LLM Inference project written in Rust
An educational Rust project for exporting and running inference on Qwen3 LLM family.
Open source
Reactions (1)
Similar products
by description similarity
A high-performance inference engine for AI models
Speeding up LLM inference 2x times (possibly)
asciinema.orgHere's a project I've been working on for the last few months.
Spice.ai OSS 1.0
spiceai.orgdata query and AI-inference engine built in Rust
AnamDB
github.comAn AI-native, differentiable Datalog engine written in Rust
Free Inference Engineer and Model Training Roadmap
inferquest.orgFree, gamified roadmaps for LLM engineering: an Inference Engineering path (KV caches, CUDA kernels, production vLLM serving) and a Model Training path (pretraining on a budget, scaling laws, SFT/DPO/GRPO) — 185 tasks with auto-verified milestones instead of a paper certificate.