ZSE
Open-source LLM inference engine with 3.9s cold starts. The inference engine the open-source world built for itself. I've been building ZSE (Z Server Engine) for the past few weeks — an open-source LLM inference engine focused on two things nobody has fully solved together: memory efficiency and fast cold starts.
Open source
Reactions (1)
Similar products
by description similarity
Tiny-vLLM
github.comhigh performance LLM inference engine in C++ and CUDA
OpenLake is a high performance storage engine for efficient LLM inference and GPU Training
SIE Serverless
superlinked.commanaged inference powered by self-hostable stack
A high-performance inference engine for AI models
Free Inference Engineer and Model Training Roadmap
inferquest.orgFree, gamified roadmaps for LLM engineering: an Inference Engineering path (KV caches, CUDA kernels, production vLLM serving) and a Model Training path (pretraining on a budget, scaling laws, SFT/DPO/GRPO) — 185 tasks with auto-verified milestones instead of a paper certificate.