← Latest products

FlashQwen

A from-scratch CUDA inference engine for Qwen3. ML Engineer, prev @Microsoft, @TencentGames. WeChat: Frankkk96 - frankkk96.

Open source

Visit github.comexternal site

Reactions (1)

Similar products

by description similarity

  1. An educational Local Qwen3 LLM Inference project written in Rust

    github.com

    An educational Rust project for exporting and running inference on Qwen3 LLM family

    Hacker News15 pts

  2. Lightweight Llama3 Inference Engine

    github.com

    CUDA C

    Hacker News12 pts

  3. Pruna AI

    news.ycombinator.com

    Inference Optimization Engine

    Hacker News6 pts

  4. We made our own inference engine for Apple Silicon

    github.com

    A high-performance inference engine for AI models

    Hacker News186 pts

  5. Tiny-vLLM

    github.com

    high performance LLM inference engine in C++ and CUDA

    Hacker News205 pts