← 최신 프로덕트

FlashQwen

A from-scratch CUDA inference engine for Qwen3. ML Engineer, prev @Microsoft, @TencentGames. WeChat: Frankkk96 - frankkk96.

오픈소스

github.com 방문외부 사이트

반응 (1)

비슷한 프로덕트

설명이 비슷한 순

  1. An educational Local Qwen3 LLM Inference project written in Rust

    github.com

    An educational Rust project for exporting and running inference on Qwen3 LLM family

    Hacker News15점

  2. Lightweight Llama3 Inference Engine

    github.com

    CUDA C

    Hacker News12점

  3. Pruna AI

    news.ycombinator.com

    Inference Optimization Engine

    Hacker News6점

  4. We made our own inference engine for Apple Silicon

    github.com

    A high-performance inference engine for AI models

    Hacker News186점

  5. Tiny-vLLM

    github.com

    high performance LLM inference engine in C++ and CUDA

    Hacker News205점