← 트렌딩

Tangerine Index는 ChatGPT 이후 나온 프로덕트와 사람들의 반응을 싣습니다.

pegainfer

github.com

Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

오픈소스

github.com 방문외부 사이트GitHub738 스타외부 사이트

반응 (1)

비슷한 프로덕트

설명이 비슷한 순

  1. FlashQwen

    A from-scratch CUDA inference engine for Qwen3

    Hacker News5점github.com오픈소스최근 반응

  2. An educational Local Qwen3 LLM Inference project written in Rust

    An educational Rust project for exporting and running inference on Qwen3 LLM family

    Hacker News15점GitHub스타 44github.com오픈소스반응 2개최근 반응

  3. OpenArc

    Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS, Embedding and Rerank models over OpenAI endpoints.

    Hacker News17점GitHub스타 547github.com오픈소스반응 2개최근 반응

  4. Genie-TTS

    GPT-SoVITS ONNX Inference Engine & Model Converter

    GitHub스타 1,843github.com오픈소스최근 반응

  5. We made our own inference engine for Apple Silicon

    A high-performance inference engine for AI models

    Hacker News186점GitHub스타 3,246github.com오픈소스반응 2개최근 반응