← 최신 프로덕트

Speeding up LLM inference 2x times (possibly)

Here's a project I've been working on for the last few months.

asciinema.org 방문외부 사이트

반응 (1)

비슷한 프로덕트

설명이 비슷한 순

  1. An educational Local Qwen3 LLM Inference project written in Rust

    github.com

    An educational Rust project for exporting and running inference on Qwen3 LLM family

    Hacker News15점

  2. I built a tiny LLM to demystify how language models work

    github.com

    A ~9M parameter LLM that talks like a small fish.

    Hacker News915점

  3. AutoThink

    news.ycombinator.com

    Boosts local LLM performance with adaptive reasoning

    Hacker News397점

  4. Crespo

    github.com

    Tree-sitter AST blueprints instead of raw code for LLMs

    Hacker News14점

  5. An RDMA/Infiniband Distributed Cache for Fast Inference and Training

    github.com

    A high-performance RDMA distributed file system for fast LLM Inference and GPU Training.

    Hacker News13점