← Trending

Tangerine Index lists products launched since ChatGPT and people's reactions to them.

llm-internals

github.com

Learn LLM internals step by step - from tokenization to attention to inference optimization.

Open source

Visit github.comexternal siteGitHub1,770 starsexternal site

Reactions (1)

Similar products

by description similarity

  1. 1Cat-vLLM

    V100 / SM70-focused vLLM engineering fork for modern LLM inference.

    github.comOpen sourcelatest reaction

    GitHub
    1,477 stars

  2. sonar

    Large-scale LLM inference engine

    github.comOpen sourcelatest reaction

    GitHub
    1,905 stars

  3. vllm

    A high-throughput and memory-efficient inference and serving engine for LLMs

    github.comOpen sourcelatest reaction

    GitHub
    96,511 stars

  4. mistral.rs

    Fast, flexible LLM inference

    github.comOpen sourcelatest reaction

    GitHub
    7,817 stars

  5. optillm

    Optimizing inference proxy for LLMs

    github.comOpen sourcelatest reaction

    GitHub
    4,338 stars