← Trending

Tangerine Index lists products launched since ChatGPT and people's reactions to them.

web-llm

github.com

High-performance In-browser LLM Inference Engine

Open source

Visit github.comexternal siteGitHub19,361 starsexternal site

Reactions (1)

Similar products

by description similarity

  1. BonzAI

    self-sovereign, local LLM inference in the browser

    bonzai.shlatest reaction

    Hacker News
    5 pts
    GitHub
    No reaction

  2. sonar

    Large-scale LLM inference engine

    github.comOpen sourcelatest reaction

    Hacker News
    No reaction
    GitHub
    1,905 stars

  3. vllm

    A high-throughput and memory-efficient inference and serving engine for LLMs

    github.comOpen sourcelatest reaction

    Hacker News
    No reaction
    GitHub
    96,511 stars

  4. 1Cat-vLLM

    V100 / SM70-focused vLLM engineering fork for modern LLM inference.

    github.comOpen sourcelatest reaction

    Hacker News
    No reaction
    GitHub
    1,477 stars

  5. rtp-llm

    RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

    github.comOpen sourcelatest reaction

    Hacker News
    No reaction
    GitHub
    1,394 stars