← Trending

Tangerine Index lists products launched since ChatGPT and people's reactions to them.

nixl

github.com

NVIDIA Inference Xfer Library (NIXL)

LibraryOpen source

Visit github.comexternal siteGitHub1,360 starsexternal site

Reactions (1)

Similar products

by description similarity

  1. exllamav2

    A fast inference library for running LLMs locally on modern consumer-class GPUs

    github.comLibraryOpen sourcelatest reaction

    Hacker News
    No reaction
    GitHub
    4,651 stars

  2. airllm

    AirLLM 2.8T LLM inference with single 4GB GPU

    github.comOpen sourcelatest reaction

    Hacker News
    No reaction
    GitHub
    41,908 stars

  3. tachyon

    Modular ZK(Zero Knowledge) backend accelerated by GPU

    github.comOpen sourcelatest reaction

    Hacker News
    No reaction
    GitHub
    7,642 stars

  4. Inferbench

    collect/share datapoints on GPU's inference performance

    inferbench.comlatest reaction

    Hacker News
    7 pts
    GitHub
    No reaction

  5. TensorFold

    LLM Inference Engine for Metal, CUDA and Vulkan.

    github.comOpen sourcelatest reaction

    Hacker News
    No reaction
    GitHub
    1,686 stars