← Trending

Tangerine Index lists products launched since ChatGPT and people's reactions to them.

ring-attention-pytorch

github.com

Implementation of 💍 Ring Attention, from Liu et al. at Berkeley AI, in Pytorch

Open source

Visit github.comexternal siteGitHub548 starsexternal site

Reactions (1)

Similar products

by description similarity

  1. ring-flash-attention

    Ring attention implementation with flash attention

    GitHub1,067 starsgithub.comOpen sourcelatest reaction

  2. native-sparse-attention-pytorch

    Implementation of the sparse attention pattern proposed by the Deepseek team in their "Native Sparse Attention" paper

    GitHub816 starsgithub.comOpen sourcelatest reaction

  3. FlashQLA

    high-performance linear attention kernel library built on TileLang

    GitHub750 starsgithub.comLibraryOpen sourcelatest reaction

  4. attention-gym

    Helpful tools and examples for working with flex-attention

    GitHub1,264 starsgithub.comOpen sourcelatest reaction

  5. cuLA

    CUDA kernels for linear attention variants, written in CuTe DSL and CUTLASS C++.

    GitHub560 starsgithub.comOpen sourcelatest reaction