← Trending

Tangerine Index lists products launched since ChatGPT and people's reactions to them.

native-sparse-attention-pytorch

github.com

Implementation of the sparse attention pattern proposed by the Deepseek team in their "Native Sparse Attention" paper

Open source

Visit github.comexternal siteGitHub816 starsexternal site

Reactions (1)

Similar products

by description similarity

  1. flash-sparse-attention

    Trainable fast and memory-efficient sparse attention

    GitHub747 starsgithub.comOpen sourcelatest reaction

  2. Block-Sparse-Attention

    A sparse attention kernel supporting mix sparse patterns

    GitHub566 starsgithub.comOpen sourcelatest reaction

  3. ring-attention-pytorch

    Implementation of 💍 Ring Attention, from Liu et al. at Berkeley AI, in Pytorch

    GitHub548 starsgithub.comOpen sourcelatest reaction

  4. FlashQLA

    high-performance linear attention kernel library built on TileLang

    GitHub750 starsgithub.comLibraryOpen sourcelatest reaction

  5. cuLA

    CUDA kernels for linear attention variants, written in CuTe DSL and CUTLASS C++.

    GitHub560 starsgithub.comOpen sourcelatest reaction