← Latest products

Bypassing Transformer Softmax via Static Contraction

A JAX XLA-powered PoC that leverages branchless mathematical primitives to bypass the memory and execution bottlenecks of LLM softmax operations.

Open source

1 stars · GitHubexternal site

Visit github.comexternal site

Reactions (1)

Similar products

by description similarity

  1. UltraCompress

    github.com

    first mathematically lossless 5-bit LLM compression

    Hacker News6 pts

  2. X

    github.com

    A programming language with switchable memory modes

    Hacker News5 pts

  3. B-IR

    github.com

    An LLM-optimized programming language

    Hacker News62 pts

  4. A new Bluebook implementation of the Smalltalk-80 VM

    github.com

    A compiler and IDE for the Luon programming language - a liaison beween Lua and Oberon+ - targeting LuaJIT

    Hacker News11 pts

  5. A Tiny Compiler for a Tiny Functional Language

    github.com

    Compiler Backend for LSTS (High-Level Typed Macro Assembler)

    Hacker News8 pts