← Latest products

WaveletLM

wavelet-based, attention-free model with O(n log n) scaling. WaveletLM. WaveletLM is a wavelet-based, attention-free architecture that replaces self-attention with learned lifting wavelet decomposition, a Fast Walsh-Hadamard Transform, per-scale gated spectral mixing with SwiGLU activation, an inverse FWHT, and wavelet reconstruction.

Open source

2 stars · GitHubexternal site

Visit github.comexternal site

Reactions (1)

Similar products

by description similarity

  1. High-Performance Wavelet Matrix for Python, Implemented in Rust

    pypi.org

    I built a Rust-powered Wavelet Matrix library for Python.

    Hacker News93 pts

  2. Wavelr

    wavelr.com

    AI-native Decision Intelligence for renewable investments

    Product Hunt73 votes

  3. Trim Transformer

    github.com

    A transformer for physics models

    Hacker News10 pts

  4. Open-source model and scorecard for measuring hallucinations in LLMs

    vectara.com

    This morning, we released a new Apache 2.0 licensed model on HuggingFace for detecting hallucinations in retrieval augmented generation (RAG) systems.

    Hacker News65 pts

  5. Compress vision-language and unimodal AI models by structured pruning

    github.com

    [ICML 2023] UPop: Unified and Progressive Pruning for Compressing Vision-Language Transformers

    Hacker News7 pts