← 최신 프로덕트

WaveletLM

wavelet-based, attention-free model with O(n log n) scaling. WaveletLM. WaveletLM is a wavelet-based, attention-free architecture that replaces self-attention with learned lifting wavelet decomposition, a Fast Walsh-Hadamard Transform, per-scale gated spectral mixing with SwiGLU activation, an inverse FWHT, and wavelet reconstruction.

오픈소스

2 스타 · GitHub외부 사이트

github.com 방문외부 사이트

반응 (1)

비슷한 프로덕트

설명이 비슷한 순

  1. High-Performance Wavelet Matrix for Python, Implemented in Rust

    pypi.org

    I built a Rust-powered Wavelet Matrix library for Python.

    Hacker News93점

  2. Wavelr

    wavelr.com

    AI-native Decision Intelligence for renewable investments

    Product Hunt추천 73

  3. Trim Transformer

    github.com

    A transformer for physics models

    Hacker News10점

  4. Open-source model and scorecard for measuring hallucinations in LLMs

    vectara.com

    This morning, we released a new Apache 2.0 licensed model on HuggingFace for detecting hallucinations in retrieval augmented generation (RAG) systems.

    Hacker News65점

  5. Compress vision-language and unimodal AI models by structured pruning

    github.com

    [ICML 2023] UPop: Unified and Progressive Pruning for Compressing Vision-Language Transformers

    Hacker News7점