← Latest products

Overfitted a 900KB Transformer to Compress a 100MB CSV into 7MB

I built an experiment that uses an overfitted transformer and arithmetic coding to compress individual files.

Visit news.ycombinator.comexternal site

Reactions (1)

Similar products

by description similarity

  1. Insights AI

    vairflow.ai

    Your AI-Powered Junior Data Analyst

    Hacker News5 pts

  2. Compressing a Histogram from 16GB to 2KB

    alexkranias.com

    Thought I'd dive into this cool streaming/approximation algorithms problem I encountered a few months ago.

    Hacker News5 pts

  3. Plik

    tycho.sytes.net

    a tiny FUSE filesystem with compression and deduplication

    Hacker News5 pts

  4. Compression-Resistant Data Transfers

    github.com

    Experiments that involve encoding arbitrary data into video files that survive Youtube compression.

    Hacker News29 pts

  5. ExANS

    theopenlake.com

    Lossless KV cache compression at 622 GB/s on H100

    Hacker News15 pts