← Latest products

UL-SMF

Open-source linear-complexity ~300x KV-cache compression. The Unified Latent-State Memory Fabric (UL-SMF) is a hardware-software co-designed memory compression fabric that solves the memory bottleneck in long-context Transformer inference. By combining FSQ with dynamic 16-dimensional latent mapping, UL-SMF compresses Key-Value (KV) cache tensors by up to 384x while maintaining >94% semantic retention.

Open source

10 stars · GitHubexternal site

Visit github.comexternal site

Reactions (1)

Similar products

by description similarity

  1. UltraCompress

    github.com

    first mathematically lossless 5-bit LLM compression

    Hacker News6 pts

  2. Micro-RLE ≤264-byte compression for UART/MCU logs

    github.com

    zero RAM growth

    Hacker News7 pts

  3. Fixing LLM memory degradation in long coding sessions

    github.com

    Empirical proof of SOTA LLM (GPT-5/Gemini-Pro/Claude-Pro) context saturation in complex engineering. Contains the "Misuraca Protocol" for deterministic logical segmentation to prevent entropy drift.

    Hacker News5 pts

  4. Cuts Long Horizon Inference Costs by 50% via external KV Cache Offload

    github.com

    OpenLake is a high performance storage engine for efficient LLM inference and GPU Training

    Hacker News22 pts

  5. Kanzi

    github.com

    fast lossless data compression

    Hacker News15 pts