← Latest products

Semantic Overlays

an NX bit for LLM prompt injection (live demo). Tiny adapters added to a frozen language model. They only fire at marked token positions, and they change how the model perceives those spans. I've built a new method for steering LLMs called Semantic Overlays, small trained adapters on a frozen model which change how it perceives a piece of its context.

Visit semantic-overlays.vercel.appexternal site

Reactions (1)

Similar products

by description similarity

  1. A CLI tool for managing and comparing LLM prompts using semantic diffing instead of traditional text-based comparison.

    Hacker News7 pts

  2. A ~9M parameter LLM that talks like a small fish.

    Hacker News915 pts

  3. A protocol for sharing knowledge via semantic lookup with use in LLMs

    Hacker News10 pts

  4. LLM

    github.com

    a Rust Crate/CLI for CPU Inference of LLMs (LLaMA, GPT-NeoX, etc.)

    Hacker News45 pts

  5. Enables small-to-large self-hosted ai models to use local source code when running tool-calling agentic workloads. We actively data mine 20,900+ (2+ TB) popular github repos using large and small ai models to create reuseable: json, markdown and parquet files for local-first tool-calling models.

    Hacker News9 pts