← Latest products

Promptfoo

CLI for testing & improving LLM prompt quality. Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.

CLIOpen source

26,683 stars · GitHubexternal site

Visit github.comexternal site

Reactions (1)

Similar products

by description similarity

  1. Prompt-Engineering Tool

    github.com

    AI-to-AI Testing for LLM

    Hacker News37 pts

  2. Deadend CLI

    github.com

    Open-source self-hosted agentic pentest tooling

    Hacker News18 pts

  3. PromptTools

    github.com

    open-source tools for evaluating LLMs and vector DBs

    Hacker News211 pts

  4. Promptr

    github.com

    let GPT operate on your codebase and other useful goodies

    Hacker News109 pts

  5. Relari

    news.ycombinator.com

    Auto Prompt Optimizer as Lightweight Alternative to Finetuning

    Hacker News32 pts