← Latest products

Artificial Analysis tool to create custom benchmarks for any use case

Turn your own tasks into a repeatable benchmark, run frontier models on it, and compare quality against cost per task. Bring your own dataset, agent trajectories, or your own agent.

Visit artificialanalysis.aiexternal site

Reactions (1)

Similar products

by description similarity

  1. BenchFlow

    github.com

    run AI benchmarks as an API

    Hacker News24 pts

  2. DesignArena

    designarena.ai

    crowdsourced benchmark for AI-generated UI/UX

    Hacker News89 pts

  3. Benchgraph

    news.ycombinator.com

    Run graph database benchmark on your own dataset

    Hacker News11 pts

  4. A tool to benchmark LLM APIs (OpenAI

    llmapitest.com

    Claude, local/self-hosted)

    Hacker News55 pts

  5. Τ³-Bench is out

    news.ycombinator.com

    can agents handle complex docs and live calls?

    Hacker News12 pts