← Latest products

ML-Dev-Bench

Benchmarking AI Agents on Real-World AI Workflows. ML-Dev-Bench is a benchmark for evaluating AI agents against various ML development tasks. We’re excited to share ML-Dev-Bench, a new open-source benchmark that tests AI agents on real-world ML development tasks.

Open source

44 stars · GitHubexternal site

Visit github.comexternal site

Reactions (1)

Similar products

by description similarity

  1. Τ³-Bench is out

    news.ycombinator.com

    can agents handle complex docs and live calls?

    Hacker News12 pts

  2. BenchFlow

    github.com

    run AI benchmarks as an API

    Hacker News24 pts

  3. Benchmark your eng team's AI agent maturity in 5 minutes

    agent-benchmarks.com

    Benchmark your software engineering process and SDLC for AI-driven agent maturity. Compare against hundreds of teams and share your result.

    Hacker News14 pts

  4. Artificial Analysis tool to create custom benchmarks for any use case

    artificialanalysis.ai

    Turn your own tasks into a repeatable benchmark, run frontier models on it, and compare quality against cost per task. Bring your own dataset, agent trajectories, or your own agent.

    Hacker News11 pts

  5. AI SRE Arena

    github.com

    an Open Benchmark for AI SRE Agents on Kubernetes

    Hacker News24 pts