BenchFlow
run AI benchmarks as an API. Research infra for creating RL environments, post-training, and evals. I built BenchFlow, an open-source framework that lets you integrate and evaluate AI tasks using Docker-based benchmarks.
Open source
Reactions (1)
Similar products
by description similarity
Artificial Analysis tool to create custom benchmarks for any use case
artificialanalysis.aiTurn your own tasks into a repeatable benchmark, run frontier models on it, and compare quality against cost per task. Bring your own dataset, agent trajectories, or your own agent.
ControlFlow
github.comopen-source AI workflows
AI SRE Arena
github.coman Open Benchmark for AI SRE Agents on Kubernetes
Flow
github.comA dynamic task engine for building AI agents
Parsimony
parsimony.lasu.devan open-source benchmark for how much code AI models add