New Benchmark from SWE-bench team is 0% solved
ProgramBench evaluates whether language models can rebuild programs from scratch.

반응 (1)
비슷한 프로덕트
설명이 비슷한 순
Cheddar-bench
github.comunsupervised benchmark for coding agents
Mandelbrot
easylang.devprogrammed in widely unknown Easylang, speeded up by WASM
SOCBench
github.coman open benchmark for AI on SoC tasks
CodeClash: Benchmarking Goal-Oriented Software Engineering
Benchmark
swesweep.comAI doesn't find bugs unless you tell it what's wrong