Faster LLM evaluation with Bayesian optimization
Bayesian Optimization as a Coverage Tool for Evaluating LLMs. Accurate evaluation (benchmarking) that's 10 times faster with just a few lines of modular code. Recently I've been working on making LLM evaluations fast by using bayesian optimization to select a sensible subset.
Open source
Reactions (1)
Similar products
by description similarity
Speeding up LLM inference 2x times (possibly)
asciinema.orgHere's a project I've been working on for the last few months.
A multi-source LLM benchmark across text, image, and audio that measures JSON value accuracy per field, not just schema compliance. 7 metrics, full leaderboard.
Automatic prompt optimizer for LLMs
promptperfect.jina.aiLocalScore
localscore.aiLocal LLM Benchmark