← 최신 프로덕트

Faster LLM evaluation with Bayesian optimization

Bayesian Optimization as a Coverage Tool for Evaluating LLMs. Accurate evaluation (benchmarking) that's 10 times faster with just a few lines of modular code. Recently I've been working on making LLM evaluations fast by using bayesian optimization to select a sensible subset.

오픈소스

288 스타 · GitHub외부 사이트

github.com 방문외부 사이트

반응 (1)

비슷한 프로덕트

설명이 비슷한 순

  1. Speeding up LLM inference 2x times (possibly)

    asciinema.org

    Here's a project I've been working on for the last few months.

    Hacker News419점

  2. 10x better performance from the Coding Harnesses with LLM-wiki

    llm-wiki.net

    Hacker News16점

  3. A new benchmark for testing LLMs for deterministic outputs

    interfaze.ai

    A multi-source LLM benchmark across text, image, and audio that measures JSON value accuracy per field, not just schema compliance. 7 metrics, full leaderboard.

    Hacker News60점

  4. Automatic prompt optimizer for LLMs

    promptperfect.jina.ai

    Hacker News126점

  5. LocalScore

    localscore.ai

    Local LLM Benchmark

    Hacker News124점