← 최신 프로덕트

LLM Deceptiveness and Gullibility Benchmark

Benchmark evaluating LLMs on their ability to create and resist disinformation. Includes comprehensive testing across major models (Claude, GPT-4, Gemini, Llama, etc.) with standardized evaluation metrics.

오픈소스

36 스타 · GitHub외부 사이트

github.com 방문외부 사이트

반응 (1)

비슷한 프로덕트

설명이 비슷한 순

  1. A new benchmark for testing LLMs for deterministic outputs

    interfaze.ai

    A multi-source LLM benchmark across text, image, and audio that measures JSON value accuracy per field, not just schema compliance. 7 metrics, full leaderboard.

    Hacker News60점

  2. New LLM outperforming GPT-3.5

    news.ycombinator.com

    Refuel LLM (84.2%) outperforms trained human annotators (80.4%), GPT-3-5-turbo (81.3%), PaLM-2 (82.3%) and Claude (79.3%) across a benchmark of 15 text labeling datasets.

    Hacker News6점

  3. A tool to benchmark LLM APIs (OpenAI

    llmapitest.com

    Claude, local/self-hosted)

    Hacker News55점

  4. LLM Thematic Generalization Benchmark

    github.com

    Thematic Generalization Benchmark: measures how effectively various LLMs can infer a narrow or specific "theme" (category/rule) from a small set of examples and anti-examples, then detect which item truly fits that theme among a collection of misleading candidates.

    Hacker News6점

  5. Pencil Puzzle Bench

    ppbench.com

    LLM Benchmark for Multi-Step Verifiable Reasoning

    Hacker News5점