ExamenosThe benchmark library
Choose what to compare.
Browse by category, then open a benchmark to see every model’s results.
Data coverage
Choose a model to see which benchmarks have recorded results and which are missing.
Explore coverage → Explore changes by dateResults over time
Choose a benchmark, then drag its timeline to see the scores we had recorded at each date.
Open benchmark timelines →Source-linked benchmark results
DeepSWE v1.1
Long-horizon agentic software engineering on original tasks from active open-source repos (Datacurve DeepSWE).
34 / 57 models with results →Official / vendorGPQA Diamond
Graduate-level science QA
32 / 57 models with results →Official / vendorTerminal-Bench 2.1
Earlier Terminal-Bench agent suite (shorter/earlier protocol than 3.0/4.0); keep separate from later versions.
25 / 57 models with results →Official / vendorTerminal-Bench 4.0
Multi-hour agentic terminal/coding tasks: shell, tools, and long-running project work under a hard time budget.
21 / 57 models with results →Official / vendorAutomationBench v1.0.6
General agent automation across multi-step workflows (forms, apps, scripts) rather than pure coding.
20 / 57 models with results →Official / vendorJobBench
Job/task agent benchmark
18 / 57 models with results →Official / vendorτ³-bench Banking
Tau-3 Banking agentic evaluation (AA / vendor-cited).
18 / 57 models with results →Official / vendorAA Intelligence Index (vendor-cited)
Artificial Analysis Intelligence Index as cited by vendor blog
16 / 57 models with results →Official / vendorAgents' Last Exam
Hard multi-step agent exam stressing planning, tools, and failure recovery at the frontier.
16 / 57 models with results →Official / vendorHumanity's Last Exam (no tools)
HLE without tools
16 / 57 models with results →Official / vendorOSWorld 2.0
Computer-use / desktop agent: operate a real GUI environment to complete open-ended tasks (partial scores must be noted).
16 / 57 models with results →IndependentIntelligence Index · Artificial Analysis
Artificial Analysis Intelligence Index. Check each observation's publisher revision and configuration; older observations need not use the same revision. Exact execution dates and serving details may be unpublished. This is not a controlled time comparison.
36 / 57 models with results →IndependentVals Index (legacy, before v2.2) · Vals AI
Legacy Vals Index observations recorded before the v2.2 benchmark revision. Preserve these historical results separately: v2.2 changes components, test populations and grading. This is not a controlled before/after comparison with v2.2.
27 / 57 models with results →IndependentVals Index v2.2 · Vals AI
GDP-weighted aggregate with revised Finance v2.1, EMB v1.1, HLAB v1.1, Code Migration v1.1 and all-pass Tax. Old Index versions are not comparable. Source default includes provider-refusal fallback tasks for Opus/Sonnet; failure-controlled scores are separate.
19 / 57 models with results →IndependentBug Hunt Bench · Bugs fixed (105 total) · Bug Hunt Bench
Recorded Bugs fixed /105 measurements from Bug Hunt Bench, with source links, evaluation dates and available effort or harness records. Vendor results remain separate.
27 / 57 models with results →IndependentARC-AGI-2 · ARC Prize
ARC-AGI-2: harder successor to ARC-AGI-1 with more compositional, less brute-forceable grid tasks. Still few-shot rule induction on novel puzzles; designed to stay unsaturated as models saturate v1. ARC Prize reports Semi-Private verified %.
12 / 57 models with results →The interactive library loads every tracked metric. Browse public benchmark tables or model profiles.
| Provider | Published / checked | Evidence |
|---|