Examenos

45.8% · raw 45.78 %

Headline · unknown effort · Own vendor

Source/record date: 2026-08-25

IBM Granite 4.2 3B card (revision 4e9c275e232f), evaluation table row “τ³-bench (AVG)”, column “3B Dense”. IBM evaluates with a framework based on NVIDIA’s NeMo Evaluator SDK; thinking mode, effort, sampling and repeats for this table are unstated. Average over τ³-bench domains; domain mix unstated. A different τ³-bench row (50.99 / 66.34 / 68.05) is commented out of the card source and not displayed, so it is not stored. Execution date unpublished.

52.4% · raw 52.41 %

Headline · unknown effort · Own vendor

Source/record date: 2026-08-25

IBM Granite 4.2 3B card (revision 4e9c275e232f), evaluation table row “BFCL (v4)”, column “3B Dense”. IBM evaluates with a framework based on NVIDIA’s NeMo Evaluator SDK; thinking mode, effort, sampling and repeats for this table are unstated. Overall score as labelled. Execution date unpublished.

32.1% · raw 32.1 %

Headline · unknown effort · Own vendor

Source/record date: 2026-08-25

IBM Granite 4.2 3B card (revision 4e9c275e232f), evaluation table row “ProfBench”, column “3B Dense”. IBM evaluates with a framework based on NVIDIA’s NeMo Evaluator SDK; thinking mode, effort, sampling and repeats for this table are unstated. Search setting unstated. Execution date unpublished.

78.3% · raw 78.33 %

Headline · unknown effort · Own vendor

Source/record date: 2026-08-25

IBM Granite 4.2 3B card (revision 4e9c275e232f), evaluation table row “AIME25”, column “3B Dense”. IBM evaluates with a framework based on NVIDIA’s NeMo Evaluator SDK; thinking mode, effort, sampling and repeats for this table are unstated. Execution date unpublished.

66.7% · raw 66.67 %

Headline · unknown effort · Own vendor

Source/record date: 2026-08-25

IBM Granite 4.2 3B card (revision 4e9c275e232f), evaluation table row “HMMT Feb25”, column “3B Dense”. IBM evaluates with a framework based on NVIDIA’s NeMo Evaluator SDK; thinking mode, effort, sampling and repeats for this table are unstated. Execution date unpublished.

54.8% · raw 54.8 %

Headline · unknown effort · Own vendor

Source/record date: 2026-08-25

IBM Granite 4.2 3B card (revision 4e9c275e232f), evaluation table row “GPQA”, column “3B Dense”. IBM evaluates with a framework based on NVIDIA’s NeMo Evaluator SDK; thinking mode, effort, sampling and repeats for this table are unstated. GPQA subset unstated. Execution date unpublished.

69.7% · raw 69.71 %

Headline · unknown effort · Own vendor

Source/record date: 2026-08-25

IBM Granite 4.2 3B card (revision 4e9c275e232f), evaluation table row “LiveCodeBench v6”, column “3B Dense”. IBM evaluates with a framework based on NVIDIA’s NeMo Evaluator SDK; thinking mode, effort, sampling and repeats for this table are unstated. Execution date unpublished.

24.1% · raw 24.11 %

Headline · unknown effort · Own vendor

Source/record date: 2026-08-25

IBM Granite 4.2 3B card (revision 4e9c275e232f), evaluation table row “SciCode”, column “3B Dense”. IBM evaluates with a framework based on NVIDIA’s NeMo Evaluator SDK; thinking mode, effort, sampling and repeats for this table are unstated. Subproblem or main-problem aggregation unstated. Execution date unpublished.

67.8% · raw 67.84 %

Headline · unknown effort · Own vendor

Source/record date: 2026-08-25

IBM Granite 4.2 3B card (revision 4e9c275e232f), evaluation table row “MMLU-Pro”, column “3B Dense”. IBM evaluates with a framework based on NVIDIA’s NeMo Evaluator SDK; thinking mode, effort, sampling and repeats for this table are unstated. Execution date unpublished.

27.8% · raw 27.78 %

Headline · unknown effort · Own vendor

Source/record date: 2026-08-25

IBM Granite 4.2 3B card (revision 4e9c275e232f), evaluation table row “MMLU-ProX lite (IBM)”, column “3B Dense”. IBM evaluates with a framework based on NVIDIA’s NeMo Evaluator SDK; thinking mode, effort, sampling and repeats for this table are unstated. Languages unstated. Execution date unpublished.

35% · raw 34.96 %

Headline · unknown effort · Own vendor

Source/record date: 2026-08-25

IBM Granite 4.2 3B card (revision 4e9c275e232f), evaluation table row “Arena-Hard-V2”, column “3B Dense”. IBM evaluates with a framework based on NVIDIA’s NeMo Evaluator SDK; thinking mode, effort, sampling and repeats for this table are unstated. Judge, baseline and style control unstated. Execution date unpublished.

74.3% · raw 74.33 %

Headline · unknown effort · Own vendor

Source/record date: 2026-08-25

IBM Granite 4.2 3B card (revision 4e9c275e232f), evaluation table row “IFBench (prompt)”, column “3B Dense”. IBM evaluates with a framework based on NVIDIA’s NeMo Evaluator SDK; thinking mode, effort, sampling and repeats for this table are unstated. Prompt-level accuracy; strict or loose unstated. Execution date unpublished.

67.5% · raw 67.52 %

Headline · unknown effort · Own vendor

Source/record date: 2026-08-25

IBM Granite 4.2 3B card (revision 4e9c275e232f), evaluation table row “RULER 64K”, column “3B Dense”. IBM evaluates with a framework based on NVIDIA’s NeMo Evaluator SDK; thinking mode, effort, sampling and repeats for this table are unstated. Execution date unpublished.

55.3% · raw 55.3 %

Headline · unknown effort · Own vendor

Source/record date: 2026-08-25

IBM Granite 4.2 3B card (revision 4e9c275e232f), evaluation table row “RULER 128K”, column “3B Dense”. IBM evaluates with a framework based on NVIDIA’s NeMo Evaluator SDK; thinking mode, effort, sampling and repeats for this table are unstated. Execution date unpublished.

5 · raw 5 index

Headline · unknown effort · Independent evaluator

Source/record date: 2026-11-05

Intelligence Index v5.0.1 (AA changelog, 3 November 2026: v5.0 with CritPt v2 regraded); never compared with v5.0 or v4.3.2 rows. AA's label states no reasoning effort. Manual observation of Artificial Analysis's public Intelligence Index evaluation page (title "Artificial Analysis Intelligence Index v5.0.1"), "Artificial Analysis Intelligence Index: Score" chart, 5 November 2026 (106 configurations selected with ?models=; rendered bar label paired with the x-axis model link; research-raw/aa-v5.0.1-2026-11-05/cap_index_score.txt). Configuration "Granite 4.2 3B". AA's displayed rounding; no API, download, hidden precision or inferred run date.

34 k tokens/task · raw 34 k tokens/task

Headline · unknown effort · Independent evaluator

Source/record date: 2026-11-05

Thousands of output tokens per task as displayed. Observed on the v5.0.1 page; bound to Intelligence Index v5.0.1 and never compared with v5.0 rows (five of the stored v5.0 cost and token values differ on the v5.0.1 page). AA's label states no reasoning effort. Manual observation of Artificial Analysis's public Intelligence Index v5.0.1 evaluation page, "Output Tokens per Task" stacked chart (reasoning plus answer total label), 5 November 2026 (106 configurations selected with ?models=; rendered bar label paired with the x-axis model link; research-raw/aa-v5.0.1-2026-11-05/cap_index_tokens.txt). Configuration "Granite 4.2 3B". AA's displayed rounding; no API, download, hidden precision or inferred run date.

0% · raw 0 %

Headline · unknown effort · Independent evaluator

Source/record date: 2026-11-05

CritPt v2 hard subset as regraded by AA on 3 November 2026; not the full set or the earlier CritPt (AA) rows. AA's label states no reasoning effort. Manual observation of Artificial Analysis's public CritPt v2 evaluation page, "Hard Subset" view, after AA's 3 November 2026 regrade, 5 November 2026 (106 configurations selected with ?models=; rendered bar label paired with the x-axis model link; research-raw/aa-v5.0.1-2026-11-05/cap_critpt_v2_hard.txt). Configuration "Granite 4.2 3B". AA's displayed rounding; no API, download, hidden precision or inferred run date.

0.4% · raw 0.4 %

Headline · unknown effort · Independent evaluator

Source/record date: 2026-11-05

AA's label states no reasoning effort. Manual observation of Artificial Analysis's public AutomationBench-AA evaluation page, Score chart, 5 November 2026 (106 configurations selected with ?models=; rendered bar label paired with the x-axis model link; research-raw/aa-v5.0.1-2026-11-05/cap_automationbench.txt). Configuration "Granite 4.2 3B". AA's displayed rounding; no API, download, hidden precision or inferred run date.

99 · raw 99 Elo

Headline · unknown effort · Independent evaluator

Source/record date: 2026-11-05

AA's label states no reasoning effort. Manual observation of Artificial Analysis's public AA-Briefcase evaluation page, combined Elo chart, 5 November 2026 (106 configurations selected with ?models=; rendered bar label paired with the x-axis model link; research-raw/aa-v5.0.1-2026-11-05/cap_briefcase_elo.txt). Configuration "Granite 4.2 3B". AA's displayed rounding; no API, download, hidden precision or inferred run date.

0 · raw 0 Elo

Headline · unknown effort · Independent evaluator

Source/record date: 2026-11-05

AA's label states no reasoning effort. Manual observation of Artificial Analysis's public AA-Briefcase evaluation page, "Analytical Quality & Presentation Elo" tab (Analytical Quality series), 5 November 2026 (106 configurations selected with ?models=; rendered bar label paired with the x-axis model link; research-raw/aa-v5.0.1-2026-11-05/cap_briefcase_quality_presentation.txt). Configuration "Granite 4.2 3B". AA's displayed rounding; no API, download, hidden precision or inferred run date.

0 · raw 0 Elo

Headline · unknown effort · Independent evaluator

Source/record date: 2026-11-05

AA's label states no reasoning effort. Manual observation of Artificial Analysis's public AA-Briefcase evaluation page, "Analytical Quality & Presentation Elo" tab (Presentation series), 5 November 2026 (106 configurations selected with ?models=; rendered bar label paired with the x-axis model link; research-raw/aa-v5.0.1-2026-11-05/cap_briefcase_quality_presentation.txt). Configuration "Granite 4.2 3B". AA's displayed rounding; no API, download, hidden precision or inferred run date.

4.7% · raw 4.7 %

Headline · unknown effort · Independent evaluator

Source/record date: 2026-11-05

AA's label states no reasoning effort. Manual observation of Artificial Analysis's public AA-Briefcase evaluation page, "Rubric Score (%)" tab, 5 November 2026 (106 configurations selected with ?models=; rendered bar label paired with the x-axis model link; research-raw/aa-v5.0.1-2026-11-05/cap_briefcase_rubric.txt). Configuration "Granite 4.2 3B". AA's displayed rounding; no API, download, hidden precision or inferred run date.

-18 · raw -18 index

Headline · unknown effort · Independent evaluator

Source/record date: 2026-11-05

Signed knowledge index; v1.1 (3,000 questions) is not comparable with v1.0 rows. AA's label states no reasoning effort. Manual observation of Artificial Analysis's public AA-Omniscience evaluation page, "AA-Omniscience v1.1: Net Score" chart, 5 November 2026 (106 configurations selected with ?models=; rendered bar label paired with the x-axis model link; research-raw/aa-v5.0.1-2026-11-05/cap_omniscience.txt). Configuration "Granite 4.2 3B". AA's displayed rounding; no API, download, hidden precision or inferred run date.

9% · raw 9 %

Headline · unknown effort · Independent evaluator

Source/record date: 2026-11-05

Not comparable with v1.0 rows. AA's label states no reasoning effort. Manual observation of Artificial Analysis's public AA-Omniscience evaluation page, accuracy chart, 5 November 2026 (106 configurations selected with ?models=; rendered bar label paired with the x-axis model link; research-raw/aa-v5.0.1-2026-11-05/cap_omniscience.txt). Configuration "Granite 4.2 3B". AA's displayed rounding; no API, download, hidden precision or inferred run date.

30% · raw 30 %

Headline · unknown effort · Independent evaluator

Source/record date: 2026-11-05

Lower is better; not comparable with v1.0 rows. AA's label states no reasoning effort. Manual observation of Artificial Analysis's public AA-Omniscience evaluation page, hallucination rate chart, 5 November 2026 (106 configurations selected with ?models=; rendered bar label paired with the x-axis model link; research-raw/aa-v5.0.1-2026-11-05/cap_omniscience.txt). Configuration "Granite 4.2 3B". AA's displayed rounding; no API, download, hidden precision or inferred run date.

0% · raw 0 %

Headline · unknown effort · Independent evaluator

Source/record date: 2026-11-05

AA's label states no reasoning effort. Manual observation of Artificial Analysis's public Terminal-Bench-Science 0.1 evaluation page, Score chart, 5 November 2026 (106 configurations selected with ?models=; rendered bar label paired with the x-axis model link; research-raw/aa-v5.0.1-2026-11-05/cap_tbscience.txt). Configuration "Granite 4.2 3B". AA's displayed rounding; no API, download, hidden precision or inferred run date.

0% · raw 0 %

Headline · unknown effort · Independent evaluator

Source/record date: 2026-11-05

AA harness; not Cognition board rows. AA's label states no reasoning effort. Manual observation of Artificial Analysis's public FrontierCode 2.0 evaluation page, Score chart, 5 November 2026 (106 configurations selected with ?models=; rendered bar label paired with the x-axis model link; research-raw/aa-v5.0.1-2026-11-05/cap_frontiercode2.txt). Configuration "Granite 4.2 3B". AA's displayed rounding; no API, download, hidden precision or inferred run date.

2.9% · raw 2.9 %

Headline · unknown effort · Independent evaluator

Source/record date: 2026-11-05

Not Humanity's Last Exam (AA). AA's label states no reasoning effort. Manual observation of Artificial Analysis's public HLE-Diamond evaluation page, Score chart, 5 November 2026 (106 configurations selected with ?models=; rendered bar label paired with the x-axis model link; research-raw/aa-v5.0.1-2026-11-05/cap_hle_diamond.txt). Configuration "Granite 4.2 3B". AA's displayed rounding; no API, download, hidden precision or inferred run date.

0.2% · raw 0.2 %

Headline · unknown effort · Independent evaluator

Source/record date: 2026-11-05

AA's label states no reasoning effort. Manual observation of Artificial Analysis's public GDP.pdf evaluation page, "All-pass Rate" tab, 5 November 2026 (106 configurations selected with ?models=; rendered bar label paired with the x-axis model link; research-raw/aa-v5.0.1-2026-11-05/cap_gdppdf.txt). Configuration "Granite 4.2 3B". AA's displayed rounding; no API, download, hidden precision or inferred run date.

0% · raw 0 %

Headline · unknown effort · Independent evaluator

Source/record date: 2026-11-05

AA's label states no reasoning effort. Manual observation of Artificial Analysis's public Terminal-Bench 4.0 evaluation page, Score chart, 5 November 2026 (106 configurations selected with ?models=; rendered bar label paired with the x-axis model link; research-raw/aa-v5.0.1-2026-11-05/cap_tb4.txt). Configuration "Granite 4.2 3B". AA's displayed rounding; no API, download, hidden precision or inferred run date.