Examenos

30.8% · raw 30.78 %

Headline · unknown effort · Own vendor

Source/record date: 2026-08-25

IBM Granite 4.2 8B card (revision a7042144125c), evaluation table row “SWE Bench Multilingual”, column “8B Dense”. IBM evaluates with a framework based on NVIDIA’s NeMo Evaluator SDK; thinking mode, effort, sampling and repeats for this table are unstated. Agent harness unstated. Execution date unpublished.

19.1% · raw 19.11 %

Headline · unknown effort · Own vendor

Source/record date: 2026-08-25

IBM Granite 4.2 8B card (revision a7042144125c), evaluation table row “SWE Bench Pro”, column “8B Dense”. IBM evaluates with a framework based on NVIDIA’s NeMo Evaluator SDK; thinking mode, effort, sampling and repeats for this table are unstated. Agent harness and SWE-bench Pro revision unstated. Execution date unpublished.

47.7% · raw 47.67 %

Headline · unknown effort · Own vendor

Source/record date: 2026-08-25

IBM Granite 4.2 8B card (revision a7042144125c), evaluation table row “SWE Bench Verified”, column “8B Dense”. IBM evaluates with a framework based on NVIDIA’s NeMo Evaluator SDK; thinking mode, effort, sampling and repeats for this table are unstated. Agent harness unstated. Execution date unpublished.

20.6% · raw 20.56 %

Headline · unknown effort · Own vendor

Source/record date: 2026-08-25

IBM Granite 4.2 8B card (revision a7042144125c), evaluation table row “Terminal-Bench 2.1”, column “8B Dense”. IBM evaluates with a framework based on NVIDIA’s NeMo Evaluator SDK; thinking mode, effort, sampling and repeats for this table are unstated. Agent harness unstated. Execution date unpublished.

58.1% · raw 58.06 %

Headline · unknown effort · Own vendor

Source/record date: 2026-08-25

IBM Granite 4.2 8B card (revision a7042144125c), evaluation table row “τ³-bench (AVG)”, column “8B Dense”. IBM evaluates with a framework based on NVIDIA’s NeMo Evaluator SDK; thinking mode, effort, sampling and repeats for this table are unstated. Average over τ³-bench domains; domain mix unstated. A different τ³-bench row (50.99 / 66.34 / 68.05) is commented out of the card source and not displayed, so it is not stored. Execution date unpublished.

52.4% · raw 52.39 %

Headline · unknown effort · Own vendor

Source/record date: 2026-08-25

IBM Granite 4.2 8B card (revision a7042144125c), evaluation table row “BFCL (v4)”, column “8B Dense”. IBM evaluates with a framework based on NVIDIA’s NeMo Evaluator SDK; thinking mode, effort, sampling and repeats for this table are unstated. Overall score as labelled. Execution date unpublished.

50.3% · raw 50.29 %

Alternative · unknown effort · Own vendor

Source/record date: 2026-08-25

IBM’s Granite 4.2 Hugging Face blog (25 August 2026), results table row “BFCL (v4)”, column 8B: 50.29, where the 8B card prints 52.39. The blog does not explain the difference; kept as an alternative. Thinking mode, effort and harness unstated. Non-headline: the first-party row (52.39, https://huggingface.co/ibm-granite/granite-4.2-8b) holds this cell.

41.2% · raw 41.2 %

Headline · unknown effort · Own vendor

Source/record date: 2026-08-25

IBM Granite 4.2 8B card (revision a7042144125c), evaluation table row “ProfBench”, column “8B Dense”. IBM evaluates with a framework based on NVIDIA’s NeMo Evaluator SDK; thinking mode, effort, sampling and repeats for this table are unstated. Search setting unstated. Execution date unpublished.

41.1% · raw 41.07 %

Headline · unknown effort · Own vendor

Source/record date: 2026-08-25

IBM Granite 4.2 8B card (revision a7042144125c), evaluation table row “BirdBench”, column “8B Dense”. IBM evaluates with a framework based on NVIDIA’s NeMo Evaluator SDK; thinking mode, effort, sampling and repeats for this table are unstated. BIRD text-to-SQL; split and metric unstated. Execution date unpublished.

1189 score · raw 1189 score

Headline · unknown effort · Own vendor

Source/record date: 2026-08-25

IBM Granite 4.2 8B card (revision a7042144125c), evaluation table row “GDPval”, column “8B Dense”. IBM evaluates with a framework based on NVIDIA’s NeMo Evaluator SDK; thinking mode, effort, sampling and repeats for this table are unstated. Elo-like score; judge, reference deliverables and harness unstated. Execution date unpublished.

86.7% · raw 86.67 %

Headline · unknown effort · Own vendor

Source/record date: 2026-08-25

IBM Granite 4.2 8B card (revision a7042144125c), evaluation table row “AIME25”, column “8B Dense”. IBM evaluates with a framework based on NVIDIA’s NeMo Evaluator SDK; thinking mode, effort, sampling and repeats for this table are unstated. Execution date unpublished.

78.3% · raw 78.33 %

Headline · unknown effort · Own vendor

Source/record date: 2026-08-25

IBM Granite 4.2 8B card (revision a7042144125c), evaluation table row “HMMT Feb25”, column “8B Dense”. IBM evaluates with a framework based on NVIDIA’s NeMo Evaluator SDK; thinking mode, effort, sampling and repeats for this table are unstated. Execution date unpublished.

64.1% · raw 64.14 %

Headline · unknown effort · Own vendor

Source/record date: 2026-08-25

IBM Granite 4.2 8B card (revision a7042144125c), evaluation table row “GPQA”, column “8B Dense”. IBM evaluates with a framework based on NVIDIA’s NeMo Evaluator SDK; thinking mode, effort, sampling and repeats for this table are unstated. GPQA subset unstated. Execution date unpublished.

73.2% · raw 73.24 %

Headline · unknown effort · Own vendor

Source/record date: 2026-08-25

IBM Granite 4.2 8B card (revision a7042144125c), evaluation table row “LiveCodeBench v6”, column “8B Dense”. IBM evaluates with a framework based on NVIDIA’s NeMo Evaluator SDK; thinking mode, effort, sampling and repeats for this table are unstated. Execution date unpublished.

36.1% · raw 36.09 %

Headline · unknown effort · Own vendor

Source/record date: 2026-08-25

IBM Granite 4.2 8B card (revision a7042144125c), evaluation table row “SciCode”, column “8B Dense”. IBM evaluates with a framework based on NVIDIA’s NeMo Evaluator SDK; thinking mode, effort, sampling and repeats for this table are unstated. Subproblem or main-problem aggregation unstated. Execution date unpublished.

74% · raw 74.04 %

Headline · unknown effort · Own vendor

Source/record date: 2026-08-25

IBM Granite 4.2 8B card (revision a7042144125c), evaluation table row “MMLU-Pro”, column “8B Dense”. IBM evaluates with a framework based on NVIDIA’s NeMo Evaluator SDK; thinking mode, effort, sampling and repeats for this table are unstated. Execution date unpublished.

61.1% · raw 61.06 %

Headline · unknown effort · Own vendor

Source/record date: 2026-08-25

IBM Granite 4.2 8B card (revision a7042144125c), evaluation table row “MMLU-ProX lite (IBM)”, column “8B Dense”. IBM evaluates with a framework based on NVIDIA’s NeMo Evaluator SDK; thinking mode, effort, sampling and repeats for this table are unstated. Languages unstated. Execution date unpublished.

65.2% · raw 65.19 %

Headline · unknown effort · Own vendor

Source/record date: 2026-08-25

IBM Granite 4.2 8B card (revision a7042144125c), evaluation table row “Arena-Hard-V2”, column “8B Dense”. IBM evaluates with a framework based on NVIDIA’s NeMo Evaluator SDK; thinking mode, effort, sampling and repeats for this table are unstated. Judge, baseline and style control unstated. Execution date unpublished.

79.3% · raw 79.33 %

Headline · unknown effort · Own vendor

Source/record date: 2026-08-25

IBM Granite 4.2 8B card (revision a7042144125c), evaluation table row “IFBench (prompt)”, column “8B Dense”. IBM evaluates with a framework based on NVIDIA’s NeMo Evaluator SDK; thinking mode, effort, sampling and repeats for this table are unstated. Prompt-level accuracy; strict or loose unstated. Execution date unpublished.

81% · raw 80.99 %

Headline · unknown effort · Own vendor

Source/record date: 2026-08-25

IBM Granite 4.2 8B card (revision a7042144125c), evaluation table row “RULER 64K”, column “8B Dense”. IBM evaluates with a framework based on NVIDIA’s NeMo Evaluator SDK; thinking mode, effort, sampling and repeats for this table are unstated. Execution date unpublished.

71.4% · raw 71.41 %

Headline · unknown effort · Own vendor

Source/record date: 2026-08-25

IBM Granite 4.2 8B card (revision a7042144125c), evaluation table row “RULER 128K”, column “8B Dense”. IBM evaluates with a framework based on NVIDIA’s NeMo Evaluator SDK; thinking mode, effort, sampling and repeats for this table are unstated. Execution date unpublished.

5 · raw 5 index

Headline · unknown effort · Independent evaluator

Source/record date: 2026-11-05

Intelligence Index v5.0.1 (AA changelog, 3 November 2026: v5.0 with CritPt v2 regraded); never compared with v5.0 or v4.3.2 rows. AA's label states no reasoning effort. Manual observation of Artificial Analysis's public Intelligence Index evaluation page (title "Artificial Analysis Intelligence Index v5.0.1"), "Artificial Analysis Intelligence Index: Score" chart, 5 November 2026 (106 configurations selected with ?models=; rendered bar label paired with the x-axis model link; research-raw/aa-v5.0.1-2026-11-05/cap_index_score.txt). Configuration "Granite 4.2 8B". AA's displayed rounding; no API, download, hidden precision or inferred run date.

$0.04/task · raw 0.04 USD/task

Headline · unknown effort · Independent evaluator

Source/record date: 2026-11-05

AA usage-priced cost per task at its list pricing; not an API tariff or invoice. Observed on the v5.0.1 page; bound to Intelligence Index v5.0.1 and never compared with v5.0 rows (five of the stored v5.0 cost and token values differ on the v5.0.1 page). AA's label states no reasoning effort. Manual observation of Artificial Analysis's public Intelligence Index v5.0.1 evaluation page, "Cost per Intelligence Index Task" stacked chart (total label), 5 November 2026 (106 configurations selected with ?models=; rendered bar label paired with the x-axis model link; research-raw/aa-v5.0.1-2026-11-05/cap_index_cost.txt). Configuration "Granite 4.2 8B". AA's displayed rounding; no API, download, hidden precision or inferred run date.

52 k tokens/task · raw 52 k tokens/task

Headline · unknown effort · Independent evaluator

Source/record date: 2026-11-05

Thousands of output tokens per task as displayed. Observed on the v5.0.1 page; bound to Intelligence Index v5.0.1 and never compared with v5.0 rows (five of the stored v5.0 cost and token values differ on the v5.0.1 page). AA's label states no reasoning effort. Manual observation of Artificial Analysis's public Intelligence Index v5.0.1 evaluation page, "Output Tokens per Task" stacked chart (reasoning plus answer total label), 5 November 2026 (106 configurations selected with ?models=; rendered bar label paired with the x-axis model link; research-raw/aa-v5.0.1-2026-11-05/cap_index_tokens.txt). Configuration "Granite 4.2 8B". AA's displayed rounding; no API, download, hidden precision or inferred run date.

0% · raw 0 %

Headline · unknown effort · Independent evaluator

Source/record date: 2026-11-05

CritPt v2 hard subset as regraded by AA on 3 November 2026; not the full set or the earlier CritPt (AA) rows. AA's label states no reasoning effort. Manual observation of Artificial Analysis's public CritPt v2 evaluation page, "Hard Subset" view, after AA's 3 November 2026 regrade, 5 November 2026 (106 configurations selected with ?models=; rendered bar label paired with the x-axis model link; research-raw/aa-v5.0.1-2026-11-05/cap_critpt_v2_hard.txt). Configuration "Granite 4.2 8B". AA's displayed rounding; no API, download, hidden precision or inferred run date.

2.1% · raw 2.1 %

Headline · unknown effort · Independent evaluator

Source/record date: 2026-11-05

AA's label states no reasoning effort. Manual observation of Artificial Analysis's public AutomationBench-AA evaluation page, Score chart, 5 November 2026 (106 configurations selected with ?models=; rendered bar label paired with the x-axis model link; research-raw/aa-v5.0.1-2026-11-05/cap_automationbench.txt). Configuration "Granite 4.2 8B". AA's displayed rounding; no API, download, hidden precision or inferred run date.

310 · raw 310 Elo

Headline · unknown effort · Independent evaluator

Source/record date: 2026-11-05

AA's label states no reasoning effort. Manual observation of Artificial Analysis's public AA-Briefcase evaluation page, combined Elo chart, 5 November 2026 (106 configurations selected with ?models=; rendered bar label paired with the x-axis model link; research-raw/aa-v5.0.1-2026-11-05/cap_briefcase_elo.txt). Configuration "Granite 4.2 8B". AA's displayed rounding; no API, download, hidden precision or inferred run date.

155 · raw 155 Elo

Headline · unknown effort · Independent evaluator

Source/record date: 2026-11-05

AA's label states no reasoning effort. Manual observation of Artificial Analysis's public AA-Briefcase evaluation page, "Analytical Quality & Presentation Elo" tab (Analytical Quality series), 5 November 2026 (106 configurations selected with ?models=; rendered bar label paired with the x-axis model link; research-raw/aa-v5.0.1-2026-11-05/cap_briefcase_quality_presentation.txt). Configuration "Granite 4.2 8B". AA's displayed rounding; no API, download, hidden precision or inferred run date.

137 · raw 137 Elo

Headline · unknown effort · Independent evaluator

Source/record date: 2026-11-05

AA's label states no reasoning effort. Manual observation of Artificial Analysis's public AA-Briefcase evaluation page, "Analytical Quality & Presentation Elo" tab (Presentation series), 5 November 2026 (106 configurations selected with ?models=; rendered bar label paired with the x-axis model link; research-raw/aa-v5.0.1-2026-11-05/cap_briefcase_quality_presentation.txt). Configuration "Granite 4.2 8B". AA's displayed rounding; no API, download, hidden precision or inferred run date.

7.3% · raw 7.3 %

Headline · unknown effort · Independent evaluator

Source/record date: 2026-11-05

AA's label states no reasoning effort. Manual observation of Artificial Analysis's public AA-Briefcase evaluation page, "Rubric Score (%)" tab, 5 November 2026 (106 configurations selected with ?models=; rendered bar label paired with the x-axis model link; research-raw/aa-v5.0.1-2026-11-05/cap_briefcase_rubric.txt). Configuration "Granite 4.2 8B". AA's displayed rounding; no API, download, hidden precision or inferred run date.

-17 · raw -17 index

Headline · unknown effort · Independent evaluator

Source/record date: 2026-11-05

Signed knowledge index; v1.1 (3,000 questions) is not comparable with v1.0 rows. AA's label states no reasoning effort. Manual observation of Artificial Analysis's public AA-Omniscience evaluation page, "AA-Omniscience v1.1: Net Score" chart, 5 November 2026 (106 configurations selected with ?models=; rendered bar label paired with the x-axis model link; research-raw/aa-v5.0.1-2026-11-05/cap_omniscience.txt). Configuration "Granite 4.2 8B". AA's displayed rounding; no API, download, hidden precision or inferred run date.

12% · raw 12 %

Headline · unknown effort · Independent evaluator

Source/record date: 2026-11-05

Not comparable with v1.0 rows. AA's label states no reasoning effort. Manual observation of Artificial Analysis's public AA-Omniscience evaluation page, accuracy chart, 5 November 2026 (106 configurations selected with ?models=; rendered bar label paired with the x-axis model link; research-raw/aa-v5.0.1-2026-11-05/cap_omniscience.txt). Configuration "Granite 4.2 8B". AA's displayed rounding; no API, download, hidden precision or inferred run date.

32% · raw 32 %

Headline · unknown effort · Independent evaluator

Source/record date: 2026-11-05

Lower is better; not comparable with v1.0 rows. AA's label states no reasoning effort. Manual observation of Artificial Analysis's public AA-Omniscience evaluation page, hallucination rate chart, 5 November 2026 (106 configurations selected with ?models=; rendered bar label paired with the x-axis model link; research-raw/aa-v5.0.1-2026-11-05/cap_omniscience.txt). Configuration "Granite 4.2 8B". AA's displayed rounding; no API, download, hidden precision or inferred run date.

0% · raw 0 %

Headline · unknown effort · Independent evaluator

Source/record date: 2026-11-05

AA's label states no reasoning effort. Manual observation of Artificial Analysis's public Terminal-Bench-Science 0.1 evaluation page, Score chart, 5 November 2026 (106 configurations selected with ?models=; rendered bar label paired with the x-axis model link; research-raw/aa-v5.0.1-2026-11-05/cap_tbscience.txt). Configuration "Granite 4.2 8B". AA's displayed rounding; no API, download, hidden precision or inferred run date.

0% · raw 0 %

Headline · unknown effort · Independent evaluator

Source/record date: 2026-11-05

AA harness; not Cognition board rows. AA's label states no reasoning effort. Manual observation of Artificial Analysis's public FrontierCode 2.0 evaluation page, Score chart, 5 November 2026 (106 configurations selected with ?models=; rendered bar label paired with the x-axis model link; research-raw/aa-v5.0.1-2026-11-05/cap_frontiercode2.txt). Configuration "Granite 4.2 8B". AA's displayed rounding; no API, download, hidden precision or inferred run date.

4% · raw 4 %

Headline · unknown effort · Independent evaluator

Source/record date: 2026-11-05

Not Humanity's Last Exam (AA). AA's label states no reasoning effort. Manual observation of Artificial Analysis's public HLE-Diamond evaluation page, Score chart, 5 November 2026 (106 configurations selected with ?models=; rendered bar label paired with the x-axis model link; research-raw/aa-v5.0.1-2026-11-05/cap_hle_diamond.txt). Configuration "Granite 4.2 8B". AA's displayed rounding; no API, download, hidden precision or inferred run date.

0.6% · raw 0.6 %

Headline · unknown effort · Independent evaluator

Source/record date: 2026-11-05

AA's label states no reasoning effort. Manual observation of Artificial Analysis's public GDP.pdf evaluation page, "All-pass Rate" tab, 5 November 2026 (106 configurations selected with ?models=; rendered bar label paired with the x-axis model link; research-raw/aa-v5.0.1-2026-11-05/cap_gdppdf.txt). Configuration "Granite 4.2 8B". AA's displayed rounding; no API, download, hidden precision or inferred run date.

0% · raw 0 %

Headline · unknown effort · Independent evaluator

Source/record date: 2026-11-05

AA's label states no reasoning effort. Manual observation of Artificial Analysis's public Terminal-Bench 4.0 evaluation page, Score chart, 5 November 2026 (106 configurations selected with ?models=; rendered bar label paired with the x-axis model link; research-raw/aa-v5.0.1-2026-11-05/cap_tb4.txt). Configuration "Granite 4.2 8B". AA's displayed rounding; no API, download, hidden precision or inferred run date.

51 tok/s · raw 51 tok/s

Headline · unknown effort · Independent evaluator

Source/record date: 2026-11-05

AA Performance Benchmarking v3.0.0 (3 November 2026): output tokens, including reasoning tokens, per second over the whole request including time to first token, averaged over the past 5 days for each workload (single-request and multi-turn agentic) and then across workloads; the model's first-party API, or the median across providers where there is none. A rolling observation; not the earlier "Output speed" rows. AA's label states no reasoning effort. Manual observation of Artificial Analysis's public Muse Spark 1.3 model page, Performance section "Output Speed" chart (Performance Benchmarking v3.0.0; the same ?models= selection), 5 November 2026 (106 configurations selected with ?models=; rendered bar label paired with the x-axis model link; research-raw/aa-v5.0.1-2026-11-05/cap_output_speed_v3.txt). Configuration "Granite 4.2 8B". AA's displayed rounding; no API, download, hidden precision or inferred run date.