Examenos

63.3 score · raw 63.3 score

Headline · high effort · Own vendor

Source/record date: 2026-10-20

Harness: SparkLLM own run at thinking high per its card, temperature 1.0, top_p 0.95; exact label “Average” in the card figure. Self-reported; run date unpublished.

71.8% · raw 71.8 %

Headline · high effort · Own vendor

Source/record date: 2026-10-20

Harness: SparkLLM own run at thinking high per its card, temperature 1.0, top_p 0.95; exact label “BFCL-V4” in the card figure. Self-reported; run date unpublished.

86.9% · raw 86.9 %

Headline · high effort · Own vendor

Source/record date: 2026-10-20

Harness: SparkLLM own run at thinking high per its card, temperature 1.0, top_p 0.95; exact label “τ²-bench” in the card figure. Self-reported; run date unpublished.

34.7% · raw 34.7 %

Headline · high effort · Own vendor

Source/record date: 2026-10-20

Harness: SparkLLM own run at thinking high per its card, temperature 1.0, top_p 0.95; exact label “τ³-bench” in the card figure. Self-reported; run date unpublished. The 4B figure labels this τ³-bench; the 1.7B figure labels it τ³-bench Banking with the same 4B reference value.

30.8% · raw 30.8 %

Headline · high effort · Own vendor

Source/record date: 2026-10-20

Harness: SparkLLM own run at thinking high per its card, temperature 1.0, top_p 0.95; exact label “VitaBench2.0” in the card figure. Self-reported; run date unpublished.

62.4% · raw 62.4 %

Headline · high effort · Own vendor

Source/record date: 2026-10-20

Harness: SparkLLM own run at thinking high per its card, temperature 1.0, top_p 0.95; exact label “MCP-Atlas” in the card figure. Self-reported; run date unpublished.

33.6% · raw 33.6 %

Headline · high effort · Own vendor

Source/record date: 2026-10-20

Harness: SparkLLM own run at thinking high per its card, temperature 1.0, top_p 0.95; exact label “EnterpriseOps-Gym” in the card figure. Self-reported; run date unpublished.

69.9% · raw 69.9 %

Headline · high effort · Own vendor

Source/record date: 2026-10-20

Harness: SparkLLM own run at thinking high per its card, temperature 1.0, top_p 0.95; exact label “ClawEval-EN” in the card figure. Self-reported; run date unpublished.

53.1% · raw 53.1 %

Headline · high effort · Own vendor

Source/record date: 2026-10-20

Harness: SparkLLM own run at thinking high per its card, temperature 1.0, top_p 0.95; exact label “BrowseComp” in the card figure. Self-reported; run date unpublished.

71.7% · raw 71.7 %

Headline · high effort · Own vendor

Source/record date: 2026-10-20

Harness: SparkLLM own run at thinking high per its card, temperature 1.0, top_p 0.95; exact label “SWebBench” in the card figure. Self-reported; run date unpublished.

74.1% · raw 74.1 %

Headline · high effort · Own vendor

Source/record date: 2026-10-20

Harness: SparkLLM own run at thinking high per its card, temperature 1.0, top_p 0.95; exact label “PAgentBench” in the card figure. Self-reported; run date unpublished.

54.3% · raw 54.3 %

Headline · high effort · Own vendor

Source/record date: 2026-10-20

Harness: SparkLLM own run at thinking high per its card, temperature 1.0, top_p 0.95; exact label “SWE Pro” in the card figure. Self-reported; run date unpublished.

62.8% · raw 62.8 %

Headline · high effort · Own vendor

Source/record date: 2026-10-20

Harness: SparkLLM own run at thinking high per its card, temperature 1.0, top_p 0.95; exact label “SWE Verified” in the card figure. Self-reported; run date unpublished.

64.7% · raw 64.7 %

Headline · high effort · Own vendor

Source/record date: 2026-10-20

Harness: SparkLLM own run at thinking high per its card, temperature 1.0, top_p 0.95; exact label “SWE Multilingual” in the card figure. Self-reported; run date unpublished.

36.8% · raw 36.8 %

Headline · high effort · Own vendor

Source/record date: 2026-10-20

Harness: SparkLLM own run at thinking high per its card, temperature 1.0, top_p 0.95; exact label “SciCode” in the card figure. Self-reported; run date unpublished.

134.9 points · raw 134.9 points

Headline · high effort · Own vendor

Source/record date: 2026-10-20

Harness: SparkLLM own run at thinking high per its card, temperature 1.0, top_p 0.95; exact label “Gaokao 2026” in the card figure. Self-reported; run date unpublished.

91.2% · raw 91.2 %

Headline · high effort · Own vendor

Source/record date: 2026-10-20

Harness: SparkLLM own run at thinking high per its card, temperature 1.0, top_p 0.95; exact label “AIME 2026” in the card figure. Self-reported; run date unpublished.

81.3% · raw 81.3 %

Headline · high effort · Own vendor

Source/record date: 2026-10-20

Harness: SparkLLM own run at thinking high per its card, temperature 1.0, top_p 0.95; exact label “HMMT Feb 26” in the card figure. Self-reported; run date unpublished.

75.2% · raw 75.2 %

Headline · high effort · Own vendor

Source/record date: 2026-10-20

Harness: SparkLLM own run at thinking high per its card, temperature 1.0, top_p 0.95; exact label “IMO-AnswerBench” in the card figure. Self-reported; run date unpublished.

67.3% · raw 67.3 %

Headline · high effort · Own vendor

Source/record date: 2026-10-20

Harness: SparkLLM own run at thinking high per its card, temperature 1.0, top_p 0.95; exact label “AA-LCRv1.1” in the card figure. Self-reported; run date unpublished.

53.3% · raw 53.3 %

Headline · high effort · Own vendor

Source/record date: 2026-10-20

Harness: SparkLLM own run at thinking high per its card, temperature 1.0, top_p 0.95; exact label “LongBench v2” in the card figure. Self-reported; run date unpublished.

92.2 f1 · raw 92.2 f1

Headline · high effort · Own vendor

Source/record date: 2026-10-20

Harness: SparkLLM own run at thinking high per its card, temperature 1.0, top_p 0.95; exact label “Graphwalks bfs 256k f1” in the card figure. Self-reported; run date unpublished. F1 on a 0–100 scale, as the figure prints it.

34.2 f1 · raw 34.2 f1

Headline · high effort · Own vendor

Source/record date: 2026-10-20

Harness: SparkLLM own run at thinking high per its card, temperature 1.0, top_p 0.95; exact label “Graphwalks bfs 1m f1” in the card figure. Self-reported; run date unpublished. F1 on a 0–100 scale, as the figure prints it.

65.6% · raw 65.6 %

Headline · high effort · Own vendor

Source/record date: 2026-10-20

Harness: SparkLLM own run at thinking high per its card, temperature 1.0, top_p 0.95; exact label “Openai_MRCR v2 256k-512k” in the card figure. Self-reported; run date unpublished. Source label OpenAI MRCR v2; needle count unstated on the card.

26% · raw 26 %

Headline · high effort · Own vendor

Source/record date: 2026-10-20

Harness: SparkLLM own run at thinking high per its card, temperature 1.0, top_p 0.95; exact label “Openai_MRCR v2 512k-1M” in the card figure. Self-reported; run date unpublished. Source label OpenAI MRCR v2; needle count unstated on the card.

93.6% · raw 93.6 %

Headline · high effort · Own vendor

Source/record date: 2026-10-20

Harness: SparkLLM own run at thinking high per its card, temperature 1.0, top_p 0.95; exact label “IFEval” in the card figure. Self-reported; run date unpublished.

75.8% · raw 75.8 %

Headline · high effort · Own vendor

Source/record date: 2026-10-20

Harness: SparkLLM own run at thinking high per its card, temperature 1.0, top_p 0.95; exact label “IFBench” in the card figure. Self-reported; run date unpublished.

17.9% · raw 17.9 %

Headline · high effort · Own vendor

Source/record date: 2026-10-20

Harness: SparkLLM own run at thinking high per its card, temperature 1.0, top_p 0.95; exact label “HLE(w/o tools)” in the card figure. Self-reported; run date unpublished.

36.9% · raw 36.9 %

Headline · high effort · Own vendor

Source/record date: 2026-10-20

Harness: SparkLLM own run at thinking high per its card, temperature 1.0, top_p 0.95; exact label “HLE(w tools)” in the card figure. Self-reported; run date unpublished.

69.9% · raw 69.9 %

Headline · high effort · Own vendor

Source/record date: 2026-10-20

Harness: SparkLLM own run at thinking high per its card, temperature 1.0, top_p 0.95; exact label “GPQA” in the card figure. Self-reported; run date unpublished.

77.1% · raw 77.1 %

Headline · high effort · Own vendor

Source/record date: 2026-10-20

Harness: SparkLLM own run at thinking high per its card, temperature 1.0, top_p 0.95; exact label “GPQA Diamond” in the card figure. Self-reported; run date unpublished.