Examenos

Official, independent and pricing data

Model profilesv c917915

Drex Max v1.1

Explore Drex Max v1.1: exact decision configuration, published specifications, source-linked benchmarks and API tariffs when available.

← All decision models · Compare this decision system →

Published API tariff

$0.03 per 1M input tokens

Nace.AI · checked 2026-11-06

Nace's pricing and models pages, 6 November 2026: $0.03 per 1M input tokens for drex-max-v1.1, output not billed; image tokens count as input. Nace's product page calls v1.1's $0.03 per 1,000 decisions its 50% launch price and gives no end date, so recheck this tariff.

No output-token charge does not mean free requests. These are provider tariffs, separate from benchmark workload costs.

139 recorded observations. Published results retain their source and setup; no Examenos evaluation was run. Missing results are not zero. How to read these comparisons →

Independent · Artificial Analysis

Drex Max v1.1 · Independent · Artificial Analysis
EvaluationResultEvidence
AA Decision Index v1.064
Setup & source

Four equally weighted evaluations: AA-Omniscience-Decision, HLE-MultiChoice (513 text-only questions), When2Call and WildGuardTest.

Named Drex Max v1.1 by Nace.AI, listed beside the original Drex Max. AA Decisions v1.0. AA's model page gives 262k context and $0.03 per 1M input tokens, matching Nace's drex-max-v1.1. Exact execution dates, precision and serving details are unpublished.

Manual browser observation of a source-rounded chart label on 6 November 2026; no automated AA adapter.

Independent AA results. Omniscience splits its 25% between accuracy and non-hallucination. Displayed integer chart values, not undisclosed precise values. No automated AA import or refresh adapter. Superseded on AA by Decision Index v2, first seen 8 November 2026 (aa-decision-index-v2 and aa-decision-v2-*); these v1.0 rows stay as the record of that edition and are no longer refreshed.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-10-17 · Revision: Manually checked chart · 2026-10-17; 2026-11-01; 2026-11-02; 2026-11-06 · Published observations; result reuse terms not specified

Result source · Benchmark source
AA Decisions v1 · AA-Omniscience-Decision accuracy26%
Setup & source

AA Decisions v1 · AA-Omniscience-Decision accuracy

Named Drex Max v1.1 by Nace.AI, listed beside the original Drex Max. AA Decisions v1.0. AA's model page gives 262k context and $0.03 per 1M input tokens, matching Nace's drex-max-v1.1. Exact execution dates, precision and serving details are unpublished.

Manual browser observation of a source-rounded chart label on 6 November 2026; no automated AA adapter.

Source-rounded chart label manually verified, not hidden precise data. Five capability components feed the four-benchmark index. Task cost is average workload cost at source current prices, not a token tariff. Time is median across tasks, not a controlled provider benchmark. Superseded on AA by Decision Index v2, first seen 8 November 2026 (aa-decision-index-v2 and aa-decision-v2-*); these v1.0 rows stay as the record of that edition and are no longer refreshed.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-10-20 · Revision: Manual rendered chart labels · 2026-10-20; 2026-11-01; 2026-11-02; 2026-11-06 · Published summary observations; upstream task/result terms retained

Result source · Benchmark source
AA Decisions v1 · AA-Omniscience-Decision non-hallucination70%
Setup & source

AA Decisions v1 · AA-Omniscience-Decision non-hallucination

Named Drex Max v1.1 by Nace.AI, listed beside the original Drex Max. AA Decisions v1.0. AA's model page gives 262k context and $0.03 per 1M input tokens, matching Nace's drex-max-v1.1. Exact execution dates, precision and serving details are unpublished.

Manual browser observation of a source-rounded chart label on 6 November 2026; no automated AA adapter.

Source-rounded chart label manually verified, not hidden precise data. Five capability components feed the four-benchmark index. Task cost is average workload cost at source current prices, not a token tariff. Time is median across tasks, not a controlled provider benchmark. Superseded on AA by Decision Index v2, first seen 8 November 2026 (aa-decision-index-v2 and aa-decision-v2-*); these v1.0 rows stay as the record of that edition and are no longer refreshed.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-10-20 · Revision: Manual rendered chart labels · 2026-10-20; 2026-11-01; 2026-11-02; 2026-11-06 · Published summary observations; upstream task/result terms retained

Result source · Benchmark source
AA Decisions v1 · HLE-MultiChoice17%
Setup & source

AA Decisions v1 · HLE-MultiChoice

Named Drex Max v1.1 by Nace.AI, listed beside the original Drex Max. AA Decisions v1.0. AA's model page gives 262k context and $0.03 per 1M input tokens, matching Nace's drex-max-v1.1. Exact execution dates, precision and serving details are unpublished.

Manual browser observation of a source-rounded chart label on 6 November 2026; no automated AA adapter.

Source-rounded chart label manually verified, not hidden precise data. Five capability components feed the four-benchmark index. Task cost is average workload cost at source current prices, not a token tariff. Time is median across tasks, not a controlled provider benchmark. Superseded on AA by Decision Index v2, first seen 8 November 2026 (aa-decision-index-v2 and aa-decision-v2-*); these v1.0 rows stay as the record of that edition and are no longer refreshed.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-10-20 · Revision: Manual rendered chart labels · 2026-10-20; 2026-11-01; 2026-11-02; 2026-11-06 · Published summary observations; upstream task/result terms retained

Result source · Benchmark source
AA Decisions v1 · When2Call95%
Setup & source

AA Decisions v1 · When2Call

Named Drex Max v1.1 by Nace.AI, listed beside the original Drex Max. AA Decisions v1.0. AA's model page gives 262k context and $0.03 per 1M input tokens, matching Nace's drex-max-v1.1. Exact execution dates, precision and serving details are unpublished.

Manual browser observation of a source-rounded chart label on 6 November 2026; no automated AA adapter.

Source-rounded chart label manually verified, not hidden precise data. Five capability components feed the four-benchmark index. Task cost is average workload cost at source current prices, not a token tariff. Time is median across tasks, not a controlled provider benchmark. Superseded on AA by Decision Index v2, first seen 8 November 2026 (aa-decision-index-v2 and aa-decision-v2-*); these v1.0 rows stay as the record of that edition and are no longer refreshed.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-10-20 · Revision: Manual rendered chart labels · 2026-10-20; 2026-11-01; 2026-11-02; 2026-11-06 · Published summary observations; upstream task/result terms retained

Result source · Benchmark source
AA Decisions v1 · WildGuardTest average F195%
Setup & source

AA Decisions v1 · WildGuardTest average F1

Named Drex Max v1.1 by Nace.AI, listed beside the original Drex Max. AA Decisions v1.0. AA's model page gives 262k context and $0.03 per 1M input tokens, matching Nace's drex-max-v1.1. Exact execution dates, precision and serving details are unpublished.

Manual browser observation of a source-rounded chart label on 6 November 2026; no automated AA adapter.

Source-rounded chart label manually verified, not hidden precise data. Five capability components feed the four-benchmark index. Task cost is average workload cost at source current prices, not a token tariff. Time is median across tasks, not a controlled provider benchmark. Superseded on AA by Decision Index v2, first seen 8 November 2026 (aa-decision-index-v2 and aa-decision-v2-*); these v1.0 rows stay as the record of that edition and are no longer refreshed.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-10-20 · Revision: Manual rendered chart labels · 2026-10-20; 2026-11-01; 2026-11-02; 2026-11-06 · Published summary observations; upstream task/result terms retained

Result source · Benchmark source
AA Decisions v1 · Median time per task234 ms
Setup & source

AA Decisions v1 · Median time per task

Named Drex Max v1.1 by Nace.AI, listed beside the original Drex Max. AA Decisions v1.0. AA's model page gives 262k context and $0.03 per 1M input tokens, matching Nace's drex-max-v1.1. Exact execution dates, precision and serving details are unpublished.

Manual browser observation of a source-rounded chart label on 6 November 2026; no automated AA adapter.

Source-rounded chart label manually verified, not hidden precise data. Five capability components feed the four-benchmark index. Task cost is average workload cost at source current prices, not a token tariff. Time is median across tasks, not a controlled provider benchmark. Superseded on AA by Decision Index v2, first seen 8 November 2026 (aa-decision-index-v2 and aa-decision-v2-*); these v1.0 rows stay as the record of that edition and are no longer refreshed.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-10-20 · Revision: Manual rendered chart labels · 2026-10-20; 2026-11-01; 2026-11-02; 2026-11-06 · Published summary observations; upstream task/result terms retained

Result source · Benchmark source
AA Decisions v1 · Cost per million tasks23 USD/1M tasks
Setup & source

AA Decisions v1 · Cost per million tasks

Named Drex Max v1.1 by Nace.AI, listed beside the original Drex Max. AA Decisions v1.0. AA's model page gives 262k context and $0.03 per 1M input tokens, matching Nace's drex-max-v1.1. Exact execution dates, precision and serving details are unpublished.

Manual browser observation of a source-rounded chart label on 6 November 2026; no automated AA adapter.

Source-rounded chart label manually verified, not hidden precise data. Five capability components feed the four-benchmark index. Task cost is average workload cost at source current prices, not a token tariff. Time is median across tasks, not a controlled provider benchmark. Superseded on AA by Decision Index v2, first seen 8 November 2026 (aa-decision-index-v2 and aa-decision-v2-*); these v1.0 rows stay as the record of that edition and are no longer refreshed.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-10-20 · Revision: Manual rendered chart labels · 2026-10-20; 2026-11-01; 2026-11-02; 2026-11-06 · Published summary observations; upstream task/result terms retained

Result source · Benchmark source
AA Decision Index v273
Setup & source

Six evaluations: AA-Paperclip 30%, EvalSafe-O*NET-AA 15%, When2Call 10%, AA-Omniscience-Decision v1.1 15%, HLE-MultiChoice v1.1 15% and AA-Symmetry 15%. Each is scored with a Decision Score (accuracy less the Brier score of the chosen answer's probability, 0 to 100), except AA-Symmetry, which uses its Symmetry Score.

Named Drex Max v1.1 by Nace.AI. AA Decision Index v2. Exact execution dates, precision and serving details are unpublished.

Manual browser observation of a source-rounded chart label on 8 November 2026; no automated AA adapter.

Independent AA results from Decision Index v2, first seen on 8 November 2026 (AA's changelog has no entry for it). Displayed chart labels, read by hand, not undisclosed precise values. No automated AA import or refresh adapter. v2 is a new edition with new evaluations and a new scoring rule: never compared with or blended into the v1.0 datasets.

Checked / reported: 2026-11-08 · Samples: Not published

Snapshot: 2026-11-08 · Revision: Manual rendered chart labels · 2026-11-08 · Published observations; result reuse terms not specified

Result source · Benchmark source
AA Decisions v2 · AA-Paperclip Decision Score73
Setup & source

AA Decisions v2 · AA-Paperclip: Decision Score; each document's 15 answers are scored as one decision. 0 to 100, where 100 is certain and right.

Named Drex Max v1.1 by Nace.AI. AA Decision Index v2. Exact execution dates, precision and serving details are unpublished.

Manual browser observation of a source-rounded chart label on 8 November 2026; no automated AA adapter.

Independent AA results from Decision Index v2, first seen on 8 November 2026 (AA's changelog has no entry for it). Displayed chart labels, read by hand, not undisclosed precise values. No automated AA import or refresh adapter. v2 is a new edition with new evaluations and a new scoring rule: never compared with or blended into the v1.0 datasets.

Checked / reported: 2026-11-08 · Samples: Not published

Snapshot: 2026-11-08 · Revision: Manual rendered chart labels · 2026-11-08 · Published summary observations; upstream task/result terms retained

Result source · Benchmark source
AA Decisions v2 · EvalSafe-O*NET-AA Decision Score88
Setup & source

AA Decisions v2 · EvalSafe-O*NET-AA: Decision Score. 0 to 100, where 100 is certain and right.

Named Drex Max v1.1 by Nace.AI. AA Decision Index v2. Exact execution dates, precision and serving details are unpublished.

Manual browser observation of a source-rounded chart label on 8 November 2026; no automated AA adapter.

Independent AA results from Decision Index v2, first seen on 8 November 2026 (AA's changelog has no entry for it). Displayed chart labels, read by hand, not undisclosed precise values. No automated AA import or refresh adapter. v2 is a new edition with new evaluations and a new scoring rule: never compared with or blended into the v1.0 datasets.

Checked / reported: 2026-11-08 · Samples: Not published

Snapshot: 2026-11-08 · Revision: Manual rendered chart labels · 2026-11-08 · Published summary observations; upstream task/result terms retained

Result source · Benchmark source
AA Decisions v2 · When2Call Decision Score95
Setup & source

AA Decisions v2 · When2Call: Decision Score. 0 to 100, where 100 is certain and right.

Named Drex Max v1.1 by Nace.AI. AA Decision Index v2. Exact execution dates, precision and serving details are unpublished.

Manual browser observation of a source-rounded chart label on 8 November 2026; no automated AA adapter.

Independent AA results from Decision Index v2, first seen on 8 November 2026 (AA's changelog has no entry for it). Displayed chart labels, read by hand, not undisclosed precise values. No automated AA import or refresh adapter. v2 is a new edition with new evaluations and a new scoring rule: never compared with or blended into the v1.0 datasets.

Checked / reported: 2026-11-08 · Samples: Not published

Snapshot: 2026-11-08 · Revision: Manual rendered chart labels · 2026-11-08 · Published summary observations; upstream task/result terms retained

Result source · Benchmark source
AA Decisions v2 · AA-Omniscience-Decision v1.1 Decision Score60
Setup & source

AA Decisions v2 · AA-Omniscience-Decision v1.1: Decision Score. 0 to 100, where 100 is certain and right.

Named Drex Max v1.1 by Nace.AI. AA Decision Index v2. Exact execution dates, precision and serving details are unpublished.

Manual browser observation of a source-rounded chart label on 8 November 2026; no automated AA adapter.

Independent AA results from Decision Index v2, first seen on 8 November 2026 (AA's changelog has no entry for it). Displayed chart labels, read by hand, not undisclosed precise values. No automated AA import or refresh adapter. v2 is a new edition with new evaluations and a new scoring rule: never compared with or blended into the v1.0 datasets.

Checked / reported: 2026-11-08 · Samples: Not published

Snapshot: 2026-11-08 · Revision: Manual rendered chart labels · 2026-11-08 · Published summary observations; upstream task/result terms retained

Result source · Benchmark source
AA Decisions v2 · HLE-MultiChoice v1.1 Decision Score47
Setup & source

AA Decisions v2 · HLE-MultiChoice v1.1: Decision Score. 0 to 100, where 100 is certain and right.

Named Drex Max v1.1 by Nace.AI. AA Decision Index v2. Exact execution dates, precision and serving details are unpublished.

Manual browser observation of a source-rounded chart label on 8 November 2026; no automated AA adapter.

Independent AA results from Decision Index v2, first seen on 8 November 2026 (AA's changelog has no entry for it). Displayed chart labels, read by hand, not undisclosed precise values. No automated AA import or refresh adapter. v2 is a new edition with new evaluations and a new scoring rule: never compared with or blended into the v1.0 datasets.

Checked / reported: 2026-11-08 · Samples: Not published

Snapshot: 2026-11-08 · Revision: Manual rendered chart labels · 2026-11-08 · Published summary observations; upstream task/result terms retained

Result source · Benchmark source
AA Decisions v2 · AA-Symmetry Symmetry Score85
Setup & source

AA Decisions v2 · AA-Symmetry: Symmetry Score. Per question, 0 if the most probable option changes between forms of the question, otherwise 1 less how far that option's probability above chance moves; shown 0 to 100.

Named Drex Max v1.1 by Nace.AI. AA Decision Index v2. Exact execution dates, precision and serving details are unpublished.

Manual browser observation of a source-rounded chart label on 8 November 2026; no automated AA adapter.

Independent AA results from Decision Index v2, first seen on 8 November 2026 (AA's changelog has no entry for it). Displayed chart labels, read by hand, not undisclosed precise values. No automated AA import or refresh adapter. v2 is a new edition with new evaluations and a new scoring rule: never compared with or blended into the v1.0 datasets.

Checked / reported: 2026-11-08 · Samples: Not published

Snapshot: 2026-11-08 · Revision: Manual rendered chart labels · 2026-11-08 · Published summary observations; upstream task/result terms retained

Result source · Benchmark source
AA Decisions v2 · Headline metrics (weighted)58
Setup & source

AA Decisions v2 · Weighted average of the six evaluations' headline metrics, with the index weights.

Named Drex Max v1.1 by Nace.AI. AA Decision Index v2. Exact execution dates, precision and serving details are unpublished.

Manual browser observation of a source-rounded chart label on 8 November 2026; no automated AA adapter.

Independent AA results from Decision Index v2, first seen on 8 November 2026 (AA's changelog has no entry for it). Displayed chart labels, read by hand, not undisclosed precise values. No automated AA import or refresh adapter. v2 is a new edition with new evaluations and a new scoring rule: never compared with or blended into the v1.0 datasets.

Checked / reported: 2026-11-08 · Samples: Not published

Snapshot: 2026-11-08 · Revision: Manual rendered chart labels · 2026-11-08 · Published summary observations; upstream task/result terms retained

Result source · Benchmark source
AA Decisions v2 · AA-Paperclip all-pass rate63%
Setup & source

AA Decisions v2 · Share of documents with every decision and extraction right.

Named Drex Max v1.1 by Nace.AI. AA Decision Index v2. Exact execution dates, precision and serving details are unpublished.

Manual browser observation of a source-rounded chart label on 8 November 2026; no automated AA adapter.

Independent AA results from Decision Index v2, first seen on 8 November 2026 (AA's changelog has no entry for it). Displayed chart labels, read by hand, not undisclosed precise values. No automated AA import or refresh adapter. v2 is a new edition with new evaluations and a new scoring rule: never compared with or blended into the v1.0 datasets.

Checked / reported: 2026-11-08 · Samples: Not published

Snapshot: 2026-11-08 · Revision: Manual rendered chart labels · 2026-11-08 · Published summary observations; upstream task/result terms retained

Result source · Benchmark source
AA Decisions v2 · EvalSafe-O*NET-AA accuracy83%
Setup & source

AA Decisions v2 · Share of questions where the answer is the reference consensus's, averaged over the three question types.

Named Drex Max v1.1 by Nace.AI. AA Decision Index v2. Exact execution dates, precision and serving details are unpublished.

Manual browser observation of a source-rounded chart label on 8 November 2026; no automated AA adapter.

Independent AA results from Decision Index v2, first seen on 8 November 2026 (AA's changelog has no entry for it). Displayed chart labels, read by hand, not undisclosed precise values. No automated AA import or refresh adapter. v2 is a new edition with new evaluations and a new scoring rule: never compared with or blended into the v1.0 datasets.

Checked / reported: 2026-11-08 · Samples: Not published

Snapshot: 2026-11-08 · Revision: Manual rendered chart labels · 2026-11-08 · Published summary observations; upstream task/result terms retained

Result source · Benchmark source
AA Decisions v2 · When2Call accuracy95%
Setup & source

AA Decisions v2 · Share of tasks answered with the correct reply.

Named Drex Max v1.1 by Nace.AI. AA Decision Index v2. Exact execution dates, precision and serving details are unpublished.

Manual browser observation of a source-rounded chart label on 8 November 2026; no automated AA adapter.

Independent AA results from Decision Index v2, first seen on 8 November 2026 (AA's changelog has no entry for it). Displayed chart labels, read by hand, not undisclosed precise values. No automated AA import or refresh adapter. v2 is a new edition with new evaluations and a new scoring rule: never compared with or blended into the v1.0 datasets.

Checked / reported: 2026-11-08 · Samples: Not published

Snapshot: 2026-11-08 · Revision: Manual rendered chart labels · 2026-11-08 · Published summary observations; upstream task/result terms retained

Result source · Benchmark source
AA Decisions v2 · AA-Omniscience-Decision v1.1 accuracy28%
Setup & source

AA Decisions v2 · Share of questions answered correctly.

Named Drex Max v1.1 by Nace.AI. AA Decision Index v2. Exact execution dates, precision and serving details are unpublished.

Manual browser observation of a source-rounded chart label on 8 November 2026; no automated AA adapter.

Independent AA results from Decision Index v2, first seen on 8 November 2026 (AA's changelog has no entry for it). Displayed chart labels, read by hand, not undisclosed precise values. No automated AA import or refresh adapter. v2 is a new edition with new evaluations and a new scoring rule: never compared with or blended into the v1.0 datasets.

Checked / reported: 2026-11-08 · Samples: Not published

Snapshot: 2026-11-08 · Revision: Manual rendered chart labels · 2026-11-08 · Published summary observations; upstream task/result terms retained

Result source · Benchmark source
AA Decisions v2 · AA-Omniscience-Decision v1.1 non-hallucination rate65%
Setup & source

AA Decisions v2 · Share of questions not answered correctly where the model chose a way to say it does not know, or gave no answer.

Named Drex Max v1.1 by Nace.AI. AA Decision Index v2. Exact execution dates, precision and serving details are unpublished.

Manual browser observation of a source-rounded chart label on 8 November 2026; no automated AA adapter.

Independent AA results from Decision Index v2, first seen on 8 November 2026 (AA's changelog has no entry for it). Displayed chart labels, read by hand, not undisclosed precise values. No automated AA import or refresh adapter. v2 is a new edition with new evaluations and a new scoring rule: never compared with or blended into the v1.0 datasets.

Checked / reported: 2026-11-08 · Samples: Not published

Snapshot: 2026-11-08 · Revision: Manual rendered chart labels · 2026-11-08 · Published summary observations; upstream task/result terms retained

Result source · Benchmark source
AA Decisions v2 · HLE-MultiChoice v1.1 accuracy8%
Setup & source

AA Decisions v2 · Share of questions answered with the correct letter.

Named Drex Max v1.1 by Nace.AI. AA Decision Index v2. Exact execution dates, precision and serving details are unpublished.

Manual browser observation of a source-rounded chart label on 8 November 2026; no automated AA adapter.

Independent AA results from Decision Index v2, first seen on 8 November 2026 (AA's changelog has no entry for it). Displayed chart labels, read by hand, not undisclosed precise values. No automated AA import or refresh adapter. v2 is a new edition with new evaluations and a new scoring rule: never compared with or blended into the v1.0 datasets.

Checked / reported: 2026-11-08 · Samples: Not published

Snapshot: 2026-11-08 · Revision: Manual rendered chart labels · 2026-11-08 · Published summary observations; upstream task/result terms retained

Result source · Benchmark source
AA Decisions v2 · HLE-MultiChoice v1.1 non-hallucination rate50%
Setup & source

AA Decisions v2 · Share of questions not answered correctly where the model chose the option that declines, or gave no answer.

Named Drex Max v1.1 by Nace.AI. AA Decision Index v2. Exact execution dates, precision and serving details are unpublished.

Manual browser observation of a source-rounded chart label on 8 November 2026; no automated AA adapter.

Independent AA results from Decision Index v2, first seen on 8 November 2026 (AA's changelog has no entry for it). Displayed chart labels, read by hand, not undisclosed precise values. No automated AA import or refresh adapter. v2 is a new edition with new evaluations and a new scoring rule: never compared with or blended into the v1.0 datasets.

Checked / reported: 2026-11-08 · Samples: Not published

Snapshot: 2026-11-08 · Revision: Manual rendered chart labels · 2026-11-08 · Published summary observations; upstream task/result terms retained

Result source · Benchmark source
AA Decisions v2 · AA-Symmetry all-pass permutation rate55%
Setup & source

AA Decisions v2 · Share of questions whose most probable option and probabilities hold across every form.

Named Drex Max v1.1 by Nace.AI. AA Decision Index v2. Exact execution dates, precision and serving details are unpublished.

Manual browser observation of a source-rounded chart label on 8 November 2026; no automated AA adapter.

Independent AA results from Decision Index v2, first seen on 8 November 2026 (AA's changelog has no entry for it). Displayed chart labels, read by hand, not undisclosed precise values. No automated AA import or refresh adapter. v2 is a new edition with new evaluations and a new scoring rule: never compared with or blended into the v1.0 datasets.

Checked / reported: 2026-11-08 · Samples: Not published

Snapshot: 2026-11-08 · Revision: Manual rendered chart labels · 2026-11-08 · Published summary observations; upstream task/result terms retained

Result source · Benchmark source
AA Decisions v2 · Brier score (index weights)0.16 Brier
Setup & source

AA Decisions v2 · Mean squared gap between the chosen answer's probability and whether it is right, 0 to 1: AA-Paperclip, EvalSafe-O*NET-AA, When2Call, AA-Omniscience-Decision v1.1 and HLE-MultiChoice v1.1 averaged with the index weights (AA-Symmetry has no Brier score).

Named Drex Max v1.1 by Nace.AI. AA Decision Index v2. Exact execution dates, precision and serving details are unpublished.

Manual browser observation of a source-rounded chart label on 8 November 2026; no automated AA adapter.

Independent AA results from Decision Index v2, first seen on 8 November 2026 (AA's changelog has no entry for it). Displayed chart labels, read by hand, not undisclosed precise values. No automated AA import or refresh adapter. v2 is a new edition with new evaluations and a new scoring rule: never compared with or blended into the v1.0 datasets.

Checked / reported: 2026-11-08 · Samples: Not published

Snapshot: 2026-11-08 · Revision: Manual rendered chart labels · 2026-11-08 · Published summary observations; upstream task/result terms retained

Result source · Benchmark source
AA Decisions v2 · AA-Paperclip Brier score0.18 Brier
Setup & source

AA Decisions v2 · Mean squared gap between the chosen answer's probability and whether it is right, 0 to 1, on AA-Paperclip. Each document's confidence that all 15 answers are right, against whether they are.

Named Drex Max v1.1 by Nace.AI. AA Decision Index v2. Exact execution dates, precision and serving details are unpublished.

Manual browser observation of a source-rounded chart label on 8 November 2026; no automated AA adapter.

Independent AA results from Decision Index v2, first seen on 8 November 2026 (AA's changelog has no entry for it). Displayed chart labels, read by hand, not undisclosed precise values. No automated AA import or refresh adapter. v2 is a new edition with new evaluations and a new scoring rule: never compared with or blended into the v1.0 datasets.

Checked / reported: 2026-11-08 · Samples: Not published

Snapshot: 2026-11-08 · Revision: Manual rendered chart labels · 2026-11-08 · Published summary observations; upstream task/result terms retained

Result source · Benchmark source
AA Decisions v2 · EvalSafe-O*NET-AA Brier score0.09 Brier
Setup & source

AA Decisions v2 · Mean squared gap between the chosen answer's probability and whether it is right, 0 to 1, on EvalSafe-O*NET-AA. Against the reference models' consensus.

Named Drex Max v1.1 by Nace.AI. AA Decision Index v2. Exact execution dates, precision and serving details are unpublished.

Manual browser observation of a source-rounded chart label on 8 November 2026; no automated AA adapter.

Independent AA results from Decision Index v2, first seen on 8 November 2026 (AA's changelog has no entry for it). Displayed chart labels, read by hand, not undisclosed precise values. No automated AA import or refresh adapter. v2 is a new edition with new evaluations and a new scoring rule: never compared with or blended into the v1.0 datasets.

Checked / reported: 2026-11-08 · Samples: Not published

Snapshot: 2026-11-08 · Revision: Manual rendered chart labels · 2026-11-08 · Published summary observations; upstream task/result terms retained

Result source · Benchmark source
AA Decisions v2 · When2Call Brier score0.04 Brier
Setup & source

AA Decisions v2 · Mean squared gap between the chosen answer's probability and whether it is right, 0 to 1, on When2Call.

Named Drex Max v1.1 by Nace.AI. AA Decision Index v2. Exact execution dates, precision and serving details are unpublished.

Manual browser observation of a source-rounded chart label on 8 November 2026; no automated AA adapter.

Independent AA results from Decision Index v2, first seen on 8 November 2026 (AA's changelog has no entry for it). Displayed chart labels, read by hand, not undisclosed precise values. No automated AA import or refresh adapter. v2 is a new edition with new evaluations and a new scoring rule: never compared with or blended into the v1.0 datasets.

Checked / reported: 2026-11-08 · Samples: Not published

Snapshot: 2026-11-08 · Revision: Manual rendered chart labels · 2026-11-08 · Published summary observations; upstream task/result terms retained

Result source · Benchmark source
AA Decisions v2 · AA-Omniscience-Decision v1.1 Brier score0.20 Brier
Setup & source

AA Decisions v2 · Mean squared gap between the chosen answer's probability and whether it is right, 0 to 1, on AA-Omniscience-Decision v1.1.

Named Drex Max v1.1 by Nace.AI. AA Decision Index v2. Exact execution dates, precision and serving details are unpublished.

Manual browser observation of a source-rounded chart label on 8 November 2026; no automated AA adapter.

Independent AA results from Decision Index v2, first seen on 8 November 2026 (AA's changelog has no entry for it). Displayed chart labels, read by hand, not undisclosed precise values. No automated AA import or refresh adapter. v2 is a new edition with new evaluations and a new scoring rule: never compared with or blended into the v1.0 datasets.

Checked / reported: 2026-11-08 · Samples: Not published

Snapshot: 2026-11-08 · Revision: Manual rendered chart labels · 2026-11-08 · Published summary observations; upstream task/result terms retained

Result source · Benchmark source
AA Decisions v2 · HLE-MultiChoice v1.1 Brier score0.23 Brier
Setup & source

AA Decisions v2 · Mean squared gap between the chosen answer's probability and whether it is right, 0 to 1, on HLE-MultiChoice v1.1.

Named Drex Max v1.1 by Nace.AI. AA Decision Index v2. Exact execution dates, precision and serving details are unpublished.

Manual browser observation of a source-rounded chart label on 8 November 2026; no automated AA adapter.

Independent AA results from Decision Index v2, first seen on 8 November 2026 (AA's changelog has no entry for it). Displayed chart labels, read by hand, not undisclosed precise values. No automated AA import or refresh adapter. v2 is a new edition with new evaluations and a new scoring rule: never compared with or blended into the v1.0 datasets.

Checked / reported: 2026-11-08 · Samples: Not published

Snapshot: 2026-11-08 · Revision: Manual rendered chart labels · 2026-11-08 · Published summary observations; upstream task/result terms retained

Result source · Benchmark source
AA Decisions v2 · Time per task (index weights)275 ms
Setup & source

AA Decisions v2 · Each evaluation's median time per task, averaged with the index weights.

Named Drex Max v1.1 by Nace.AI. AA Decision Index v2. Exact execution dates, precision and serving details are unpublished.

Manual browser observation of a source-rounded chart label on 8 November 2026; no automated AA adapter.

Independent AA results from Decision Index v2, first seen on 8 November 2026 (AA's changelog has no entry for it). Displayed chart labels, read by hand, not undisclosed precise values. No automated AA import or refresh adapter. v2 is a new edition with new evaluations and a new scoring rule: never compared with or blended into the v1.0 datasets. Time is median across tasks, not a controlled provider benchmark.

Checked / reported: 2026-11-08 · Samples: Not published

Snapshot: 2026-11-08 · Revision: Manual rendered chart labels · 2026-11-08 · Published summary observations; upstream task/result terms retained

Result source · Benchmark source
AA Decisions v2 · AA-Paperclip median time per task335 ms
Setup & source

AA Decisions v2 · Median time per task on AA-Paperclip.

Named Drex Max v1.1 by Nace.AI. AA Decision Index v2. Exact execution dates, precision and serving details are unpublished.

Manual browser observation of a source-rounded chart label on 8 November 2026; no automated AA adapter.

Independent AA results from Decision Index v2, first seen on 8 November 2026 (AA's changelog has no entry for it). Displayed chart labels, read by hand, not undisclosed precise values. No automated AA import or refresh adapter. v2 is a new edition with new evaluations and a new scoring rule: never compared with or blended into the v1.0 datasets. Time is median across tasks, not a controlled provider benchmark.

Checked / reported: 2026-11-08 · Samples: Not published

Snapshot: 2026-11-08 · Revision: Manual rendered chart labels · 2026-11-08 · Published summary observations; upstream task/result terms retained

Result source · Benchmark source
AA Decisions v2 · EvalSafe-O*NET-AA median time per task265 ms
Setup & source

AA Decisions v2 · Median time per task on EvalSafe-O*NET-AA.

Named Drex Max v1.1 by Nace.AI. AA Decision Index v2. Exact execution dates, precision and serving details are unpublished.

Manual browser observation of a source-rounded chart label on 8 November 2026; no automated AA adapter.

Independent AA results from Decision Index v2, first seen on 8 November 2026 (AA's changelog has no entry for it). Displayed chart labels, read by hand, not undisclosed precise values. No automated AA import or refresh adapter. v2 is a new edition with new evaluations and a new scoring rule: never compared with or blended into the v1.0 datasets. Time is median across tasks, not a controlled provider benchmark.

Checked / reported: 2026-11-08 · Samples: Not published

Snapshot: 2026-11-08 · Revision: Manual rendered chart labels · 2026-11-08 · Published summary observations; upstream task/result terms retained

Result source · Benchmark source
AA Decisions v2 · When2Call median time per task284 ms
Setup & source

AA Decisions v2 · Median time per task on When2Call.

Named Drex Max v1.1 by Nace.AI. AA Decision Index v2. Exact execution dates, precision and serving details are unpublished.

Manual browser observation of a source-rounded chart label on 8 November 2026; no automated AA adapter.

Independent AA results from Decision Index v2, first seen on 8 November 2026 (AA's changelog has no entry for it). Displayed chart labels, read by hand, not undisclosed precise values. No automated AA import or refresh adapter. v2 is a new edition with new evaluations and a new scoring rule: never compared with or blended into the v1.0 datasets. Time is median across tasks, not a controlled provider benchmark.

Checked / reported: 2026-11-08 · Samples: Not published

Snapshot: 2026-11-08 · Revision: Manual rendered chart labels · 2026-11-08 · Published summary observations; upstream task/result terms retained

Result source · Benchmark source
AA Decisions v2 · AA-Omniscience-Decision v1.1 median time per task230 ms
Setup & source

AA Decisions v2 · Median time per task on AA-Omniscience-Decision v1.1.

Named Drex Max v1.1 by Nace.AI. AA Decision Index v2. Exact execution dates, precision and serving details are unpublished.

Manual browser observation of a source-rounded chart label on 8 November 2026; no automated AA adapter.

Independent AA results from Decision Index v2, first seen on 8 November 2026 (AA's changelog has no entry for it). Displayed chart labels, read by hand, not undisclosed precise values. No automated AA import or refresh adapter. v2 is a new edition with new evaluations and a new scoring rule: never compared with or blended into the v1.0 datasets. Time is median across tasks, not a controlled provider benchmark.

Checked / reported: 2026-11-08 · Samples: Not published

Snapshot: 2026-11-08 · Revision: Manual rendered chart labels · 2026-11-08 · Published summary observations; upstream task/result terms retained

Result source · Benchmark source
AA Decisions v2 · HLE-MultiChoice v1.1 median time per task237 ms
Setup & source

AA Decisions v2 · Median time per task on HLE-MultiChoice v1.1.

Named Drex Max v1.1 by Nace.AI. AA Decision Index v2. Exact execution dates, precision and serving details are unpublished.

Manual browser observation of a source-rounded chart label on 8 November 2026; no automated AA adapter.

Independent AA results from Decision Index v2, first seen on 8 November 2026 (AA's changelog has no entry for it). Displayed chart labels, read by hand, not undisclosed precise values. No automated AA import or refresh adapter. v2 is a new edition with new evaluations and a new scoring rule: never compared with or blended into the v1.0 datasets. Time is median across tasks, not a controlled provider benchmark.

Checked / reported: 2026-11-08 · Samples: Not published

Snapshot: 2026-11-08 · Revision: Manual rendered chart labels · 2026-11-08 · Published summary observations; upstream task/result terms retained

Result source · Benchmark source
AA Decisions v2 · AA-Symmetry median time per task241 ms
Setup & source

AA Decisions v2 · Median time per task on AA-Symmetry.

Named Drex Max v1.1 by Nace.AI. AA Decision Index v2. Exact execution dates, precision and serving details are unpublished.

Manual browser observation of a source-rounded chart label on 8 November 2026; no automated AA adapter.

Independent AA results from Decision Index v2, first seen on 8 November 2026 (AA's changelog has no entry for it). Displayed chart labels, read by hand, not undisclosed precise values. No automated AA import or refresh adapter. v2 is a new edition with new evaluations and a new scoring rule: never compared with or blended into the v1.0 datasets. Time is median across tasks, not a controlled provider benchmark.

Checked / reported: 2026-11-08 · Samples: Not published

Snapshot: 2026-11-08 · Revision: Manual rendered chart labels · 2026-11-08 · Published summary observations; upstream task/result terms retained

Result source · Benchmark source
AA Decisions v2 · Cost per million tasks102 USD/1M tasks
Setup & source

AA Decisions v2 · Average cost per 1 million tasks across all index evaluations at current prices (USD).

Named Drex Max v1.1 by Nace.AI. AA Decision Index v2. Exact execution dates, precision and serving details are unpublished.

Manual browser observation of a source-rounded chart label on 8 November 2026; no automated AA adapter. AA prints "*" after this value in every cost chart; no footnote text is rendered.

Independent AA results from Decision Index v2, first seen on 8 November 2026 (AA's changelog has no entry for it). Displayed chart labels, read by hand, not undisclosed precise values. No automated AA import or refresh adapter. v2 is a new edition with new evaluations and a new scoring rule: never compared with or blended into the v1.0 datasets. Task cost is average workload cost at source current prices, not a token tariff.

Checked / reported: 2026-11-08 · Samples: Not published

Snapshot: 2026-11-08 · Revision: Manual rendered chart labels · 2026-11-08 · Published summary observations; upstream task/result terms retained

Result source · Benchmark source
AA Decisions v2 · AA-Paperclip cost per million tasks282 USD/1M tasks
Setup & source

AA Decisions v2 · Average cost per 1 million tasks on AA-Paperclip at current prices (USD).

Named Drex Max v1.1 by Nace.AI. AA Decision Index v2. Exact execution dates, precision and serving details are unpublished.

Manual browser observation of a source-rounded chart label on 8 November 2026; no automated AA adapter. AA prints "*" after this value in every cost chart; no footnote text is rendered.

Independent AA results from Decision Index v2, first seen on 8 November 2026 (AA's changelog has no entry for it). Displayed chart labels, read by hand, not undisclosed precise values. No automated AA import or refresh adapter. v2 is a new edition with new evaluations and a new scoring rule: never compared with or blended into the v1.0 datasets. Task cost is average workload cost at source current prices, not a token tariff.

Checked / reported: 2026-11-08 · Samples: Not published

Snapshot: 2026-11-08 · Revision: Manual rendered chart labels · 2026-11-08 · Published summary observations; upstream task/result terms retained

Result source · Benchmark source
AA Decisions v2 · EvalSafe-O*NET-AA cost per million tasks55 USD/1M tasks
Setup & source

AA Decisions v2 · Average cost per 1 million tasks on EvalSafe-O*NET-AA at current prices (USD).

Named Drex Max v1.1 by Nace.AI. AA Decision Index v2. Exact execution dates, precision and serving details are unpublished.

Manual browser observation of a source-rounded chart label on 8 November 2026; no automated AA adapter. AA prints "*" after this value in every cost chart; no footnote text is rendered.

Independent AA results from Decision Index v2, first seen on 8 November 2026 (AA's changelog has no entry for it). Displayed chart labels, read by hand, not undisclosed precise values. No automated AA import or refresh adapter. v2 is a new edition with new evaluations and a new scoring rule: never compared with or blended into the v1.0 datasets. Task cost is average workload cost at source current prices, not a token tariff.

Checked / reported: 2026-11-08 · Samples: Not published

Snapshot: 2026-11-08 · Revision: Manual rendered chart labels · 2026-11-08 · Published summary observations; upstream task/result terms retained

Result source · Benchmark source
AA Decisions v2 · When2Call cost per million tasks32 USD/1M tasks
Setup & source

AA Decisions v2 · Average cost per 1 million tasks on When2Call at current prices (USD).

Named Drex Max v1.1 by Nace.AI. AA Decision Index v2. Exact execution dates, precision and serving details are unpublished.

Manual browser observation of a source-rounded chart label on 8 November 2026; no automated AA adapter. AA prints "*" after this value in every cost chart; no footnote text is rendered.

Independent AA results from Decision Index v2, first seen on 8 November 2026 (AA's changelog has no entry for it). Displayed chart labels, read by hand, not undisclosed precise values. No automated AA import or refresh adapter. v2 is a new edition with new evaluations and a new scoring rule: never compared with or blended into the v1.0 datasets. Task cost is average workload cost at source current prices, not a token tariff.

Checked / reported: 2026-11-08 · Samples: Not published

Snapshot: 2026-11-08 · Revision: Manual rendered chart labels · 2026-11-08 · Published summary observations; upstream task/result terms retained

Result source · Benchmark source
AA Decisions v2 · AA-Omniscience-Decision v1.1 cost per million tasks6.40 USD/1M tasks
Setup & source

AA Decisions v2 · Average cost per 1 million tasks on AA-Omniscience-Decision v1.1 at current prices (USD).

Named Drex Max v1.1 by Nace.AI. AA Decision Index v2. Exact execution dates, precision and serving details are unpublished.

Manual browser observation of a source-rounded chart label on 8 November 2026; no automated AA adapter. AA prints "*" after this value in every cost chart; no footnote text is rendered.

Independent AA results from Decision Index v2, first seen on 8 November 2026 (AA's changelog has no entry for it). Displayed chart labels, read by hand, not undisclosed precise values. No automated AA import or refresh adapter. v2 is a new edition with new evaluations and a new scoring rule: never compared with or blended into the v1.0 datasets. Task cost is average workload cost at source current prices, not a token tariff.

Checked / reported: 2026-11-08 · Samples: Not published

Snapshot: 2026-11-08 · Revision: Manual rendered chart labels · 2026-11-08 · Published summary observations; upstream task/result terms retained

Result source · Benchmark source
AA Decisions v2 · HLE-MultiChoice v1.1 cost per million tasks16 USD/1M tasks
Setup & source

AA Decisions v2 · Average cost per 1 million tasks on HLE-MultiChoice v1.1 at current prices (USD).

Named Drex Max v1.1 by Nace.AI. AA Decision Index v2. Exact execution dates, precision and serving details are unpublished.

Manual browser observation of a source-rounded chart label on 8 November 2026; no automated AA adapter. AA prints "*" after this value in every cost chart; no footnote text is rendered.

Independent AA results from Decision Index v2, first seen on 8 November 2026 (AA's changelog has no entry for it). Displayed chart labels, read by hand, not undisclosed precise values. No automated AA import or refresh adapter. v2 is a new edition with new evaluations and a new scoring rule: never compared with or blended into the v1.0 datasets. Task cost is average workload cost at source current prices, not a token tariff.

Checked / reported: 2026-11-08 · Samples: Not published

Snapshot: 2026-11-08 · Revision: Manual rendered chart labels · 2026-11-08 · Published summary observations; upstream task/result terms retained

Result source · Benchmark source
AA Decisions v2 · AA-Symmetry cost per million tasks19 USD/1M tasks
Setup & source

AA Decisions v2 · Average cost per 1 million tasks on AA-Symmetry at current prices (USD).

Named Drex Max v1.1 by Nace.AI. AA Decision Index v2. Exact execution dates, precision and serving details are unpublished.

Manual browser observation of a source-rounded chart label on 8 November 2026; no automated AA adapter. AA prints "*" after this value in every cost chart; no footnote text is rendered.

Independent AA results from Decision Index v2, first seen on 8 November 2026 (AA's changelog has no entry for it). Displayed chart labels, read by hand, not undisclosed precise values. No automated AA import or refresh adapter. v2 is a new edition with new evaluations and a new scoring rule: never compared with or blended into the v1.0 datasets. Task cost is average workload cost at source current prices, not a token tariff.

Checked / reported: 2026-11-08 · Samples: Not published

Snapshot: 2026-11-08 · Revision: Manual rendered chart labels · 2026-11-08 · Published summary observations; upstream task/result terms retained

Result source · Benchmark source

Official / vendor · Nace.AI vendor product

Drex Max v1.1 · Official / vendor · Nace.AI vendor product
EvaluationResultEvidence
Nace Drex Max v1.1 product · Decision Index 0.4.0 (public)70.80
Setup & source

Nace Drex Max v1.1 product · Decision Index 0.4.0 (public)

Drex Max v1.1 column of the comparison table on Nace's Drex product page.

Nace Drex product page checked 6 November 2026: the Drex Max v1.1 column of its comparison table. Decision Index edition 0.4.0, public benchmarks only (37 benchmarks, 140,178 scored requests). The vendor has not specified dataset revisions, sample populations, execution dates or harnesses for the other rows. Vendor run; not ranked and not blended with community or independent results. The original Drex Max showed 67.6 on edition 0.3.2 on 21 October; the two editions are not compared. Nace's results dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a) gives 70.79 for the same 37 benchmarks and 140,178 requests: the same run, so it is not stored twice.

Nace Drex product page checked 6 November 2026: the Drex Max v1.1 column of its comparison table. Decision Index edition 0.4.0, public benchmarks only (37 benchmarks, 140,178 scored requests). The vendor has not specified dataset revisions, sample populations, execution dates or harnesses for the other rows. Vendor run; not ranked and not blended with community or independent results. The original Drex Max showed 67.6 on edition 0.3.2 on 21 October; the two editions are not compared.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-11-06 · Revision: 2026-11-06 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 product · JevBench93.90%
Setup & source

Nace Drex Max v1.1 product · JevBench

Drex Max v1.1 column of the comparison table on Nace's Drex product page.

Nace Drex product page checked 6 November 2026: the Drex Max v1.1 column of its comparison table. Decision Index edition 0.4.0, public benchmarks only (37 benchmarks, 140,178 scored requests). The vendor has not specified dataset revisions, sample populations, execution dates or harnesses for the other rows. Vendor run; not ranked and not blended with community or independent results.

Nace Drex product page checked 6 November 2026: the Drex Max v1.1 column of its comparison table. Decision Index edition 0.4.0, public benchmarks only (37 benchmarks, 140,178 scored requests). The vendor has not specified dataset revisions, sample populations, execution dates or harnesses for the other rows. Vendor run; not ranked and not blended with community or independent results.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-11-06 · Revision: 2026-11-06 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 product · Decision Bench94.20%
Setup & source

Nace Drex Max v1.1 product · Decision Bench

Drex Max v1.1 column of the comparison table on Nace's Drex product page.

Nace Drex product page checked 6 November 2026: the Drex Max v1.1 column of its comparison table. Decision Index edition 0.4.0, public benchmarks only (37 benchmarks, 140,178 scored requests). The vendor has not specified dataset revisions, sample populations, execution dates or harnesses for the other rows. Vendor run; not ranked and not blended with community or independent results.

Nace Drex product page checked 6 November 2026: the Drex Max v1.1 column of its comparison table. Decision Index edition 0.4.0, public benchmarks only (37 benchmarks, 140,178 scored requests). The vendor has not specified dataset revisions, sample populations, execution dates or harnesses for the other rows. Vendor run; not ranked and not blended with community or independent results.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-11-06 · Revision: 2026-11-06 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 product · DecideBench (item)99.00%
Setup & source

Nace Drex Max v1.1 product · DecideBench (item)

Drex Max v1.1 column of the comparison table on Nace's Drex product page.

Nace Drex product page checked 6 November 2026: the Drex Max v1.1 column of its comparison table. Decision Index edition 0.4.0, public benchmarks only (37 benchmarks, 140,178 scored requests). The vendor has not specified dataset revisions, sample populations, execution dates or harnesses for the other rows. Vendor run; not ranked and not blended with community or independent results.

Nace Drex product page checked 6 November 2026: the Drex Max v1.1 column of its comparison table. Decision Index edition 0.4.0, public benchmarks only (37 benchmarks, 140,178 scored requests). The vendor has not specified dataset revisions, sample populations, execution dates or harnesses for the other rows. Vendor run; not ranked and not blended with community or independent results.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-11-06 · Revision: 2026-11-06 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 product · DecideBench (pair)98.00%
Setup & source

Nace Drex Max v1.1 product · DecideBench (pair)

Drex Max v1.1 column of the comparison table on Nace's Drex product page.

Nace Drex product page checked 6 November 2026: the Drex Max v1.1 column of its comparison table. Decision Index edition 0.4.0, public benchmarks only (37 benchmarks, 140,178 scored requests). The vendor has not specified dataset revisions, sample populations, execution dates or harnesses for the other rows. Vendor run; not ranked and not blended with community or independent results.

Nace Drex product page checked 6 November 2026: the Drex Max v1.1 column of its comparison table. Decision Index edition 0.4.0, public benchmarks only (37 benchmarks, 140,178 scored requests). The vendor has not specified dataset revisions, sample populations, execution dates or harnesses for the other rows. Vendor run; not ranked and not blended with community or independent results.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-11-06 · Revision: 2026-11-06 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 product · Game Bench (win %)65.20%
Setup & source

Nace Drex Max v1.1 product · Game Bench (win %)

Drex Max v1.1 column of the comparison table on Nace's Drex product page.

Nace Drex product page checked 6 November 2026: the Drex Max v1.1 column of its comparison table. Decision Index edition 0.4.0, public benchmarks only (37 benchmarks, 140,178 scored requests). The vendor has not specified dataset revisions, sample populations, execution dates or harnesses for the other rows. Vendor run; not ranked and not blended with community or independent results.

Nace Drex product page checked 6 November 2026: the Drex Max v1.1 column of its comparison table. Decision Index edition 0.4.0, public benchmarks only (37 benchmarks, 140,178 scored requests). The vendor has not specified dataset revisions, sample populations, execution dates or harnesses for the other rows. Vendor run; not ranked and not blended with community or independent results.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-11-06 · Revision: 2026-11-06 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 product · MMLU-Pro75.20%
Setup & source

Nace Drex Max v1.1 product · MMLU-Pro

Drex Max v1.1 column of the comparison table on Nace's Drex product page.

Nace Drex product page checked 6 November 2026: the Drex Max v1.1 column of its comparison table. Decision Index edition 0.4.0, public benchmarks only (37 benchmarks, 140,178 scored requests). The vendor has not specified dataset revisions, sample populations, execution dates or harnesses for the other rows. Vendor run; not ranked and not blended with community or independent results. Nace's results dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a) gives 0.7521609042553191 (accuracy) over 12,032 requests for this run, which rounds to this value; it is not stored twice.

Nace Drex product page checked 6 November 2026: the Drex Max v1.1 column of its comparison table. Decision Index edition 0.4.0, public benchmarks only (37 benchmarks, 140,178 scored requests). The vendor has not specified dataset revisions, sample populations, execution dates or harnesses for the other rows. Vendor run; not ranked and not blended with community or independent results.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-11-06 · Revision: 2026-11-06 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 product · HLE18.20%
Setup & source

Nace Drex Max v1.1 product · HLE

Drex Max v1.1 column of the comparison table on Nace's Drex product page.

Nace Drex product page checked 6 November 2026: the Drex Max v1.1 column of its comparison table. Decision Index edition 0.4.0, public benchmarks only (37 benchmarks, 140,178 scored requests). The vendor has not specified dataset revisions, sample populations, execution dates or harnesses for the other rows. Vendor run; not ranked and not blended with community or independent results. Nace's results dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a) gives 15.57% (accuracy, 501 requests) in its Decision Index run, stored on nace-drex-max-v11-results-text-hle. Nace does not say which run this page value comes from; both are kept.

Nace Drex product page checked 6 November 2026: the Drex Max v1.1 column of its comparison table. Decision Index edition 0.4.0, public benchmarks only (37 benchmarks, 140,178 scored requests). The vendor has not specified dataset revisions, sample populations, execution dates or harnesses for the other rows. Vendor run; not ranked and not blended with community or independent results.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-11-06 · Revision: 2026-11-06 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 product · CRUXEval86.80%
Setup & source

Nace Drex Max v1.1 product · CRUXEval

Drex Max v1.1 column of the comparison table on Nace's Drex product page.

Nace Drex product page checked 6 November 2026: the Drex Max v1.1 column of its comparison table. Decision Index edition 0.4.0, public benchmarks only (37 benchmarks, 140,178 scored requests). The vendor has not specified dataset revisions, sample populations, execution dates or harnesses for the other rows. Vendor run; not ranked and not blended with community or independent results. Nace's results dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a) gives 0.868421052631579 (accuracy) over 570 requests for this run, which rounds to this value; it is not stored twice.

Nace Drex product page checked 6 November 2026: the Drex Max v1.1 column of its comparison table. Decision Index edition 0.4.0, public benchmarks only (37 benchmarks, 140,178 scored requests). The vendor has not specified dataset revisions, sample populations, execution dates or harnesses for the other rows. Vendor run; not ranked and not blended with community or independent results.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-11-06 · Revision: 2026-11-06 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 product · ARC-Challenge96.80%
Setup & source

Nace Drex Max v1.1 product · ARC-Challenge

Drex Max v1.1 column of the comparison table on Nace's Drex product page.

Nace Drex product page checked 6 November 2026: the Drex Max v1.1 column of its comparison table. Decision Index edition 0.4.0, public benchmarks only (37 benchmarks, 140,178 scored requests). The vendor has not specified dataset revisions, sample populations, execution dates or harnesses for the other rows. Vendor run; not ranked and not blended with community or independent results. Nace's results dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a) gives 0.9684300341296929 (accuracy) over 1,172 requests for this run, which rounds to this value; it is not stored twice.

Nace Drex product page checked 6 November 2026: the Drex Max v1.1 column of its comparison table. Decision Index edition 0.4.0, public benchmarks only (37 benchmarks, 140,178 scored requests). The vendor has not specified dataset revisions, sample populations, execution dates or harnesses for the other rows. Vendor run; not ranked and not blended with community or independent results.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-11-06 · Revision: 2026-11-06 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 product · ARC-Easy99.20%
Setup & source

Nace Drex Max v1.1 product · ARC-Easy

Drex Max v1.1 column of the comparison table on Nace's Drex product page.

Nace Drex product page checked 6 November 2026: the Drex Max v1.1 column of its comparison table. Decision Index edition 0.4.0, public benchmarks only (37 benchmarks, 140,178 scored requests). The vendor has not specified dataset revisions, sample populations, execution dates or harnesses for the other rows. Vendor run; not ranked and not blended with community or independent results. Nace's results dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a) gives 0.992003367003367 (accuracy) over 2,376 requests for this run, which rounds to this value; it is not stored twice.

Nace Drex product page checked 6 November 2026: the Drex Max v1.1 column of its comparison table. Decision Index edition 0.4.0, public benchmarks only (37 benchmarks, 140,178 scored requests). The vendor has not specified dataset revisions, sample populations, execution dates or harnesses for the other rows. Vendor run; not ranked and not blended with community or independent results.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-11-06 · Revision: 2026-11-06 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 product · HellaSwag98.10%
Setup & source

Nace Drex Max v1.1 product · HellaSwag

Drex Max v1.1 column of the comparison table on Nace's Drex product page.

Nace Drex product page checked 6 November 2026: the Drex Max v1.1 column of its comparison table. Decision Index edition 0.4.0, public benchmarks only (37 benchmarks, 140,178 scored requests). The vendor has not specified dataset revisions, sample populations, execution dates or harnesses for the other rows. Vendor run; not ranked and not blended with community or independent results. Nace's results dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a) gives 97.05% (accuracy, 10,042 requests) in its Decision Index run, stored on nace-drex-max-v11-results-text-hellaswag. Nace does not say which run this page value comes from; both are kept.

Nace Drex product page checked 6 November 2026: the Drex Max v1.1 column of its comparison table. Decision Index edition 0.4.0, public benchmarks only (37 benchmarks, 140,178 scored requests). The vendor has not specified dataset revisions, sample populations, execution dates or harnesses for the other rows. Vendor run; not ranked and not blended with community or independent results.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-11-06 · Revision: 2026-11-06 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 product · OSWorld-Verified (automation)78.70%
Setup & source

Nace Drex Max v1.1 product · OSWorld-Verified (automation)

Drex Max v1.1 column of the comparison table on Nace's Drex product page.

Nace Drex product page checked 6 November 2026: the Drex Max v1.1 column of its comparison table. Decision Index edition 0.4.0, public benchmarks only (37 benchmarks, 140,178 scored requests). The vendor has not specified dataset revisions, sample populations, execution dates or harnesses for the other rows. Vendor run; not ranked and not blended with community or independent results. Published as 0.787 on a 0–1 scale.

Nace Drex product page checked 6 November 2026: the Drex Max v1.1 column of its comparison table. Decision Index edition 0.4.0, public benchmarks only (37 benchmarks, 140,178 scored requests). The vendor has not specified dataset revisions, sample populations, execution dates or harnesses for the other rows. Vendor run; not ranked and not blended with community or independent results. Published as 0.787 on a 0–1 scale.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-11-06 · Revision: 2026-11-06 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 product · OSWorld-V2 (automation)72.90%
Setup & source

Nace Drex Max v1.1 product · OSWorld-V2 (automation)

Drex Max v1.1 column of the comparison table on Nace's Drex product page.

Nace Drex product page checked 6 November 2026: the Drex Max v1.1 column of its comparison table. Decision Index edition 0.4.0, public benchmarks only (37 benchmarks, 140,178 scored requests). The vendor has not specified dataset revisions, sample populations, execution dates or harnesses for the other rows. Vendor run; not ranked and not blended with community or independent results. Published as 0.729 on a 0–1 scale.

Nace Drex product page checked 6 November 2026: the Drex Max v1.1 column of its comparison table. Decision Index edition 0.4.0, public benchmarks only (37 benchmarks, 140,178 scored requests). The vendor has not specified dataset revisions, sample populations, execution dates or harnesses for the other rows. Vendor run; not ranked and not blended with community or independent results. Published as 0.729 on a 0–1 scale.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-11-06 · Revision: 2026-11-06 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 product · BFCL (tool calling)97.80%
Setup & source

Nace Drex Max v1.1 product · BFCL (tool calling)

Drex Max v1.1 column of the comparison table on Nace's Drex product page.

Nace Drex product page checked 6 November 2026: the Drex Max v1.1 column of its comparison table. Decision Index edition 0.4.0, public benchmarks only (37 benchmarks, 140,178 scored requests). The vendor has not specified dataset revisions, sample populations, execution dates or harnesses for the other rows. Vendor run; not ranked and not blended with community or independent results. Nace's results dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a) gives 0.9781582054309327 (case exact accuracy) over 1,694 requests for this run, which rounds to this value; it is not stored twice.

Nace Drex product page checked 6 November 2026: the Drex Max v1.1 column of its comparison table. Decision Index edition 0.4.0, public benchmarks only (37 benchmarks, 140,178 scored requests). The vendor has not specified dataset revisions, sample populations, execution dates or harnesses for the other rows. Vendor run; not ranked and not blended with community or independent results.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-11-06 · Revision: 2026-11-06 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 product · ToolRet (tool retrieval)71.10%
Setup & source

Nace Drex Max v1.1 product · ToolRet (tool retrieval)

Drex Max v1.1 column of the comparison table on Nace's Drex product page.

Nace Drex product page checked 6 November 2026: the Drex Max v1.1 column of its comparison table. Decision Index edition 0.4.0, public benchmarks only (37 benchmarks, 140,178 scored requests). The vendor has not specified dataset revisions, sample populations, execution dates or harnesses for the other rows. Vendor run; not ranked and not blended with community or independent results. Nace's results dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a) gives 69.75% (nDCG@10, 685 requests) in its Decision Index run, stored on nace-drex-max-v11-results-text-toolret. Nace does not say which run this page value comes from; both are kept.

Nace Drex product page checked 6 November 2026: the Drex Max v1.1 column of its comparison table. Decision Index edition 0.4.0, public benchmarks only (37 benchmarks, 140,178 scored requests). The vendor has not specified dataset revisions, sample populations, execution dates or harnesses for the other rows. Vendor run; not ranked and not blended with community or independent results.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-11-06 · Revision: 2026-11-06 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 product · When2Call91.80%
Setup & source

Nace Drex Max v1.1 product · When2Call

Drex Max v1.1 column of the comparison table on Nace's Drex product page.

Nace Drex product page checked 6 November 2026: the Drex Max v1.1 column of its comparison table. Decision Index edition 0.4.0, public benchmarks only (37 benchmarks, 140,178 scored requests). The vendor has not specified dataset revisions, sample populations, execution dates or harnesses for the other rows. Vendor run; not ranked and not blended with community or independent results. Nace's results dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a) gives 0.9184008762322016 (accuracy) over 3,652 requests for this run, which rounds to this value; it is not stored twice.

Nace Drex product page checked 6 November 2026: the Drex Max v1.1 column of its comparison table. Decision Index edition 0.4.0, public benchmarks only (37 benchmarks, 140,178 scored requests). The vendor has not specified dataset revisions, sample populations, execution dates or harnesses for the other rows. Vendor run; not ranked and not blended with community or independent results.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-11-06 · Revision: 2026-11-06 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 product · RAGTruth85.80%
Setup & source

Nace Drex Max v1.1 product · RAGTruth

Drex Max v1.1 column of the comparison table on Nace's Drex product page.

Nace Drex product page checked 6 November 2026: the Drex Max v1.1 column of its comparison table. Decision Index edition 0.4.0, public benchmarks only (37 benchmarks, 140,178 scored requests). The vendor has not specified dataset revisions, sample populations, execution dates or harnesses for the other rows. Vendor run; not ranked and not blended with community or independent results. Nace's results dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a) gives 0.8582129481005886 (F1 on hallucinated class) over 2,700 requests for this run, which rounds to this value; it is not stored twice.

Nace Drex product page checked 6 November 2026: the Drex Max v1.1 column of its comparison table. Decision Index edition 0.4.0, public benchmarks only (37 benchmarks, 140,178 scored requests). The vendor has not specified dataset revisions, sample populations, execution dates or harnesses for the other rows. Vendor run; not ranked and not blended with community or independent results.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-11-06 · Revision: 2026-11-06 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 product · Median API latency172.00 ms
Setup & source

Nace Drex Max v1.1 product · Median API latency

Drex Max v1.1 column of the comparison table on Nace's Drex product page.

Nace Drex product page checked 6 November 2026: the Drex Max v1.1 column of its comparison table. Decision Index edition 0.4.0, public benchmarks only (37 benchmarks, 140,178 scored requests). The vendor has not specified dataset revisions, sample populations, execution dates or harnesses for the other rows. Vendor run; not ranked and not blended with community or independent results.

Nace Drex product page checked 6 November 2026: the Drex Max v1.1 column of its comparison table. Decision Index edition 0.4.0, public benchmarks only (37 benchmarks, 140,178 scored requests). The vendor has not specified dataset revisions, sample populations, execution dates or harnesses for the other rows. Vendor run; not ranked and not blended with community or independent results.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-11-06 · Revision: 2026-11-06 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 product · Cost (per 1k decisions, launch price)0.0300 USD/1k decisions
Setup & source

Nace Drex Max v1.1 product · Cost (per 1k decisions, launch price)

Drex Max v1.1 column of the comparison table on Nace's Drex product page.

Nace Drex product page checked 6 November 2026: the Drex Max v1.1 column of its comparison table. Decision Index edition 0.4.0, public benchmarks only (37 benchmarks, 140,178 scored requests). The vendor has not specified dataset revisions, sample populations, execution dates or harnesses for the other rows. Vendor run; not ranked and not blended with community or independent results. The page states this cost is at the 50% launch price; a workload cost, not the token tariff.

Nace Drex product page checked 6 November 2026: the Drex Max v1.1 column of its comparison table. Decision Index edition 0.4.0, public benchmarks only (37 benchmarks, 140,178 scored requests). The vendor has not specified dataset revisions, sample populations, execution dates or harnesses for the other rows. Vendor run; not ranked and not blended with community or independent results. The page states this cost is at the 50% launch price; a workload cost, not the token tariff.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-11-06 · Revision: 2026-11-06 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 product vision · Decision Index Vision (public)75.90
Setup & source

Nace Drex Max v1.1 product vision · Decision Index Vision (public)

Drex Max v1.1 vision panel on Nace's Drex product page.

Nace Drex product page checked 6 November 2026: Drex Max v1.1 on the public Decision Index Vision suite, 11 benchmarks. Vendor run; not ranked and not blended with community or independent results. Nace's results dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a) gives 75.78 for its vision run (75.39 in its first upload). This panel's accuracies give 75.89 with that run's chance levels and weights, so the panel is a different run; both are kept.

Nace Drex product page checked 6 November 2026: Drex Max v1.1 on the public Decision Index Vision suite, 11 benchmarks. Vendor run; not ranked and not blended with community or independent results.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-11-06 · Revision: 2026-11-06 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 product vision · CV-Bench86.30%
Setup & source

Nace Drex Max v1.1 product vision · CV-Bench

Drex Max v1.1 vision panel on Nace's Drex product page.

Nace Drex product page checked 6 November 2026: Drex Max v1.1 on the public Decision Index Vision suite, 11 benchmarks. Vendor run; not ranked and not blended with community or independent results. Same value as the original Drex Max on 21 October (86.3); every other v1.1 vision value differs.

Nace Drex product page checked 6 November 2026: Drex Max v1.1 on the public Decision Index Vision suite, 11 benchmarks. Vendor run; not ranked and not blended with community or independent results. Same value as the original Drex Max on 21 October (86.3); every other v1.1 vision value differs.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-11-06 · Revision: 2026-11-06 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 product vision · BLINK75.00%
Setup & source

Nace Drex Max v1.1 product vision · BLINK

Drex Max v1.1 vision panel on Nace's Drex product page.

Nace Drex product page checked 6 November 2026: Drex Max v1.1 on the public Decision Index Vision suite, 11 benchmarks. Vendor run; not ranked and not blended with community or independent results.

Nace Drex product page checked 6 November 2026: Drex Max v1.1 on the public Decision Index Vision suite, 11 benchmarks. Vendor run; not ranked and not blended with community or independent results.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-11-06 · Revision: 2026-11-06 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 product vision · RealWorldQA83.50%
Setup & source

Nace Drex Max v1.1 product vision · RealWorldQA

Drex Max v1.1 vision panel on Nace's Drex product page.

Nace Drex product page checked 6 November 2026: Drex Max v1.1 on the public Decision Index Vision suite, 11 benchmarks. Vendor run; not ranked and not blended with community or independent results.

Nace Drex product page checked 6 November 2026: Drex Max v1.1 on the public Decision Index Vision suite, 11 benchmarks. Vendor run; not ranked and not blended with community or independent results.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-11-06 · Revision: 2026-11-06 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 product vision · Winoground93.40%
Setup & source

Nace Drex Max v1.1 product vision · Winoground

Drex Max v1.1 vision panel on Nace's Drex product page.

Nace Drex product page checked 6 November 2026: Drex Max v1.1 on the public Decision Index Vision suite, 11 benchmarks. Vendor run; not ranked and not blended with community or independent results.

Nace Drex product page checked 6 November 2026: Drex Max v1.1 on the public Decision Index Vision suite, 11 benchmarks. Vendor run; not ranked and not blended with community or independent results.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-11-06 · Revision: 2026-11-06 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 product vision · CharXiv86.60%
Setup & source

Nace Drex Max v1.1 product vision · CharXiv

Drex Max v1.1 vision panel on Nace's Drex product page.

Nace Drex product page checked 6 November 2026: Drex Max v1.1 on the public Decision Index Vision suite, 11 benchmarks. Vendor run; not ranked and not blended with community or independent results. Nace's results dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a) gives accuracy 84.96% over 532 rows for its vision run (skill stored on nace-drex-max-v11-results-vision-charxiv); the page's panel is a different run, and both are kept.

Nace Drex product page checked 6 November 2026: Drex Max v1.1 on the public Decision Index Vision suite, 11 benchmarks. Vendor run; not ranked and not blended with community or independent results.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-11-06 · Revision: 2026-11-06 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 product vision · InfographicVQA98.40%
Setup & source

Nace Drex Max v1.1 product vision · InfographicVQA

Drex Max v1.1 vision panel on Nace's Drex product page.

Nace Drex product page checked 6 November 2026: Drex Max v1.1 on the public Decision Index Vision suite, 11 benchmarks. Vendor run; not ranked and not blended with community or independent results. Nace's results dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a) gives accuracy 98.77% over 244 rows for its vision run (skill stored on nace-drex-max-v11-results-vision-infographicvqa); the page's panel is a different run, and both are kept.

Nace Drex product page checked 6 November 2026: Drex Max v1.1 on the public Decision Index Vision suite, 11 benchmarks. Vendor run; not ranked and not blended with community or independent results.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-11-06 · Revision: 2026-11-06 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 product vision · KIE (CORD + FUNSD)95.90%
Setup & source

Nace Drex Max v1.1 product vision · KIE (CORD + FUNSD)

Drex Max v1.1 vision panel on Nace's Drex product page.

Nace Drex product page checked 6 November 2026: Drex Max v1.1 on the public Decision Index Vision suite, 11 benchmarks. Vendor run; not ranked and not blended with community or independent results.

Nace Drex product page checked 6 November 2026: Drex Max v1.1 on the public Decision Index Vision suite, 11 benchmarks. Vendor run; not ranked and not blended with community or independent results.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-11-06 · Revision: 2026-11-06 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 product vision · Mind2Web89.20%
Setup & source

Nace Drex Max v1.1 product vision · Mind2Web

Drex Max v1.1 vision panel on Nace's Drex product page.

Nace Drex product page checked 6 November 2026: Drex Max v1.1 on the public Decision Index Vision suite, 11 benchmarks. Vendor run; not ranked and not blended with community or independent results. Nace's results dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a) gives accuracy 89.72% over 973 rows for its vision run (skill stored on nace-drex-max-v11-results-vision-mind2web); the page's panel is a different run, and both are kept.

Nace Drex product page checked 6 November 2026: Drex Max v1.1 on the public Decision Index Vision suite, 11 benchmarks. Vendor run; not ranked and not blended with community or independent results.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-11-06 · Revision: 2026-11-06 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 product vision · R-Bench-M58.60%
Setup & source

Nace Drex Max v1.1 product vision · R-Bench-M

Drex Max v1.1 vision panel on Nace's Drex product page.

Nace Drex product page checked 6 November 2026: Drex Max v1.1 on the public Decision Index Vision suite, 11 benchmarks. Vendor run; not ranked and not blended with community or independent results.

Nace Drex product page checked 6 November 2026: Drex Max v1.1 on the public Decision Index Vision suite, 11 benchmarks. Vendor run; not ranked and not blended with community or independent results.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-11-06 · Revision: 2026-11-06 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 product vision · MMMU-Pro (vision)53.80%
Setup & source

Nace Drex Max v1.1 product vision · MMMU-Pro (vision)

Drex Max v1.1 vision panel on Nace's Drex product page.

Nace Drex product page checked 6 November 2026: Drex Max v1.1 on the public Decision Index Vision suite, 11 benchmarks. Vendor run; not ranked and not blended with community or independent results.

Nace Drex product page checked 6 November 2026: Drex Max v1.1 on the public Decision Index Vision suite, 11 benchmarks. Vendor run; not ranked and not blended with community or independent results.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-11-06 · Revision: 2026-11-06 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 product vision · Hateful Memes (moderation)72.80%
Setup & source

Nace Drex Max v1.1 product vision · Hateful Memes (moderation)

Drex Max v1.1 vision panel on Nace's Drex product page.

Nace Drex product page checked 6 November 2026: Drex Max v1.1 on the public Decision Index Vision suite, 11 benchmarks. Vendor run; not ranked and not blended with community or independent results.

Nace Drex product page checked 6 November 2026: Drex Max v1.1 on the public Decision Index Vision suite, 11 benchmarks. Vendor run; not ranked and not blended with community or independent results.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-11-06 · Revision: 2026-11-06 · Published observations; result reuse terms not specified

Result source · Benchmark source

Peer vendor · Nace.AI vendor release

Drex Max v1.1 · Peer vendor · Nace.AI vendor release
EvaluationResultEvidence
Nace Drex for Finance launch · Drex Finance Index65.80
Setup & source

Nace Drex for Finance launch · Drex Finance Index

'Drex Max v1.1 Nace' column of the comparison table in Nace's 2 November 2026 Drex for Finance release post; Nace-run.

Nace.AI's 2 November 2026 Drex for Finance release table, checked 6 November 2026. The Drex Finance Index combines 48 public finance test sets held out from training (3,361 decisions); each set is scored as skill above chance, 0 a coin flip and 100 every answer right, with below-chance sets counted as 0. Nace has not published the test-set list, revisions, execution dates or harness. Vendor run; not ranked and not blended with community or independent results. Peer columns mapped only where the label names a registered release: Jev 1.14, pplx-decider v1.2, Drex Max v1.1 and Drex Max v1. The 'GPT-6 Luna' and 'GLiDE' columns are not stored: GPT-6 Luna: a bare 'GPT-6 Luna' label names OpenAI's chat model, which is not a Decisions system; Nace writes 'GPT-6 Luna Decisions' when it means that endpoint; GLiDE: no release named, and GLiDE (September 2026) and GLiDE v1.2 are both registered.

Nace.AI's 2 November 2026 Drex for Finance release table, checked 6 November 2026. The Drex Finance Index combines 48 public finance test sets held out from training (3,361 decisions); each set is scored as skill above chance, 0 a coin flip and 100 every answer right, with below-chance sets counted as 0. Nace has not published the test-set list, revisions, execution dates or harness. Vendor run; not ranked and not blended with community or independent results. Peer columns mapped only where the label names a registered release: Jev 1.14, pplx-decider v1.2, Drex Max v1.1 and Drex Max v1. The 'GPT-6 Luna' and 'GLiDE' columns are not stored: GPT-6 Luna: a bare 'GPT-6 Luna' label names OpenAI's chat model, which is not a Decisions system; Nace writes 'GPT-6 Luna Decisions' when it means that endpoint; GLiDE: no release named, and GLiDE (September 2026) and GLiDE v1.2 are both registered.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-11-02 · Revision: 2026-11-06 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex for Finance launch · Accuracy (3,361 decisions)77.70%
Setup & source

Nace Drex for Finance launch · Accuracy (3,361 decisions)

'Drex Max v1.1 Nace' column of the comparison table in Nace's 2 November 2026 Drex for Finance release post; Nace-run.

Nace.AI's 2 November 2026 Drex for Finance release table, checked 6 November 2026. The Drex Finance Index combines 48 public finance test sets held out from training (3,361 decisions); each set is scored as skill above chance, 0 a coin flip and 100 every answer right, with below-chance sets counted as 0. Nace has not published the test-set list, revisions, execution dates or harness. Vendor run; not ranked and not blended with community or independent results. Peer columns mapped only where the label names a registered release: Jev 1.14, pplx-decider v1.2, Drex Max v1.1 and Drex Max v1. The 'GPT-6 Luna' and 'GLiDE' columns are not stored: GPT-6 Luna: a bare 'GPT-6 Luna' label names OpenAI's chat model, which is not a Decisions system; Nace writes 'GPT-6 Luna Decisions' when it means that endpoint; GLiDE: no release named, and GLiDE (September 2026) and GLiDE v1.2 are both registered.

Nace.AI's 2 November 2026 Drex for Finance release table, checked 6 November 2026. The Drex Finance Index combines 48 public finance test sets held out from training (3,361 decisions); each set is scored as skill above chance, 0 a coin flip and 100 every answer right, with below-chance sets counted as 0. Nace has not published the test-set list, revisions, execution dates or harness. Vendor run; not ranked and not blended with community or independent results. Peer columns mapped only where the label names a registered release: Jev 1.14, pplx-decider v1.2, Drex Max v1.1 and Drex Max v1. The 'GPT-6 Luna' and 'GLiDE' columns are not stored: GPT-6 Luna: a bare 'GPT-6 Luna' label names OpenAI's chat model, which is not a Decisions system; Nace writes 'GPT-6 Luna Decisions' when it means that endpoint; GLiDE: no release named, and GLiDE (September 2026) and GLiDE v1.2 are both registered.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-11-02 · Revision: 2026-11-06 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex for Finance launch · Sentiment & tone69.30
Setup & source

Nace Drex for Finance launch · Sentiment & tone

'Drex Max v1.1 Nace' column of the comparison table in Nace's 2 November 2026 Drex for Finance release post; Nace-run.

Nace.AI's 2 November 2026 Drex for Finance release table, checked 6 November 2026. The Drex Finance Index combines 48 public finance test sets held out from training (3,361 decisions); each set is scored as skill above chance, 0 a coin flip and 100 every answer right, with below-chance sets counted as 0. Nace has not published the test-set list, revisions, execution dates or harness. Vendor run; not ranked and not blended with community or independent results. Category score: chance-corrected skill on that category's test sets. Peer columns mapped only where the label names a registered release: Jev 1.14, pplx-decider v1.2, Drex Max v1.1 and Drex Max v1. The 'GPT-6 Luna' and 'GLiDE' columns are not stored: GPT-6 Luna: a bare 'GPT-6 Luna' label names OpenAI's chat model, which is not a Decisions system; Nace writes 'GPT-6 Luna Decisions' when it means that endpoint; GLiDE: no release named, and GLiDE (September 2026) and GLiDE v1.2 are both registered.

Nace.AI's 2 November 2026 Drex for Finance release table, checked 6 November 2026. The Drex Finance Index combines 48 public finance test sets held out from training (3,361 decisions); each set is scored as skill above chance, 0 a coin flip and 100 every answer right, with below-chance sets counted as 0. Nace has not published the test-set list, revisions, execution dates or harness. Vendor run; not ranked and not blended with community or independent results. Category score: chance-corrected skill on that category's test sets. Peer columns mapped only where the label names a registered release: Jev 1.14, pplx-decider v1.2, Drex Max v1.1 and Drex Max v1. The 'GPT-6 Luna' and 'GLiDE' columns are not stored: GPT-6 Luna: a bare 'GPT-6 Luna' label names OpenAI's chat model, which is not a Decisions system; Nace writes 'GPT-6 Luna Decisions' when it means that endpoint; GLiDE: no release named, and GLiDE (September 2026) and GLiDE v1.2 are both registered.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-11-02 · Revision: 2026-11-06 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex for Finance launch · News & headlines71.40
Setup & source

Nace Drex for Finance launch · News & headlines

'Drex Max v1.1 Nace' column of the comparison table in Nace's 2 November 2026 Drex for Finance release post; Nace-run.

Nace.AI's 2 November 2026 Drex for Finance release table, checked 6 November 2026. The Drex Finance Index combines 48 public finance test sets held out from training (3,361 decisions); each set is scored as skill above chance, 0 a coin flip and 100 every answer right, with below-chance sets counted as 0. Nace has not published the test-set list, revisions, execution dates or harness. Vendor run; not ranked and not blended with community or independent results. Category score: chance-corrected skill on that category's test sets. Peer columns mapped only where the label names a registered release: Jev 1.14, pplx-decider v1.2, Drex Max v1.1 and Drex Max v1. The 'GPT-6 Luna' and 'GLiDE' columns are not stored: GPT-6 Luna: a bare 'GPT-6 Luna' label names OpenAI's chat model, which is not a Decisions system; Nace writes 'GPT-6 Luna Decisions' when it means that endpoint; GLiDE: no release named, and GLiDE (September 2026) and GLiDE v1.2 are both registered.

Nace.AI's 2 November 2026 Drex for Finance release table, checked 6 November 2026. The Drex Finance Index combines 48 public finance test sets held out from training (3,361 decisions); each set is scored as skill above chance, 0 a coin flip and 100 every answer right, with below-chance sets counted as 0. Nace has not published the test-set list, revisions, execution dates or harness. Vendor run; not ranked and not blended with community or independent results. Category score: chance-corrected skill on that category's test sets. Peer columns mapped only where the label names a registered release: Jev 1.14, pplx-decider v1.2, Drex Max v1.1 and Drex Max v1. The 'GPT-6 Luna' and 'GLiDE' columns are not stored: GPT-6 Luna: a bare 'GPT-6 Luna' label names OpenAI's chat model, which is not a Decisions system; Nace writes 'GPT-6 Luna Decisions' when it means that endpoint; GLiDE: no release named, and GLiDE (September 2026) and GLiDE v1.2 are both registered.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-11-02 · Revision: 2026-11-06 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex for Finance launch · Banking & support intent74.50
Setup & source

Nace Drex for Finance launch · Banking & support intent

'Drex Max v1.1 Nace' column of the comparison table in Nace's 2 November 2026 Drex for Finance release post; Nace-run.

Nace.AI's 2 November 2026 Drex for Finance release table, checked 6 November 2026. The Drex Finance Index combines 48 public finance test sets held out from training (3,361 decisions); each set is scored as skill above chance, 0 a coin flip and 100 every answer right, with below-chance sets counted as 0. Nace has not published the test-set list, revisions, execution dates or harness. Vendor run; not ranked and not blended with community or independent results. Category score: chance-corrected skill on that category's test sets. Peer columns mapped only where the label names a registered release: Jev 1.14, pplx-decider v1.2, Drex Max v1.1 and Drex Max v1. The 'GPT-6 Luna' and 'GLiDE' columns are not stored: GPT-6 Luna: a bare 'GPT-6 Luna' label names OpenAI's chat model, which is not a Decisions system; Nace writes 'GPT-6 Luna Decisions' when it means that endpoint; GLiDE: no release named, and GLiDE (September 2026) and GLiDE v1.2 are both registered.

Nace.AI's 2 November 2026 Drex for Finance release table, checked 6 November 2026. The Drex Finance Index combines 48 public finance test sets held out from training (3,361 decisions); each set is scored as skill above chance, 0 a coin flip and 100 every answer right, with below-chance sets counted as 0. Nace has not published the test-set list, revisions, execution dates or harness. Vendor run; not ranked and not blended with community or independent results. Category score: chance-corrected skill on that category's test sets. Peer columns mapped only where the label names a registered release: Jev 1.14, pplx-decider v1.2, Drex Max v1.1 and Drex Max v1. The 'GPT-6 Luna' and 'GLiDE' columns are not stored: GPT-6 Luna: a bare 'GPT-6 Luna' label names OpenAI's chat model, which is not a Decisions system; Nace writes 'GPT-6 Luna Decisions' when it means that endpoint; GLiDE: no release named, and GLiDE (September 2026) and GLiDE v1.2 are both registered.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-11-02 · Revision: 2026-11-06 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex for Finance launch · Documents & extraction87.80
Setup & source

Nace Drex for Finance launch · Documents & extraction

'Drex Max v1.1 Nace' column of the comparison table in Nace's 2 November 2026 Drex for Finance release post; Nace-run.

Nace.AI's 2 November 2026 Drex for Finance release table, checked 6 November 2026. The Drex Finance Index combines 48 public finance test sets held out from training (3,361 decisions); each set is scored as skill above chance, 0 a coin flip and 100 every answer right, with below-chance sets counted as 0. Nace has not published the test-set list, revisions, execution dates or harness. Vendor run; not ranked and not blended with community or independent results. Category score: chance-corrected skill on that category's test sets. Peer columns mapped only where the label names a registered release: Jev 1.14, pplx-decider v1.2, Drex Max v1.1 and Drex Max v1. The 'GPT-6 Luna' and 'GLiDE' columns are not stored: GPT-6 Luna: a bare 'GPT-6 Luna' label names OpenAI's chat model, which is not a Decisions system; Nace writes 'GPT-6 Luna Decisions' when it means that endpoint; GLiDE: no release named, and GLiDE (September 2026) and GLiDE v1.2 are both registered.

Nace.AI's 2 November 2026 Drex for Finance release table, checked 6 November 2026. The Drex Finance Index combines 48 public finance test sets held out from training (3,361 decisions); each set is scored as skill above chance, 0 a coin flip and 100 every answer right, with below-chance sets counted as 0. Nace has not published the test-set list, revisions, execution dates or harness. Vendor run; not ranked and not blended with community or independent results. Category score: chance-corrected skill on that category's test sets. Peer columns mapped only where the label names a registered release: Jev 1.14, pplx-decider v1.2, Drex Max v1.1 and Drex Max v1. The 'GPT-6 Luna' and 'GLiDE' columns are not stored: GPT-6 Luna: a bare 'GPT-6 Luna' label names OpenAI's chat model, which is not a Decisions system; Nace writes 'GPT-6 Luna Decisions' when it means that endpoint; GLiDE: no release named, and GLiDE (September 2026) and GLiDE v1.2 are both registered.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-11-02 · Revision: 2026-11-06 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex for Finance launch · Financial QA & filings89.70
Setup & source

Nace Drex for Finance launch · Financial QA & filings

'Drex Max v1.1 Nace' column of the comparison table in Nace's 2 November 2026 Drex for Finance release post; Nace-run.

Nace.AI's 2 November 2026 Drex for Finance release table, checked 6 November 2026. The Drex Finance Index combines 48 public finance test sets held out from training (3,361 decisions); each set is scored as skill above chance, 0 a coin flip and 100 every answer right, with below-chance sets counted as 0. Nace has not published the test-set list, revisions, execution dates or harness. Vendor run; not ranked and not blended with community or independent results. Category score: chance-corrected skill on that category's test sets. Peer columns mapped only where the label names a registered release: Jev 1.14, pplx-decider v1.2, Drex Max v1.1 and Drex Max v1. The 'GPT-6 Luna' and 'GLiDE' columns are not stored: GPT-6 Luna: a bare 'GPT-6 Luna' label names OpenAI's chat model, which is not a Decisions system; Nace writes 'GPT-6 Luna Decisions' when it means that endpoint; GLiDE: no release named, and GLiDE (September 2026) and GLiDE v1.2 are both registered.

Nace.AI's 2 November 2026 Drex for Finance release table, checked 6 November 2026. The Drex Finance Index combines 48 public finance test sets held out from training (3,361 decisions); each set is scored as skill above chance, 0 a coin flip and 100 every answer right, with below-chance sets counted as 0. Nace has not published the test-set list, revisions, execution dates or harness. Vendor run; not ranked and not blended with community or independent results. Category score: chance-corrected skill on that category's test sets. Peer columns mapped only where the label names a registered release: Jev 1.14, pplx-decider v1.2, Drex Max v1.1 and Drex Max v1. The 'GPT-6 Luna' and 'GLiDE' columns are not stored: GPT-6 Luna: a bare 'GPT-6 Luna' label names OpenAI's chat model, which is not a Decisions system; Nace writes 'GPT-6 Luna Decisions' when it means that endpoint; GLiDE: no release named, and GLiDE (September 2026) and GLiDE v1.2 are both registered.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-11-02 · Revision: 2026-11-06 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex for Finance launch · Credit & risk0.00
Setup & source

Nace Drex for Finance launch · Credit & risk

'Drex Max v1.1 Nace' column of the comparison table in Nace's 2 November 2026 Drex for Finance release post; Nace-run.

Nace.AI's 2 November 2026 Drex for Finance release table, checked 6 November 2026. The Drex Finance Index combines 48 public finance test sets held out from training (3,361 decisions); each set is scored as skill above chance, 0 a coin flip and 100 every answer right, with below-chance sets counted as 0. Nace has not published the test-set list, revisions, execution dates or harness. Vendor run; not ranked and not blended with community or independent results. Category score: chance-corrected skill on that category's test sets. Peer columns mapped only where the label names a registered release: Jev 1.14, pplx-decider v1.2, Drex Max v1.1 and Drex Max v1. The 'GPT-6 Luna' and 'GLiDE' columns are not stored: GPT-6 Luna: a bare 'GPT-6 Luna' label names OpenAI's chat model, which is not a Decisions system; Nace writes 'GPT-6 Luna Decisions' when it means that endpoint; GLiDE: no release named, and GLiDE (September 2026) and GLiDE v1.2 are both registered. Published as 0.0: Nace says this is the floor for a model at or below a coin flip, not missing data.

Nace.AI's 2 November 2026 Drex for Finance release table, checked 6 November 2026. The Drex Finance Index combines 48 public finance test sets held out from training (3,361 decisions); each set is scored as skill above chance, 0 a coin flip and 100 every answer right, with below-chance sets counted as 0. Nace has not published the test-set list, revisions, execution dates or harness. Vendor run; not ranked and not blended with community or independent results. Category score: chance-corrected skill on that category's test sets. Peer columns mapped only where the label names a registered release: Jev 1.14, pplx-decider v1.2, Drex Max v1.1 and Drex Max v1. The 'GPT-6 Luna' and 'GLiDE' columns are not stored: GPT-6 Luna: a bare 'GPT-6 Luna' label names OpenAI's chat model, which is not a Decisions system; Nace writes 'GPT-6 Luna Decisions' when it means that endpoint; GLiDE: no release named, and GLiDE (September 2026) and GLiDE v1.2 are both registered.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-11-02 · Revision: 2026-11-06 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex for Finance launch · Monetary policy30.00
Setup & source

Nace Drex for Finance launch · Monetary policy

'Drex Max v1.1 Nace' column of the comparison table in Nace's 2 November 2026 Drex for Finance release post; Nace-run.

Nace.AI's 2 November 2026 Drex for Finance release table, checked 6 November 2026. The Drex Finance Index combines 48 public finance test sets held out from training (3,361 decisions); each set is scored as skill above chance, 0 a coin flip and 100 every answer right, with below-chance sets counted as 0. Nace has not published the test-set list, revisions, execution dates or harness. Vendor run; not ranked and not blended with community or independent results. Category score: chance-corrected skill on that category's test sets. Peer columns mapped only where the label names a registered release: Jev 1.14, pplx-decider v1.2, Drex Max v1.1 and Drex Max v1. The 'GPT-6 Luna' and 'GLiDE' columns are not stored: GPT-6 Luna: a bare 'GPT-6 Luna' label names OpenAI's chat model, which is not a Decisions system; Nace writes 'GPT-6 Luna Decisions' when it means that endpoint; GLiDE: no release named, and GLiDE (September 2026) and GLiDE v1.2 are both registered.

Nace.AI's 2 November 2026 Drex for Finance release table, checked 6 November 2026. The Drex Finance Index combines 48 public finance test sets held out from training (3,361 decisions); each set is scored as skill above chance, 0 a coin flip and 100 every answer right, with below-chance sets counted as 0. Nace has not published the test-set list, revisions, execution dates or harness. Vendor run; not ranked and not blended with community or independent results. Category score: chance-corrected skill on that category's test sets. Peer columns mapped only where the label names a registered release: Jev 1.14, pplx-decider v1.2, Drex Max v1.1 and Drex Max v1. The 'GPT-6 Luna' and 'GLiDE' columns are not stored: GPT-6 Luna: a bare 'GPT-6 Luna' label names OpenAI's chat model, which is not a Decisions system; Nace writes 'GPT-6 Luna Decisions' when it means that endpoint; GLiDE: no release named, and GLiDE (September 2026) and GLiDE v1.2 are both registered.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-11-02 · Revision: 2026-11-06 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex for Finance launch · ESG & climate59.40
Setup & source

Nace Drex for Finance launch · ESG & climate

'Drex Max v1.1 Nace' column of the comparison table in Nace's 2 November 2026 Drex for Finance release post; Nace-run.

Nace.AI's 2 November 2026 Drex for Finance release table, checked 6 November 2026. The Drex Finance Index combines 48 public finance test sets held out from training (3,361 decisions); each set is scored as skill above chance, 0 a coin flip and 100 every answer right, with below-chance sets counted as 0. Nace has not published the test-set list, revisions, execution dates or harness. Vendor run; not ranked and not blended with community or independent results. Category score: chance-corrected skill on that category's test sets. Peer columns mapped only where the label names a registered release: Jev 1.14, pplx-decider v1.2, Drex Max v1.1 and Drex Max v1. The 'GPT-6 Luna' and 'GLiDE' columns are not stored: GPT-6 Luna: a bare 'GPT-6 Luna' label names OpenAI's chat model, which is not a Decisions system; Nace writes 'GPT-6 Luna Decisions' when it means that endpoint; GLiDE: no release named, and GLiDE (September 2026) and GLiDE v1.2 are both registered.

Nace.AI's 2 November 2026 Drex for Finance release table, checked 6 November 2026. The Drex Finance Index combines 48 public finance test sets held out from training (3,361 decisions); each set is scored as skill above chance, 0 a coin flip and 100 every answer right, with below-chance sets counted as 0. Nace has not published the test-set list, revisions, execution dates or harness. Vendor run; not ranked and not blended with community or independent results. Category score: chance-corrected skill on that category's test sets. Peer columns mapped only where the label names a registered release: Jev 1.14, pplx-decider v1.2, Drex Max v1.1 and Drex Max v1. The 'GPT-6 Luna' and 'GLiDE' columns are not stored: GPT-6 Luna: a bare 'GPT-6 Luna' label names OpenAI's chat model, which is not a Decisions system; Nace writes 'GPT-6 Luna Decisions' when it means that endpoint; GLiDE: no release named, and GLiDE (September 2026) and GLiDE v1.2 are both registered.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-11-02 · Revision: 2026-11-06 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex for Finance launch · Markets & reasoning43.00
Setup & source

Nace Drex for Finance launch · Markets & reasoning

'Drex Max v1.1 Nace' column of the comparison table in Nace's 2 November 2026 Drex for Finance release post; Nace-run.

Nace.AI's 2 November 2026 Drex for Finance release table, checked 6 November 2026. The Drex Finance Index combines 48 public finance test sets held out from training (3,361 decisions); each set is scored as skill above chance, 0 a coin flip and 100 every answer right, with below-chance sets counted as 0. Nace has not published the test-set list, revisions, execution dates or harness. Vendor run; not ranked and not blended with community or independent results. Category score: chance-corrected skill on that category's test sets. Peer columns mapped only where the label names a registered release: Jev 1.14, pplx-decider v1.2, Drex Max v1.1 and Drex Max v1. The 'GPT-6 Luna' and 'GLiDE' columns are not stored: GPT-6 Luna: a bare 'GPT-6 Luna' label names OpenAI's chat model, which is not a Decisions system; Nace writes 'GPT-6 Luna Decisions' when it means that endpoint; GLiDE: no release named, and GLiDE (September 2026) and GLiDE v1.2 are both registered.

Nace.AI's 2 November 2026 Drex for Finance release table, checked 6 November 2026. The Drex Finance Index combines 48 public finance test sets held out from training (3,361 decisions); each set is scored as skill above chance, 0 a coin flip and 100 every answer right, with below-chance sets counted as 0. Nace has not published the test-set list, revisions, execution dates or harness. Vendor run; not ranked and not blended with community or independent results. Category score: chance-corrected skill on that category's test sets. Peer columns mapped only where the label names a registered release: Jev 1.14, pplx-decider v1.2, Drex Max v1.1 and Drex Max v1. The 'GPT-6 Luna' and 'GLiDE' columns are not stored: GPT-6 Luna: a bare 'GPT-6 Luna' label names OpenAI's chat model, which is not a Decisions system; Nace writes 'GPT-6 Luna Decisions' when it means that endpoint; GLiDE: no release named, and GLiDE (September 2026) and GLiDE v1.2 are both registered.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-11-02 · Revision: 2026-11-06 · Published observations; result reuse terms not specified

Result source · Benchmark source

Official / vendor · Nace.AI results dataset (vendor measured)

Drex Max v1.1 · Official / vendor · Nace.AI results dataset (vendor measured)
EvaluationResultEvidence
Nace Drex Max v1.1 results · Knowledge & Reasoning (public skill)58.7 points
Setup & source

Knowledge & Reasoning area skill × 100 (11 benchmarks) from Nace's own Decision Index 0.3 public-suite run of Drex Max v1.1.

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on one NVIDIA B200 per worker; Decision Index kit c254f8d, public suite release-v3, 140,178 scoreable requests, edition 0.3 scoring. Not a run of the hosted API.

Published as skill 0.5867 on a 0–1 scale; raw (not chance-corrected) 0.6651; coverage 1.0; 11 benchmarks. The README prints 58.7.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Text run: the frozen public suite release-v3 (rows_sha256 b2b56d6fb636…, 140,620 requests, 140,178 scoreable, 43 benchmarks, 37 in the index), the same files as the original Drex Max's results dataset, scored on 27 October 2026 with Decision Index kit c254f8d (--edition 0.3) and labelled the Decision Index 0.4 public suite. The public index is 100 × the weighted mean of five area skills; each benchmark is chance-corrected, (score − chance) / (1 − chance) clipped to 0–1, and coverage-adjusted. scores.json also gives a raw index of 77.92 and a breadth skill of 70.15, not stored as columns. Its latency fields are in-process wall time under batched inference on one NVIDIA B200 per worker, not serving latency, and are not stored.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · Language Understanding (public skill)74.4 points
Setup & source

Language Understanding area skill × 100 (9 benchmarks) from Nace's own Decision Index 0.3 public-suite run of Drex Max v1.1.

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on one NVIDIA B200 per worker; Decision Index kit c254f8d, public suite release-v3, 140,178 scoreable requests, edition 0.3 scoring. Not a run of the hosted API.

Published as skill 0.7437 on a 0–1 scale; raw (not chance-corrected) 0.8189; coverage 1.0; 9 benchmarks. The README prints 74.4.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Text run: the frozen public suite release-v3 (rows_sha256 b2b56d6fb636…, 140,620 requests, 140,178 scoreable, 43 benchmarks, 37 in the index), the same files as the original Drex Max's results dataset, scored on 27 October 2026 with Decision Index kit c254f8d (--edition 0.3) and labelled the Decision Index 0.4 public suite. The public index is 100 × the weighted mean of five area skills; each benchmark is chance-corrected, (score − chance) / (1 − chance) clipped to 0–1, and coverage-adjusted. scores.json also gives a raw index of 77.92 and a breadth skill of 70.15, not stored as columns. Its latency fields are in-process wall time under batched inference on one NVIDIA B200 per worker, not serving latency, and are not stored.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · Retrieval & Classification (public skill)71.0 points
Setup & source

Retrieval & Classification area skill × 100 (6 benchmarks) from Nace's own Decision Index 0.3 public-suite run of Drex Max v1.1.

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on one NVIDIA B200 per worker; Decision Index kit c254f8d, public suite release-v3, 140,178 scoreable requests, edition 0.3 scoring. Not a run of the hosted API.

Published as skill 0.7104 on a 0–1 scale; raw (not chance-corrected) 0.7802; coverage 1.0; 6 benchmarks. The README prints 71.0.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Text run: the frozen public suite release-v3 (rows_sha256 b2b56d6fb636…, 140,620 requests, 140,178 scoreable, 43 benchmarks, 37 in the index), the same files as the original Drex Max's results dataset, scored on 27 October 2026 with Decision Index kit c254f8d (--edition 0.3) and labelled the Decision Index 0.4 public suite. The public index is 100 × the weighted mean of five area skills; each benchmark is chance-corrected, (score − chance) / (1 − chance) clipped to 0–1, and coverage-adjusted. scores.json also gives a raw index of 77.92 and a breadth skill of 70.15, not stored as columns. Its latency fields are in-process wall time under batched inference on one NVIDIA B200 per worker, not serving latency, and are not stored.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · Tools & Automation (public skill)88.0 points
Setup & source

Tools & Automation area skill × 100 (5 benchmarks) from Nace's own Decision Index 0.3 public-suite run of Drex Max v1.1.

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on one NVIDIA B200 per worker; Decision Index kit c254f8d, public suite release-v3, 140,178 scoreable requests, edition 0.3 scoring. Not a run of the hosted API.

Published as skill 0.8802 on a 0–1 scale; raw (not chance-corrected) 0.8961; coverage 1.0; 5 benchmarks. The README prints 88.0.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Text run: the frozen public suite release-v3 (rows_sha256 b2b56d6fb636…, 140,620 requests, 140,178 scoreable, 43 benchmarks, 37 in the index), the same files as the original Drex Max's results dataset, scored on 27 October 2026 with Decision Index kit c254f8d (--edition 0.3) and labelled the Decision Index 0.4 public suite. The public index is 100 × the weighted mean of five area skills; each benchmark is chance-corrected, (score − chance) / (1 − chance) clipped to 0–1, and coverage-adjusted. scores.json also gives a raw index of 77.92 and a breadth skill of 70.15, not stored as columns. Its latency fields are in-process wall time under batched inference on one NVIDIA B200 per worker, not serving latency, and are not stored.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · Arts & Human Taste (public skill)60.8 points
Setup & source

Arts & Human Taste area skill × 100 (6 benchmarks) from Nace's own Decision Index 0.3 public-suite run of Drex Max v1.1.

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on one NVIDIA B200 per worker; Decision Index kit c254f8d, public suite release-v3, 140,178 scoreable requests, edition 0.3 scoring. Not a run of the hosted API.

Published as skill 0.6082 on a 0–1 scale; raw (not chance-corrected) 0.7562; coverage 1.0; 6 benchmarks. The README prints 60.8.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Text run: the frozen public suite release-v3 (rows_sha256 b2b56d6fb636…, 140,620 requests, 140,178 scoreable, 43 benchmarks, 37 in the index), the same files as the original Drex Max's results dataset, scored on 27 October 2026 with Decision Index kit c254f8d (--edition 0.3) and labelled the Decision Index 0.4 public suite. The public index is 100 × the weighted mean of five area skills; each benchmark is chance-corrected, (score − chance) / (1 − chance) clipped to 0–1, and coverage-adjusted. scores.json also gives a raw index of 77.92 and a breadth skill of 70.15, not stored as columns. Its latency fields are in-process wall time under batched inference on one NVIDIA B200 per worker, not serving latency, and are not stored.

Checked / reported: 2026-11-06 · Samples: Not published

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · ToolRet (nDCG@10)69.75%
Setup & source

ToolRet, nDCG@10, from Nace's own Decision Index 0.3 public-suite run of Drex Max v1.1 (685 scored requests).

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on one NVIDIA B200 per worker; Decision Index kit c254f8d, public suite release-v3, 140,178 scoreable requests, edition 0.3 scoring. Not a run of the hosted API.

Published as 0.6975309230172237 on a 0–1 scale (nDCG@10). Index component: raw 0.6975, chance-corrected skill 0.6507, chance 0.1341; in the public index. Nace's Drex page shows 71.1 for v1.1 on ToolRet without naming the run; that row is kept separately.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Text run: the frozen public suite release-v3 (rows_sha256 b2b56d6fb636…, 140,620 requests, 140,178 scoreable, 43 benchmarks, 37 in the index), the same files as the original Drex Max's results dataset, scored on 27 October 2026 with Decision Index kit c254f8d (--edition 0.3) and labelled the Decision Index 0.4 public suite. The public index is 100 × the weighted mean of five area skills; each benchmark is chance-corrected, (score − chance) / (1 − chance) clipped to 0–1, and coverage-adjusted. scores.json also gives a raw index of 77.92 and a breadth skill of 70.15, not stored as columns. Its latency fields are in-process wall time under batched inference on one NVIDIA B200 per worker, not serving latency, and are not stored. Nace's Drex page shows 71.1 for v1.1 on ToolRet without naming the run; that row is kept separately.

Checked / reported: 2026-11-06 · Samples: 685

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · API-Bank (accuracy)88.39%
Setup & source

API-Bank, accuracy, from Nace's own Decision Index 0.3 public-suite run of Drex Max v1.1 (508 scored requests).

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on one NVIDIA B200 per worker; Decision Index kit c254f8d, public suite release-v3, 140,178 scoreable requests, edition 0.3 scoring. Not a run of the hosted API.

Published as 0.8838582677165354 on a 0–1 scale (accuracy). Index component: raw 0.8839, chance-corrected skill 0.8817, chance 0.0189; in the public index.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Text run: the frozen public suite release-v3 (rows_sha256 b2b56d6fb636…, 140,620 requests, 140,178 scoreable, 43 benchmarks, 37 in the index), the same files as the original Drex Max's results dataset, scored on 27 October 2026 with Decision Index kit c254f8d (--edition 0.3) and labelled the Decision Index 0.4 public suite. The public index is 100 × the weighted mean of five area skills; each benchmark is chance-corrected, (score − chance) / (1 − chance) clipped to 0–1, and coverage-adjusted. scores.json also gives a raw index of 77.92 and a breadth skill of 70.15, not stored as columns. Its latency fields are in-process wall time under batched inference on one NVIDIA B200 per worker, not serving latency, and are not stored.

Checked / reported: 2026-11-06 · Samples: 508

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · BANKING77 (macro-F1)91.10%
Setup & source

BANKING77, macro-F1, from Nace's own Decision Index 0.3 public-suite run of Drex Max v1.1 (3,080 scored requests).

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on one NVIDIA B200 per worker; Decision Index kit c254f8d, public suite release-v3, 140,178 scoreable requests, edition 0.3 scoring. Not a run of the hosted API.

Published as 0.9110202695358018 on a 0–1 scale (macro-F1). Index component: raw 0.911, chance-corrected skill 0.9099, chance 0.0127; in the public index.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Text run: the frozen public suite release-v3 (rows_sha256 b2b56d6fb636…, 140,620 requests, 140,178 scoreable, 43 benchmarks, 37 in the index), the same files as the original Drex Max's results dataset, scored on 27 October 2026 with Decision Index kit c254f8d (--edition 0.3) and labelled the Decision Index 0.4 public suite. The public index is 100 × the weighted mean of five area skills; each benchmark is chance-corrected, (score − chance) / (1 − chance) clipped to 0–1, and coverage-adjusted. scores.json also gives a raw index of 77.92 and a breadth skill of 70.15, not stored as columns. Its latency fields are in-process wall time under batched inference on one NVIDIA B200 per worker, not serving latency, and are not stored.

Checked / reported: 2026-11-06 · Samples: 3080

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · CLINC150+OOS (macro-F1)94.90%
Setup & source

CLINC150+OOS, macro-F1, from Nace's own Decision Index 0.3 public-suite run of Drex Max v1.1 (5,500 scored requests).

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on one NVIDIA B200 per worker; Decision Index kit c254f8d, public suite release-v3, 140,178 scoreable requests, edition 0.3 scoring. Not a run of the hosted API.

Published as 0.9489644166290192 on a 0–1 scale (macro-F1). Index component: raw 0.949, chance-corrected skill 0.9487, chance 0.006; in the public index.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Text run: the frozen public suite release-v3 (rows_sha256 b2b56d6fb636…, 140,620 requests, 140,178 scoreable, 43 benchmarks, 37 in the index), the same files as the original Drex Max's results dataset, scored on 27 October 2026 with Decision Index kit c254f8d (--edition 0.3) and labelled the Decision Index 0.4 public suite. The public index is 100 × the weighted mean of five area skills; each benchmark is chance-corrected, (score − chance) / (1 − chance) clipped to 0–1, and coverage-adjusted. scores.json also gives a raw index of 77.92 and a breadth skill of 70.15, not stored as columns. Its latency fields are in-process wall time under batched inference on one NVIDIA B200 per worker, not serving latency, and are not stored.

Checked / reported: 2026-11-06 · Samples: 5500

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · RouterBench (selected quality (quality objective))79.56%
Setup & source

RouterBench, selected quality (quality objective), from Nace's own Decision Index 0.3 public-suite run of Drex Max v1.1 (10,000 scored requests).

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on one NVIDIA B200 per worker; Decision Index kit c254f8d, public suite release-v3, 140,178 scoreable requests, edition 0.3 scoring. Not a run of the hosted API.

Published as 0.795645 on a 0–1 scale (selected quality (quality objective)). Index component: raw 0.7956, chance-corrected skill 0.5208, chance 0.5735; not in the public index.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Text run: the frozen public suite release-v3 (rows_sha256 b2b56d6fb636…, 140,620 requests, 140,178 scoreable, 43 benchmarks, 37 in the index), the same files as the original Drex Max's results dataset, scored on 27 October 2026 with Decision Index kit c254f8d (--edition 0.3) and labelled the Decision Index 0.4 public suite. The public index is 100 × the weighted mean of five area skills; each benchmark is chance-corrected, (score − chance) / (1 − chance) clipped to 0–1, and coverage-adjusted. scores.json also gives a raw index of 77.92 and a breadth skill of 70.15, not stored as columns. Its latency fields are in-process wall time under batched inference on one NVIDIA B200 per worker, not serving latency, and are not stored.

Checked / reported: 2026-11-06 · Samples: 10000

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · Home appliance simulator (case exact accuracy)98.86%
Setup & source

Home appliance simulator, case exact accuracy, from Nace's own Decision Index 0.3 public-suite run of Drex Max v1.1 (88 scored requests).

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on one NVIDIA B200 per worker; Decision Index kit c254f8d, public suite release-v3, 140,178 scoreable requests, edition 0.3 scoring. Not a run of the hosted API.

Published as 0.9886363636363636 on a 0–1 scale (case exact accuracy). Index component: raw 0.9886, chance-corrected skill 0.9886, chance 0.0; in the public index.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Text run: the frozen public suite release-v3 (rows_sha256 b2b56d6fb636…, 140,620 requests, 140,178 scoreable, 43 benchmarks, 37 in the index), the same files as the original Drex Max's results dataset, scored on 27 October 2026 with Decision Index kit c254f8d (--edition 0.3) and labelled the Decision Index 0.4 public suite. The public index is 100 × the weighted mean of five area skills; each benchmark is chance-corrected, (score − chance) / (1 − chance) clipped to 0–1, and coverage-adjusted. scores.json also gives a raw index of 77.92 and a breadth skill of 70.15, not stored as columns. Its latency fields are in-process wall time under batched inference on one NVIDIA B200 per worker, not serving latency, and are not stored.

Checked / reported: 2026-11-06 · Samples: 88

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · SGD/SGD-X (macro-F1)64.88%
Setup & source

SGD/SGD-X, macro-F1, from Nace's own Decision Index 0.3 public-suite run of Drex Max v1.1 (2,500 scored requests).

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on one NVIDIA B200 per worker; Decision Index kit c254f8d, public suite release-v3, 140,178 scoreable requests, edition 0.3 scoring. Not a run of the hosted API.

Published as 0.6487726234097377 on a 0–1 scale (macro-F1). Index component: raw 0.6488, chance-corrected skill 0.4156, chance 0.399; not in the public index.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Text run: the frozen public suite release-v3 (rows_sha256 b2b56d6fb636…, 140,620 requests, 140,178 scoreable, 43 benchmarks, 37 in the index), the same files as the original Drex Max's results dataset, scored on 27 October 2026 with Decision Index kit c254f8d (--edition 0.3) and labelled the Decision Index 0.4 public suite. The public index is 100 × the weighted mean of five area skills; each benchmark is chance-corrected, (score − chance) / (1 − chance) clipped to 0–1, and coverage-adjusted. scores.json also gives a raw index of 77.92 and a breadth skill of 70.15, not stored as columns. Its latency fields are in-process wall time under batched inference on one NVIDIA B200 per worker, not serving latency, and are not stored.

Checked / reported: 2026-11-06 · Samples: 2500

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · ContractNLI (macro-F1)83.86%
Setup & source

ContractNLI, macro-F1, from Nace's own Decision Index 0.3 public-suite run of Drex Max v1.1 (123 scored requests).

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on one NVIDIA B200 per worker; Decision Index kit c254f8d, public suite release-v3, 140,178 scoreable requests, edition 0.3 scoring. Not a run of the hosted API.

Published as 0.8385590124954193 on a 0–1 scale (macro-F1). Index component: raw 0.8386, chance-corrected skill 0.7665, chance 0.3085; in the public index.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Text run: the frozen public suite release-v3 (rows_sha256 b2b56d6fb636…, 140,620 requests, 140,178 scoreable, 43 benchmarks, 37 in the index), the same files as the original Drex Max's results dataset, scored on 27 October 2026 with Decision Index kit c254f8d (--edition 0.3) and labelled the Decision Index 0.4 public suite. The public index is 100 × the weighted mean of five area skills; each benchmark is chance-corrected, (score − chance) / (1 − chance) clipped to 0–1, and coverage-adjusted. scores.json also gives a raw index of 77.92 and a breadth skill of 70.15, not stored as columns. Its latency fields are in-process wall time under batched inference on one NVIDIA B200 per worker, not serving latency, and are not stored.

Checked / reported: 2026-11-06 · Samples: 123

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · ANLI (macro-F1)76.50%
Setup & source

ANLI, macro-F1, from Nace's own Decision Index 0.3 public-suite run of Drex Max v1.1 (3,200 scored requests).

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on one NVIDIA B200 per worker; Decision Index kit c254f8d, public suite release-v3, 140,178 scoreable requests, edition 0.3 scoring. Not a run of the hosted API.

Published as 0.7649914358869888 on a 0–1 scale (macro-F1). Index component: raw 0.765, chance-corrected skill 0.648, chance 0.3324; in the public index.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Text run: the frozen public suite release-v3 (rows_sha256 b2b56d6fb636…, 140,620 requests, 140,178 scoreable, 43 benchmarks, 37 in the index), the same files as the original Drex Max's results dataset, scored on 27 October 2026 with Decision Index kit c254f8d (--edition 0.3) and labelled the Decision Index 0.4 public suite. The public index is 100 × the weighted mean of five area skills; each benchmark is chance-corrected, (score − chance) / (1 − chance) clipped to 0–1, and coverage-adjusted. scores.json also gives a raw index of 77.92 and a breadth skill of 70.15, not stored as columns. Its latency fields are in-process wall time under batched inference on one NVIDIA B200 per worker, not serving latency, and are not stored.

Checked / reported: 2026-11-06 · Samples: 3200

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · BPoMP (accuracy)97.34%
Setup & source

BPoMP, accuracy, from Nace's own Decision Index 0.3 public-suite run of Drex Max v1.1 (5,000 scored requests).

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on one NVIDIA B200 per worker; Decision Index kit c254f8d, public suite release-v3, 140,178 scoreable requests, edition 0.3 scoring. Not a run of the hosted API.

Published as 0.9734 on a 0–1 scale (accuracy). Index component: raw 0.9738, chance-corrected skill 0.9477, chance 0.5; in the public index.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Text run: the frozen public suite release-v3 (rows_sha256 b2b56d6fb636…, 140,620 requests, 140,178 scoreable, 43 benchmarks, 37 in the index), the same files as the original Drex Max's results dataset, scored on 27 October 2026 with Decision Index kit c254f8d (--edition 0.3) and labelled the Decision Index 0.4 public suite. The public index is 100 × the weighted mean of five area skills; each benchmark is chance-corrected, (score − chance) / (1 − chance) clipped to 0–1, and coverage-adjusted. scores.json also gives a raw index of 77.92 and a breadth skill of 70.15, not stored as columns. Its latency fields are in-process wall time under batched inference on one NVIDIA B200 per worker, not serving latency, and are not stored.

Checked / reported: 2026-11-06 · Samples: 5000

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · Humicroedit (accuracy)67.73%
Setup & source

Humicroedit, accuracy, from Nace's own Decision Index 0.3 public-suite run of Drex Max v1.1 (2,628 scored requests).

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on one NVIDIA B200 per worker; Decision Index kit c254f8d, public suite release-v3, 140,178 scoreable requests, edition 0.3 scoring. Not a run of the hosted API.

Published as 0.6773211567732116 on a 0–1 scale (accuracy). Index component: raw 0.6773, chance-corrected skill 0.3546, chance 0.5; in the public index.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Text run: the frozen public suite release-v3 (rows_sha256 b2b56d6fb636…, 140,620 requests, 140,178 scoreable, 43 benchmarks, 37 in the index), the same files as the original Drex Max's results dataset, scored on 27 October 2026 with Decision Index kit c254f8d (--edition 0.3) and labelled the Decision Index 0.4 public suite. The public index is 100 × the weighted mean of five area skills; each benchmark is chance-corrected, (score − chance) / (1 − chance) clipped to 0–1, and coverage-adjusted. scores.json also gives a raw index of 77.92 and a breadth skill of 70.15, not stored as columns. Its latency fields are in-process wall time under batched inference on one NVIDIA B200 per worker, not serving latency, and are not stored.

Checked / reported: 2026-11-06 · Samples: 2628

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · POP909-CL (accuracy)77.20%
Setup & source

POP909-CL, accuracy, from Nace's own Decision Index 0.3 public-suite run of Drex Max v1.1 (2,000 scored requests).

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on one NVIDIA B200 per worker; Decision Index kit c254f8d, public suite release-v3, 140,178 scoreable requests, edition 0.3 scoring. Not a run of the hosted API.

Published as 0.772 on a 0–1 scale (accuracy). Index component: raw 0.7707, chance-corrected skill 0.7689, chance 0.0078; in the public index.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Text run: the frozen public suite release-v3 (rows_sha256 b2b56d6fb636…, 140,620 requests, 140,178 scoreable, 43 benchmarks, 37 in the index), the same files as the original Drex Max's results dataset, scored on 27 October 2026 with Decision Index kit c254f8d (--edition 0.3) and labelled the Decision Index 0.4 public suite. The public index is 100 × the weighted mean of five area skills; each benchmark is chance-corrected, (score − chance) / (1 − chance) clipped to 0–1, and coverage-adjusted. scores.json also gives a raw index of 77.92 and a breadth skill of 70.15, not stored as columns. Its latency fields are in-process wall time under batched inference on one NVIDIA B200 per worker, not serving latency, and are not stored.

Checked / reported: 2026-11-06 · Samples: 2000

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · cfcolor (accuracy)65.34%
Setup & source

cfcolor, accuracy, from Nace's own Decision Index 0.3 public-suite run of Drex Max v1.1 (5,000 scored requests).

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on one NVIDIA B200 per worker; Decision Index kit c254f8d, public suite release-v3, 140,178 scoreable requests, edition 0.3 scoring. Not a run of the hosted API.

Published as 0.6534 on a 0–1 scale (accuracy). Index component: raw 0.6784, chance-corrected skill 0.3568, chance 0.5; in the public index.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Text run: the frozen public suite release-v3 (rows_sha256 b2b56d6fb636…, 140,620 requests, 140,178 scoreable, 43 benchmarks, 37 in the index), the same files as the original Drex Max's results dataset, scored on 27 October 2026 with Decision Index kit c254f8d (--edition 0.3) and labelled the Decision Index 0.4 public suite. The public index is 100 × the weighted mean of five area skills; each benchmark is chance-corrected, (score − chance) / (1 − chance) clipped to 0–1, and coverage-adjusted. scores.json also gives a raw index of 77.92 and a breadth skill of 70.15, not stored as columns. Its latency fields are in-process wall time under batched inference on one NVIDIA B200 per worker, not serving latency, and are not stored.

Checked / reported: 2026-11-06 · Samples: 5000

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · MMLU (accuracy)87.36%
Setup & source

MMLU, accuracy, from Nace's own Decision Index 0.3 public-suite run of Drex Max v1.1 (14,033 scored requests).

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on one NVIDIA B200 per worker; Decision Index kit c254f8d, public suite release-v3, 140,178 scoreable requests, edition 0.3 scoring. Not a run of the hosted API.

Published as 0.8735836955747167 on a 0–1 scale (accuracy). Index component: raw 0.8736, chance-corrected skill 0.8315, chance 0.25; not in the public index.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Text run: the frozen public suite release-v3 (rows_sha256 b2b56d6fb636…, 140,620 requests, 140,178 scoreable, 43 benchmarks, 37 in the index), the same files as the original Drex Max's results dataset, scored on 27 October 2026 with Decision Index kit c254f8d (--edition 0.3) and labelled the Decision Index 0.4 public suite. The public index is 100 × the weighted mean of five area skills; each benchmark is chance-corrected, (score − chance) / (1 − chance) clipped to 0–1, and coverage-adjusted. scores.json also gives a raw index of 77.92 and a breadth skill of 70.15, not stored as columns. Its latency fields are in-process wall time under batched inference on one NVIDIA B200 per worker, not serving latency, and are not stored.

Checked / reported: 2026-11-06 · Samples: 14033

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · GPQA Diamond (accuracy)54.59%
Setup & source

GPQA Diamond, accuracy, from Nace's own Decision Index 0.3 public-suite run of Drex Max v1.1 (196 scored requests).

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on one NVIDIA B200 per worker; Decision Index kit c254f8d, public suite release-v3, 140,178 scoreable requests, edition 0.3 scoring. Not a run of the hosted API.

Published as 0.5459183673469388 on a 0–1 scale (accuracy). Index component: raw 0.5459, chance-corrected skill 0.3946, chance 0.25; in the public index.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Text run: the frozen public suite release-v3 (rows_sha256 b2b56d6fb636…, 140,620 requests, 140,178 scoreable, 43 benchmarks, 37 in the index), the same files as the original Drex Max's results dataset, scored on 27 October 2026 with Decision Index kit c254f8d (--edition 0.3) and labelled the Decision Index 0.4 public suite. The public index is 100 × the weighted mean of five area skills; each benchmark is chance-corrected, (score − chance) / (1 − chance) clipped to 0–1, and coverage-adjusted. scores.json also gives a raw index of 77.92 and a breadth skill of 70.15, not stored as columns. Its latency fields are in-process wall time under batched inference on one NVIDIA B200 per worker, not serving latency, and are not stored.

Checked / reported: 2026-11-06 · Samples: 196

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · WinoGrande (accuracy)93.45%
Setup & source

WinoGrande, accuracy, from Nace's own Decision Index 0.3 public-suite run of Drex Max v1.1 (1,267 scored requests).

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on one NVIDIA B200 per worker; Decision Index kit c254f8d, public suite release-v3, 140,178 scoreable requests, edition 0.3 scoring. Not a run of the hosted API.

Published as 0.9344909234411997 on a 0–1 scale (accuracy). Index component: raw 0.9345, chance-corrected skill 0.869, chance 0.5; in the public index.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Text run: the frozen public suite release-v3 (rows_sha256 b2b56d6fb636…, 140,620 requests, 140,178 scoreable, 43 benchmarks, 37 in the index), the same files as the original Drex Max's results dataset, scored on 27 October 2026 with Decision Index kit c254f8d (--edition 0.3) and labelled the Decision Index 0.4 public suite. The public index is 100 × the weighted mean of five area skills; each benchmark is chance-corrected, (score − chance) / (1 − chance) clipped to 0–1, and coverage-adjusted. scores.json also gives a raw index of 77.92 and a breadth skill of 70.15, not stored as columns. Its latency fields are in-process wall time under batched inference on one NVIDIA B200 per worker, not serving latency, and are not stored.

Checked / reported: 2026-11-06 · Samples: 1267

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · HellaSwag (accuracy)97.05%
Setup & source

HellaSwag, accuracy, from Nace's own Decision Index 0.3 public-suite run of Drex Max v1.1 (10,042 scored requests).

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on one NVIDIA B200 per worker; Decision Index kit c254f8d, public suite release-v3, 140,178 scoreable requests, edition 0.3 scoring. Not a run of the hosted API.

Published as 0.9705238000398327 on a 0–1 scale (accuracy). Index component: raw 0.9705, chance-corrected skill 0.9607, chance 0.25; in the public index. Nace's Drex page shows 98.1 for v1.1 on HellaSwag without naming the run; that row is kept separately.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Text run: the frozen public suite release-v3 (rows_sha256 b2b56d6fb636…, 140,620 requests, 140,178 scoreable, 43 benchmarks, 37 in the index), the same files as the original Drex Max's results dataset, scored on 27 October 2026 with Decision Index kit c254f8d (--edition 0.3) and labelled the Decision Index 0.4 public suite. The public index is 100 × the weighted mean of five area skills; each benchmark is chance-corrected, (score − chance) / (1 − chance) clipped to 0–1, and coverage-adjusted. scores.json also gives a raw index of 77.92 and a breadth skill of 70.15, not stored as columns. Its latency fields are in-process wall time under batched inference on one NVIDIA B200 per worker, not serving latency, and are not stored. Nace's Drex page shows 98.1 for v1.1 on HellaSwag without naming the run; that row is kept separately.

Checked / reported: 2026-11-06 · Samples: 10042

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · ChessBench (accuracy)25.80%
Setup & source

ChessBench, accuracy, from Nace's own Decision Index 0.3 public-suite run of Drex Max v1.1 (5,000 scored requests).

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on one NVIDIA B200 per worker; Decision Index kit c254f8d, public suite release-v3, 140,178 scoreable requests, edition 0.3 scoring. Not a run of the hosted API.

Published as 0.258 on a 0–1 scale (accuracy). Index component: raw 0.258, chance-corrected skill 0.1918, chance 0.0819; in the public index.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Text run: the frozen public suite release-v3 (rows_sha256 b2b56d6fb636…, 140,620 requests, 140,178 scoreable, 43 benchmarks, 37 in the index), the same files as the original Drex Max's results dataset, scored on 27 October 2026 with Decision Index kit c254f8d (--edition 0.3) and labelled the Decision Index 0.4 public suite. The public index is 100 × the weighted mean of five area skills; each benchmark is chance-corrected, (score − chance) / (1 − chance) clipped to 0–1, and coverage-adjusted. scores.json also gives a raw index of 77.92 and a breadth skill of 70.15, not stored as columns. Its latency fields are in-process wall time under batched inference on one NVIDIA B200 per worker, not serving latency, and are not stored.

Checked / reported: 2026-11-06 · Samples: 5000

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · MuSR (accuracy)71.54%
Setup & source

MuSR, accuracy, from Nace's own Decision Index 0.3 public-suite run of Drex Max v1.1 (752 scored requests).

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on one NVIDIA B200 per worker; Decision Index kit c254f8d, public suite release-v3, 140,178 scoreable requests, edition 0.3 scoring. Not a run of the hosted API.

Published as 0.7154255319148937 on a 0–1 scale (accuracy). Index component: raw 0.7154, chance-corrected skill 0.5475, chance 0.371; in the public index.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Text run: the frozen public suite release-v3 (rows_sha256 b2b56d6fb636…, 140,620 requests, 140,178 scoreable, 43 benchmarks, 37 in the index), the same files as the original Drex Max's results dataset, scored on 27 October 2026 with Decision Index kit c254f8d (--edition 0.3) and labelled the Decision Index 0.4 public suite. The public index is 100 × the weighted mean of five area skills; each benchmark is chance-corrected, (score − chance) / (1 − chance) clipped to 0–1, and coverage-adjusted. scores.json also gives a raw index of 77.92 and a breadth skill of 70.15, not stored as columns. Its latency fields are in-process wall time under batched inference on one NVIDIA B200 per worker, not serving latency, and are not stored.

Checked / reported: 2026-11-06 · Samples: 752

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · SATA-Bench (case exact accuracy)38.06%
Setup & source

SATA-Bench, case exact accuracy, from Nace's own Decision Index 0.3 public-suite run of Drex Max v1.1 (1,650 scored requests).

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on one NVIDIA B200 per worker; Decision Index kit c254f8d, public suite release-v3, 140,178 scoreable requests, edition 0.3 scoring. Not a run of the hosted API.

Published as 0.3806060606060606 on a 0–1 scale (case exact accuracy). Index component: raw 0.3806, chance-corrected skill 0.3724, chance 0.0131; in the public index.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Text run: the frozen public suite release-v3 (rows_sha256 b2b56d6fb636…, 140,620 requests, 140,178 scoreable, 43 benchmarks, 37 in the index), the same files as the original Drex Max's results dataset, scored on 27 October 2026 with Decision Index kit c254f8d (--edition 0.3) and labelled the Decision Index 0.4 public suite. The public index is 100 × the weighted mean of five area skills; each benchmark is chance-corrected, (score − chance) / (1 − chance) clipped to 0–1, and coverage-adjusted. scores.json also gives a raw index of 77.92 and a breadth skill of 70.15, not stored as columns. Its latency fields are in-process wall time under batched inference on one NVIDIA B200 per worker, not serving latency, and are not stored.

Checked / reported: 2026-11-06 · Samples: 1650

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · SimpleBench (accuracy)30.00%
Setup & source

SimpleBench, accuracy, from Nace's own Decision Index 0.3 public-suite run of Drex Max v1.1 (10 scored requests).

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on one NVIDIA B200 per worker; Decision Index kit c254f8d, public suite release-v3, 140,178 scoreable requests, edition 0.3 scoring. Not a run of the hosted API.

Published as 0.3 on a 0–1 scale (accuracy). Index component: raw 0.3, chance-corrected skill 0.16, chance 0.1667; not in the public index.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Text run: the frozen public suite release-v3 (rows_sha256 b2b56d6fb636…, 140,620 requests, 140,178 scoreable, 43 benchmarks, 37 in the index), the same files as the original Drex Max's results dataset, scored on 27 October 2026 with Decision Index kit c254f8d (--edition 0.3) and labelled the Decision Index 0.4 public suite. The public index is 100 × the weighted mean of five area skills; each benchmark is chance-corrected, (score − chance) / (1 − chance) clipped to 0–1, and coverage-adjusted. scores.json also gives a raw index of 77.92 and a breadth skill of 70.15, not stored as columns. Its latency fields are in-process wall time under batched inference on one NVIDIA B200 per worker, not serving latency, and are not stored.

Checked / reported: 2026-11-06 · Samples: 10

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · BRIGHT (nDCG@10)49.61%
Setup & source

BRIGHT, nDCG@10, from Nace's own Decision Index 0.3 public-suite run of Drex Max v1.1 (220 scored requests).

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on one NVIDIA B200 per worker; Decision Index kit c254f8d, public suite release-v3, 140,178 scoreable requests, edition 0.3 scoring. Not a run of the hosted API.

Published as 0.4960763085785154 on a 0–1 scale (nDCG@10). Index component: raw 0.4961, chance-corrected skill 0.4299, chance 0.116; in the public index.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Text run: the frozen public suite release-v3 (rows_sha256 b2b56d6fb636…, 140,620 requests, 140,178 scoreable, 43 benchmarks, 37 in the index), the same files as the original Drex Max's results dataset, scored on 27 October 2026 with Decision Index kit c254f8d (--edition 0.3) and labelled the Decision Index 0.4 public suite. The public index is 100 × the weighted mean of five area skills; each benchmark is chance-corrected, (score − chance) / (1 − chance) clipped to 0–1, and coverage-adjusted. scores.json also gives a raw index of 77.92 and a breadth skill of 70.15, not stored as columns. Its latency fields are in-process wall time under batched inference on one NVIDIA B200 per worker, not serving latency, and are not stored.

Checked / reported: 2026-11-06 · Samples: 220

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · Amazon ESCI (macro-F1)59.96%
Setup & source

Amazon ESCI, macro-F1, from Nace's own Decision Index 0.3 public-suite run of Drex Max v1.1 (5,000 scored requests).

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on one NVIDIA B200 per worker; Decision Index kit c254f8d, public suite release-v3, 140,178 scoreable requests, edition 0.3 scoring. Not a run of the hosted API.

Published as 0.5996309606305666 on a 0–1 scale (macro-F1). Index component: raw 0.5996, chance-corrected skill 0.4978, chance 0.2027; in the public index.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Text run: the frozen public suite release-v3 (rows_sha256 b2b56d6fb636…, 140,620 requests, 140,178 scoreable, 43 benchmarks, 37 in the index), the same files as the original Drex Max's results dataset, scored on 27 October 2026 with Decision Index kit c254f8d (--edition 0.3) and labelled the Decision Index 0.4 public suite. The public index is 100 × the weighted mean of five area skills; each benchmark is chance-corrected, (score − chance) / (1 − chance) clipped to 0–1, and coverage-adjusted. scores.json also gives a raw index of 77.92 and a breadth skill of 70.15, not stored as columns. Its latency fields are in-process wall time under batched inference on one NVIDIA B200 per worker, not serving latency, and are not stored.

Checked / reported: 2026-11-06 · Samples: 5000

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · ACOS (per-review F1)53.51%
Setup & source

ACOS, per-review F1, from Nace's own Decision Index 0.3 public-suite run of Drex Max v1.1 (1,565 scored requests).

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on one NVIDIA B200 per worker; Decision Index kit c254f8d, public suite release-v3, 140,178 scoreable requests, edition 0.3 scoring. Not a run of the hosted API.

Published as 0.5350859022513434 on a 0–1 scale (per-review F1). Index component: raw 0.5351, chance-corrected skill 0.5202, chance 0.031; in the public index.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Text run: the frozen public suite release-v3 (rows_sha256 b2b56d6fb636…, 140,620 requests, 140,178 scoreable, 43 benchmarks, 37 in the index), the same files as the original Drex Max's results dataset, scored on 27 October 2026 with Decision Index kit c254f8d (--edition 0.3) and labelled the Decision Index 0.4 public suite. The public index is 100 × the weighted mean of five area skills; each benchmark is chance-corrected, (score − chance) / (1 − chance) clipped to 0–1, and coverage-adjusted. scores.json also gives a raw index of 77.92 and a breadth skill of 70.15, not stored as columns. Its latency fields are in-process wall time under batched inference on one NVIDIA B200 per worker, not serving latency, and are not stored.

Checked / reported: 2026-11-06 · Samples: 1565

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · FinEntity (macro-F1)94.75%
Setup & source

FinEntity, macro-F1, from Nace's own Decision Index 0.3 public-suite run of Drex Max v1.1 (979 scored requests).

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on one NVIDIA B200 per worker; Decision Index kit c254f8d, public suite release-v3, 140,178 scoreable requests, edition 0.3 scoring. Not a run of the hosted API.

Published as 0.9474797135055434 on a 0–1 scale (macro-F1). Index component: raw 0.9475, chance-corrected skill 0.9228, chance 0.3201; in the public index.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Text run: the frozen public suite release-v3 (rows_sha256 b2b56d6fb636…, 140,620 requests, 140,178 scoreable, 43 benchmarks, 37 in the index), the same files as the original Drex Max's results dataset, scored on 27 October 2026 with Decision Index kit c254f8d (--edition 0.3) and labelled the Decision Index 0.4 public suite. The public index is 100 × the weighted mean of five area skills; each benchmark is chance-corrected, (score − chance) / (1 − chance) clipped to 0–1, and coverage-adjusted. scores.json also gives a raw index of 77.92 and a breadth skill of 70.15, not stored as columns. Its latency fields are in-process wall time under batched inference on one NVIDIA B200 per worker, not serving latency, and are not stored.

Checked / reported: 2026-11-06 · Samples: 979

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · VAST (macro-F1)81.02%
Setup & source

VAST, macro-F1, from Nace's own Decision Index 0.3 public-suite run of Drex Max v1.1 (3,006 scored requests).

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on one NVIDIA B200 per worker; Decision Index kit c254f8d, public suite release-v3, 140,178 scoreable requests, edition 0.3 scoring. Not a run of the hosted API.

Published as 0.8101802992851731 on a 0–1 scale (macro-F1). Index component: raw 0.8102, chance-corrected skill 0.7153, chance 0.3333; in the public index.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Text run: the frozen public suite release-v3 (rows_sha256 b2b56d6fb636…, 140,620 requests, 140,178 scoreable, 43 benchmarks, 37 in the index), the same files as the original Drex Max's results dataset, scored on 27 October 2026 with Decision Index kit c254f8d (--edition 0.3) and labelled the Decision Index 0.4 public suite. The public index is 100 × the weighted mean of five area skills; each benchmark is chance-corrected, (score − chance) / (1 − chance) clipped to 0–1, and coverage-adjusted. scores.json also gives a raw index of 77.92 and a breadth skill of 70.15, not stored as columns. Its latency fields are in-process wall time under batched inference on one NVIDIA B200 per worker, not serving latency, and are not stored.

Checked / reported: 2026-11-06 · Samples: 3006

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · NLI4CT (macro-F1)86.54%
Setup & source

NLI4CT, macro-F1, from Nace's own Decision Index 0.3 public-suite run of Drex Max v1.1 (5,500 scored requests).

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on one NVIDIA B200 per worker; Decision Index kit c254f8d, public suite release-v3, 140,178 scoreable requests, edition 0.3 scoring. Not a run of the hosted API.

Published as 0.8653669254294748 on a 0–1 scale (macro-F1). Index component: raw 0.8654, chance-corrected skill 0.7381, chance 0.486; in the public index.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Text run: the frozen public suite release-v3 (rows_sha256 b2b56d6fb636…, 140,620 requests, 140,178 scoreable, 43 benchmarks, 37 in the index), the same files as the original Drex Max's results dataset, scored on 27 October 2026 with Decision Index kit c254f8d (--edition 0.3) and labelled the Decision Index 0.4 public suite. The public index is 100 × the weighted mean of five area skills; each benchmark is chance-corrected, (score − chance) / (1 − chance) clipped to 0–1, and coverage-adjusted. scores.json also gives a raw index of 77.92 and a breadth skill of 70.15, not stored as columns. Its latency fields are in-process wall time under batched inference on one NVIDIA B200 per worker, not serving latency, and are not stored.

Checked / reported: 2026-11-06 · Samples: 5500

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · CLadder (accuracy)92.78%
Setup & source

CLadder, accuracy, from Nace's own Decision Index 0.3 public-suite run of Drex Max v1.1 (5,000 scored requests).

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on one NVIDIA B200 per worker; Decision Index kit c254f8d, public suite release-v3, 140,178 scoreable requests, edition 0.3 scoring. Not a run of the hosted API.

Published as 0.9278 on a 0–1 scale (accuracy). Index component: raw 0.9278, chance-corrected skill 0.8556, chance 0.5; in the public index.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Text run: the frozen public suite release-v3 (rows_sha256 b2b56d6fb636…, 140,620 requests, 140,178 scoreable, 43 benchmarks, 37 in the index), the same files as the original Drex Max's results dataset, scored on 27 October 2026 with Decision Index kit c254f8d (--edition 0.3) and labelled the Decision Index 0.4 public suite. The public index is 100 × the weighted mean of five area skills; each benchmark is chance-corrected, (score − chance) / (1 − chance) clipped to 0–1, and coverage-adjusted. scores.json also gives a raw index of 77.92 and a breadth skill of 70.15, not stored as columns. Its latency fields are in-process wall time under batched inference on one NVIDIA B200 per worker, not serving latency, and are not stored.

Checked / reported: 2026-11-06 · Samples: 5000

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · HLE (accuracy)15.57%
Setup & source

HLE, accuracy, from Nace's own Decision Index 0.3 public-suite run of Drex Max v1.1 (501 scored requests).

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on one NVIDIA B200 per worker; Decision Index kit c254f8d, public suite release-v3, 140,178 scoreable requests, edition 0.3 scoring. Not a run of the hosted API.

Published as 0.15568862275449102 on a 0–1 scale (accuracy). Index component: raw 0.1557, chance-corrected skill 0.0, chance 0.1641; in the public index. Nace's Drex page shows 18.2 for v1.1 on HLE without naming the run; that row is kept separately.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Text run: the frozen public suite release-v3 (rows_sha256 b2b56d6fb636…, 140,620 requests, 140,178 scoreable, 43 benchmarks, 37 in the index), the same files as the original Drex Max's results dataset, scored on 27 October 2026 with Decision Index kit c254f8d (--edition 0.3) and labelled the Decision Index 0.4 public suite. The public index is 100 × the weighted mean of five area skills; each benchmark is chance-corrected, (score − chance) / (1 − chance) clipped to 0–1, and coverage-adjusted. scores.json also gives a raw index of 77.92 and a breadth skill of 70.15, not stored as columns. Its latency fields are in-process wall time under batched inference on one NVIDIA B200 per worker, not serving latency, and are not stored. Nace's Drex page shows 18.2 for v1.1 on HLE without naming the run; that row is kept separately.

Checked / reported: 2026-11-06 · Samples: 501

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · Habermas Machine (accuracy)62.83%
Setup & source

Habermas Machine, accuracy, from Nace's own Decision Index 0.3 public-suite run of Drex Max v1.1 (1,676 scored requests).

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on one NVIDIA B200 per worker; Decision Index kit c254f8d, public suite release-v3, 140,178 scoreable requests, edition 0.3 scoring. Not a run of the hosted API.

Published as 0.6282816229116945 on a 0–1 scale (accuracy). Index component: raw 0.6283, chance-corrected skill 0.4605, chance 0.311; in the public index.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Text run: the frozen public suite release-v3 (rows_sha256 b2b56d6fb636…, 140,620 requests, 140,178 scoreable, 43 benchmarks, 37 in the index), the same files as the original Drex Max's results dataset, scored on 27 October 2026 with Decision Index kit c254f8d (--edition 0.3) and labelled the Decision Index 0.4 public suite. The public index is 100 × the weighted mean of five area skills; each benchmark is chance-corrected, (score − chance) / (1 − chance) clipped to 0–1, and coverage-adjusted. scores.json also gives a raw index of 77.92 and a breadth skill of 70.15, not stored as columns. Its latency fields are in-process wall time under batched inference on one NVIDIA B200 per worker, not serving latency, and are not stored.

Checked / reported: 2026-11-06 · Samples: 1676

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · GSM8K (accuracy)83.89%
Setup & source

GSM8K, accuracy, from Nace's own Decision Index 0.3 public-suite run of Drex Max v1.1 (2,638 scored requests).

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on one NVIDIA B200 per worker; Decision Index kit c254f8d, public suite release-v3, 140,178 scoreable requests, edition 0.3 scoring. Not a run of the hosted API.

Published as 0.8388931008339652 on a 0–1 scale (accuracy). Index component: raw 0.8389, chance-corrected skill 0.8068, chance 0.25; in the public index.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Text run: the frozen public suite release-v3 (rows_sha256 b2b56d6fb636…, 140,620 requests, 140,178 scoreable, 43 benchmarks, 37 in the index), the same files as the original Drex Max's results dataset, scored on 27 October 2026 with Decision Index kit c254f8d (--edition 0.3) and labelled the Decision Index 0.4 public suite. The public index is 100 × the weighted mean of five area skills; each benchmark is chance-corrected, (score − chance) / (1 − chance) clipped to 0–1, and coverage-adjusted. scores.json also gives a raw index of 77.92 and a breadth skill of 70.15, not stored as columns. Its latency fields are in-process wall time under batched inference on one NVIDIA B200 per worker, not serving latency, and are not stored.

Checked / reported: 2026-11-06 · Samples: 2638

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · PhishNChips phishing decisions (accuracy)84.20%
Setup & source

PhishNChips phishing decisions, accuracy, from Nace's own Decision Index 0.3 public-suite run of Drex Max v1.1 (2,000 scored requests).

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on one NVIDIA B200 per worker; Decision Index kit c254f8d, public suite release-v3, 140,178 scoreable requests, edition 0.3 scoring. Not a run of the hosted API.

Published as 0.842 on a 0–1 scale (accuracy). Index component: raw 0.842, chance-corrected skill 0.684, chance 0.5; in the public index.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Text run: the frozen public suite release-v3 (rows_sha256 b2b56d6fb636…, 140,620 requests, 140,178 scoreable, 43 benchmarks, 37 in the index), the same files as the original Drex Max's results dataset, scored on 27 October 2026 with Decision Index kit c254f8d (--edition 0.3) and labelled the Decision Index 0.4 public suite. The public index is 100 × the weighted mean of five area skills; each benchmark is chance-corrected, (score − chance) / (1 − chance) clipped to 0–1, and coverage-adjusted. scores.json also gives a raw index of 77.92 and a breadth skill of 70.15, not stored as columns. Its latency fields are in-process wall time under batched inference on one NVIDIA B200 per worker, not serving latency, and are not stored.

Checked / reported: 2026-11-06 · Samples: 2000

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · BBH fixed-option tasks (accuracy)93.83%
Setup & source

BBH fixed-option tasks, accuracy, from Nace's own Decision Index 0.3 public-suite run of Drex Max v1.1 (5,507 scored requests).

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on one NVIDIA B200 per worker; Decision Index kit c254f8d, public suite release-v3, 140,178 scoreable requests, edition 0.3 scoring. Not a run of the hosted API.

Published as 0.9382603958598148 on a 0–1 scale (accuracy). Index component: raw 0.9383, chance-corrected skill 0.9106, chance 0.3101; in the public index.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Text run: the frozen public suite release-v3 (rows_sha256 b2b56d6fb636…, 140,620 requests, 140,178 scoreable, 43 benchmarks, 37 in the index), the same files as the original Drex Max's results dataset, scored on 27 October 2026 with Decision Index kit c254f8d (--edition 0.3) and labelled the Decision Index 0.4 public suite. The public index is 100 × the weighted mean of five area skills; each benchmark is chance-corrected, (score − chance) / (1 − chance) clipped to 0–1, and coverage-adjusted. scores.json also gives a raw index of 77.92 and a breadth skill of 70.15, not stored as columns. Its latency fields are in-process wall time under batched inference on one NVIDIA B200 per worker, not serving latency, and are not stored.

Checked / reported: 2026-11-06 · Samples: 5507

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · HoVer claim verification (accuracy)88.05%
Setup & source

HoVer claim verification, accuracy, from Nace's own Decision Index 0.3 public-suite run of Drex Max v1.1 (4,000 scored requests).

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on one NVIDIA B200 per worker; Decision Index kit c254f8d, public suite release-v3, 140,178 scoreable requests, edition 0.3 scoring. Not a run of the hosted API.

Published as 0.8805 on a 0–1 scale (accuracy). Index component: raw 0.8805, chance-corrected skill 0.761, chance 0.5; in the public index.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Text run: the frozen public suite release-v3 (rows_sha256 b2b56d6fb636…, 140,620 requests, 140,178 scoreable, 43 benchmarks, 37 in the index), the same files as the original Drex Max's results dataset, scored on 27 October 2026 with Decision Index kit c254f8d (--edition 0.3) and labelled the Decision Index 0.4 public suite. The public index is 100 × the weighted mean of five area skills; each benchmark is chance-corrected, (score − chance) / (1 − chance) clipped to 0–1, and coverage-adjusted. scores.json also gives a raw index of 77.92 and a breadth skill of 70.15, not stored as columns. Its latency fields are in-process wall time under batched inference on one NVIDIA B200 per worker, not serving latency, and are not stored.

Checked / reported: 2026-11-06 · Samples: 4000

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · New Yorker caption matching (accuracy)80.87%
Setup & source

New Yorker caption matching, accuracy, from Nace's own Decision Index 0.3 public-suite run of Drex Max v1.1 (528 scored requests).

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on one NVIDIA B200 per worker; Decision Index kit c254f8d, public suite release-v3, 140,178 scoreable requests, edition 0.3 scoring. Not a run of the hosted API.

Published as 0.8087121212121212 on a 0–1 scale (accuracy). Index component: raw 0.8087, chance-corrected skill 0.7609, chance 0.2; in the public index.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Text run: the frozen public suite release-v3 (rows_sha256 b2b56d6fb636…, 140,620 requests, 140,178 scoreable, 43 benchmarks, 37 in the index), the same files as the original Drex Max's results dataset, scored on 27 October 2026 with Decision Index kit c254f8d (--edition 0.3) and labelled the Decision Index 0.4 public suite. The public index is 100 × the weighted mean of five area skills; each benchmark is chance-corrected, (score − chance) / (1 − chance) clipped to 0–1, and coverage-adjusted. scores.json also gives a raw index of 77.92 and a breadth skill of 70.15, not stored as columns. Its latency fields are in-process wall time under batched inference on one NVIDIA B200 per worker, not serving latency, and are not stored.

Checked / reported: 2026-11-06 · Samples: 528

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · Public vision index75.78
Setup & source

Public vision index from Nace's own run of Drex Max v1.1 on the Decision Index vision suite.

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on NVIDIA B200; Decision Index kit c254f8d, public vision suite, 12,210 rows, images capped at 1,638,400 pixels. Not a run of the hosted API.

Published as 75.78447602638617. Nace's Drex page shows 75.9 for v1.1's vision panel; its accuracies give 75.89 with this run's chance levels and weights, so the panel is a different vision run. Both are kept.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Vision run: the public Decision Index vision suite (rows_sha256 f5f1cfb5cd92…, 12,210 rows, identical to the original Drex Max's vision run), images at native resolution capped at 1,638,400 pixels, scored with the kit's vision score (edition 0.3, Nace's '0.4 Vision board'). The column is chance-corrected skill × 100; R-Bench-M weighs 0.5 and MMMU-Pro vision 0.25 in the index, the rest 1. The run was replaced on 27 October: the first upload (commit bc74e68) gave 75.39 on a locally rebuilt suite whose Mind2Web images and 52 InfographicVQA images differed from the reference build; the stored run passes vision verify. Nace's Drex page shows accuracy, not skill, and its vision panel is a different run (see each row).

Checked / reported: 2026-11-06 · Samples: 12210

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · CV-Bench (vision skill)77.4 points
Setup & source

CV-Bench chance-corrected skill × 100 from Nace's own run of Drex Max v1.1 on the Decision Index vision suite (2,038 rows).

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on NVIDIA B200; Decision Index kit c254f8d, public vision suite, 12,210 rows, images capped at 1,638,400 pixels. Not a run of the hosted API.

Published as skill 0.7741591678696222 on a 0–1 scale; accuracy 0.8631010794896958, chance 0.393825646058227, index weight 1.0; the README prints 77.4.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Vision run: the public Decision Index vision suite (rows_sha256 f5f1cfb5cd92…, 12,210 rows, identical to the original Drex Max's vision run), images at native resolution capped at 1,638,400 pixels, scored with the kit's vision score (edition 0.3, Nace's '0.4 Vision board'). The column is chance-corrected skill × 100; R-Bench-M weighs 0.5 and MMMU-Pro vision 0.25 in the index, the rest 1. The run was replaced on 27 October: the first upload (commit bc74e68) gave 75.39 on a locally rebuilt suite whose Mind2Web images and 52 InfographicVQA images differed from the reference build; the stored run passes vision verify. Nace's Drex page shows accuracy, not skill, and its vision panel is a different run (see each row).

Checked / reported: 2026-11-06 · Samples: 2038

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · BLINK (vision skill)61.3 points
Setup & source

BLINK chance-corrected skill × 100 from Nace's own run of Drex Max v1.1 on the Decision Index vision suite (961 rows).

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on NVIDIA B200; Decision Index kit c254f8d, public vision suite, 12,210 rows, images capped at 1,638,400 pixels. Not a run of the hosted API.

Published as skill 0.6133709222714459 on a 0–1 scale; accuracy 0.7502601456815817, chance 0.3540582726326743, index weight 1.0; the README prints 61.3.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Vision run: the public Decision Index vision suite (rows_sha256 f5f1cfb5cd92…, 12,210 rows, identical to the original Drex Max's vision run), images at native resolution capped at 1,638,400 pixels, scored with the kit's vision score (edition 0.3, Nace's '0.4 Vision board'). The column is chance-corrected skill × 100; R-Bench-M weighs 0.5 and MMMU-Pro vision 0.25 in the index, the rest 1. The run was replaced on 27 October: the first upload (commit bc74e68) gave 75.39 on a locally rebuilt suite whose Mind2Web images and 52 InfographicVQA images differed from the reference build; the stored run passes vision verify. Nace's Drex page shows accuracy, not skill, and its vision panel is a different run (see each row).

Checked / reported: 2026-11-06 · Samples: 961

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · RealWorldQA (vision skill)73.1 points
Setup & source

RealWorldQA chance-corrected skill × 100 from Nace's own run of Drex Max v1.1 on the Decision Index vision suite (589 rows).

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on NVIDIA B200; Decision Index kit c254f8d, public vision suite, 12,210 rows, images capped at 1,638,400 pixels. Not a run of the hosted API.

Published as skill 0.7308670520231213 on a 0–1 scale; accuracy 0.8353140916808149, chance 0.38808715336728916, index weight 1.0; the README prints 73.1.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Vision run: the public Decision Index vision suite (rows_sha256 f5f1cfb5cd92…, 12,210 rows, identical to the original Drex Max's vision run), images at native resolution capped at 1,638,400 pixels, scored with the kit's vision score (edition 0.3, Nace's '0.4 Vision board'). The column is chance-corrected skill × 100; R-Bench-M weighs 0.5 and MMMU-Pro vision 0.25 in the index, the rest 1. The run was replaced on 27 October: the first upload (commit bc74e68) gave 75.39 on a locally rebuilt suite whose Mind2Web images and 52 InfographicVQA images differed from the reference build; the stored run passes vision verify. Nace's Drex page shows accuracy, not skill, and its vision panel is a different run (see each row).

Checked / reported: 2026-11-06 · Samples: 589

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · CharXiv (vision skill)80.0 points
Setup & source

CharXiv chance-corrected skill × 100 from Nace's own run of Drex Max v1.1 on the Decision Index vision suite (532 rows).

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on NVIDIA B200; Decision Index kit c254f8d, public vision suite, 12,210 rows, images capped at 1,638,400 pixels. Not a run of the hosted API.

Published as skill 0.7994987468671679 on a 0–1 scale; accuracy 0.849624060150376, chance 0.25, index weight 1.0; the README prints 79.9. Nace's Drex page shows accuracy 86.6% for v1.1; this run's accuracy is 84.96%.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Vision run: the public Decision Index vision suite (rows_sha256 f5f1cfb5cd92…, 12,210 rows, identical to the original Drex Max's vision run), images at native resolution capped at 1,638,400 pixels, scored with the kit's vision score (edition 0.3, Nace's '0.4 Vision board'). The column is chance-corrected skill × 100; R-Bench-M weighs 0.5 and MMMU-Pro vision 0.25 in the index, the rest 1. The run was replaced on 27 October: the first upload (commit bc74e68) gave 75.39 on a locally rebuilt suite whose Mind2Web images and 52 InfographicVQA images differed from the reference build; the stored run passes vision verify. Nace's Drex page shows accuracy, not skill, and its vision panel is a different run (see each row).

Checked / reported: 2026-11-06 · Samples: 532

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · InfographicVQA (vision skill)98.4 points
Setup & source

InfographicVQA chance-corrected skill × 100 from Nace's own run of Drex Max v1.1 on the Decision Index vision suite (244 rows).

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on NVIDIA B200; Decision Index kit c254f8d, public vision suite, 12,210 rows, images capped at 1,638,400 pixels. Not a run of the hosted API.

Published as skill 0.9836065573770493 on a 0–1 scale; accuracy 0.9877049180327869, chance 0.25, index weight 1.0; the README prints 98.4. Nace's Drex page shows accuracy 98.4% for v1.1; this run's accuracy is 98.77%.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Vision run: the public Decision Index vision suite (rows_sha256 f5f1cfb5cd92…, 12,210 rows, identical to the original Drex Max's vision run), images at native resolution capped at 1,638,400 pixels, scored with the kit's vision score (edition 0.3, Nace's '0.4 Vision board'). The column is chance-corrected skill × 100; R-Bench-M weighs 0.5 and MMMU-Pro vision 0.25 in the index, the rest 1. The run was replaced on 27 October: the first upload (commit bc74e68) gave 75.39 on a locally rebuilt suite whose Mind2Web images and 52 InfographicVQA images differed from the reference build; the stored run passes vision verify. Nace's Drex page shows accuracy, not skill, and its vision panel is a different run (see each row).

Checked / reported: 2026-11-06 · Samples: 244

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · Mind2Web (vision skill)86.3 points
Setup & source

Mind2Web chance-corrected skill × 100 from Nace's own run of Drex Max v1.1 on the Decision Index vision suite (973 rows).

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on NVIDIA B200; Decision Index kit c254f8d, public vision suite, 12,210 rows, images capped at 1,638,400 pixels. Not a run of the hosted API.

Published as skill 0.8629667694415896 on a 0–1 scale; accuracy 0.8972250770811921, chance 0.25, index weight 1.0; the README prints 86.3. Nace's Drex page shows accuracy 89.2% for v1.1; this run's accuracy is 89.72%.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Vision run: the public Decision Index vision suite (rows_sha256 f5f1cfb5cd92…, 12,210 rows, identical to the original Drex Max's vision run), images at native resolution capped at 1,638,400 pixels, scored with the kit's vision score (edition 0.3, Nace's '0.4 Vision board'). The column is chance-corrected skill × 100; R-Bench-M weighs 0.5 and MMMU-Pro vision 0.25 in the index, the rest 1. The run was replaced on 27 October: the first upload (commit bc74e68) gave 75.39 on a locally rebuilt suite whose Mind2Web images and 52 InfographicVQA images differed from the reference build; the stored run passes vision verify. Nace's Drex page shows accuracy, not skill, and its vision panel is a different run (see each row).

Checked / reported: 2026-11-06 · Samples: 973

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · Winoground (vision skill)86.8 points
Setup & source

Winoground chance-corrected skill × 100 from Nace's own run of Drex Max v1.1 on the Decision Index vision suite (800 rows).

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on NVIDIA B200; Decision Index kit c254f8d, public vision suite, 12,210 rows, images capped at 1,638,400 pixels. Not a run of the hosted API.

Published as skill 0.8674999999999999 on a 0–1 scale; accuracy 0.93375, chance 0.5, index weight 1.0; the README prints 86.8.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Vision run: the public Decision Index vision suite (rows_sha256 f5f1cfb5cd92…, 12,210 rows, identical to the original Drex Max's vision run), images at native resolution capped at 1,638,400 pixels, scored with the kit's vision score (edition 0.3, Nace's '0.4 Vision board'). The column is chance-corrected skill × 100; R-Bench-M weighs 0.5 and MMMU-Pro vision 0.25 in the index, the rest 1. The run was replaced on 27 October: the first upload (commit bc74e68) gave 75.39 on a locally rebuilt suite whose Mind2Web images and 52 InfographicVQA images differed from the reference build; the stored run passes vision verify. Nace's Drex page shows accuracy, not skill, and its vision panel is a different run (see each row).

Checked / reported: 2026-11-06 · Samples: 800

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · KIE (CORD+FUNSD) (vision skill)93.2 points
Setup & source

KIE (CORD+FUNSD) chance-corrected skill × 100 from Nace's own run of Drex Max v1.1 on the Decision Index vision suite (2,465 rows).

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on NVIDIA B200; Decision Index kit c254f8d, public vision suite, 12,210 rows, images capped at 1,638,400 pixels. Not a run of the hosted API.

Published as skill 0.9318751043579897 on a 0–1 scale; accuracy 0.9586206896551724, chance 0.39259634888438133, index weight 1.0; the README prints 93.2.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Vision run: the public Decision Index vision suite (rows_sha256 f5f1cfb5cd92…, 12,210 rows, identical to the original Drex Max's vision run), images at native resolution capped at 1,638,400 pixels, scored with the kit's vision score (edition 0.3, Nace's '0.4 Vision board'). The column is chance-corrected skill × 100; R-Bench-M weighs 0.5 and MMMU-Pro vision 0.25 in the index, the rest 1. The run was replaced on 27 October: the first upload (commit bc74e68) gave 75.39 on a locally rebuilt suite whose Mind2Web images and 52 InfographicVQA images differed from the reference build; the stored run passes vision verify. Nace's Drex page shows accuracy, not skill, and its vision panel is a different run (see each row).

Checked / reported: 2026-11-06 · Samples: 2465

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · Moderation (Hateful Memes) (vision skill)45.6 points
Setup & source

Moderation (Hateful Memes) chance-corrected skill × 100 from Nace's own run of Drex Max v1.1 on the Decision Index vision suite (1,213 rows).

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on NVIDIA B200; Decision Index kit c254f8d, public vision suite, 12,210 rows, images capped at 1,638,400 pixels. Not a run of the hosted API.

Published as skill 0.4558944765045343 on a 0–1 scale; accuracy 0.7279472382522671, chance 0.5, index weight 1.0; the README prints 45.6.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Vision run: the public Decision Index vision suite (rows_sha256 f5f1cfb5cd92…, 12,210 rows, identical to the original Drex Max's vision run), images at native resolution capped at 1,638,400 pixels, scored with the kit's vision score (edition 0.3, Nace's '0.4 Vision board'). The column is chance-corrected skill × 100; R-Bench-M weighs 0.5 and MMMU-Pro vision 0.25 in the index, the rest 1. The run was replaced on 27 October: the first upload (commit bc74e68) gave 75.39 on a locally rebuilt suite whose Mind2Web images and 52 InfographicVQA images differed from the reference build; the stored run passes vision verify. Nace's Drex page shows accuracy, not skill, and its vision panel is a different run (see each row).

Checked / reported: 2026-11-06 · Samples: 1213

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · R-Bench-M (vision skill)50.4 points
Setup & source

R-Bench-M chance-corrected skill × 100 from Nace's own run of Drex Max v1.1 on the Decision Index vision suite (665 rows).

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on NVIDIA B200; Decision Index kit c254f8d, public vision suite, 12,210 rows, images capped at 1,638,400 pixels. Not a run of the hosted API.

Published as skill 0.5036847646262596 on a 0–1 scale; accuracy 0.5864661654135338, chance 0.16679197994987469, index weight 0.5; the README prints 50.4.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Vision run: the public Decision Index vision suite (rows_sha256 f5f1cfb5cd92…, 12,210 rows, identical to the original Drex Max's vision run), images at native resolution capped at 1,638,400 pixels, scored with the kit's vision score (edition 0.3, Nace's '0.4 Vision board'). The column is chance-corrected skill × 100; R-Bench-M weighs 0.5 and MMMU-Pro vision 0.25 in the index, the rest 1. The run was replaced on 27 October: the first upload (commit bc74e68) gave 75.39 on a locally rebuilt suite whose Mind2Web images and 52 InfographicVQA images differed from the reference build; the stored run passes vision verify. Nace's Drex page shows accuracy, not skill, and its vision panel is a different run (see each row).

Checked / reported: 2026-11-06 · Samples: 665

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source
Nace Drex Max v1.1 results · MMMU-Pro vision (vision skill)47.0 points
Setup & source

MMMU-Pro vision chance-corrected skill × 100 from Nace's own run of Drex Max v1.1 on the Decision Index vision suite (1,730 rows).

Nace-run Drex Max v1.1 (engine drex-max-v1.1), weights loaded locally from NaceXDeepInfra/Drex-Max-v1.1 (not public) on NVIDIA B200; Decision Index kit c254f8d, public vision suite, 12,210 rows, images capped at 1,638,400 pixels. Not a run of the hosted API.

Published as skill 0.4696209341880083 on a 0–1 scale; accuracy 0.5375722543352601, chance 0.12811840535828975, index weight 0.25; the README prints 47.0.

Nace.AI's own Decision Index run of Drex Max v1.1, published in the Hugging Face dataset nace-ai/drex-max-v1.1-decision-index-results (revision 1c6b41a, 27 October 2026; read 6 November 2026). The run names engine drex-max-v1.1 and loaded weights locally from the Hugging Face repository NaceXDeepInfra/Drex-Max-v1.1, which is not public; no weights hash is published, so the run is tied to the hosted release by Nace's naming only. Values that Nace's Drex page already shows for this run (public index 70.8, MMLU-Pro, CRUXEval, ARC-Challenge, ARC-Easy, BFCL, When2Call and RAGTruth) stay on the product rows and are not stored twice. Vendor run; not ranked and not blended with community or independent results. Vision run: the public Decision Index vision suite (rows_sha256 f5f1cfb5cd92…, 12,210 rows, identical to the original Drex Max's vision run), images at native resolution capped at 1,638,400 pixels, scored with the kit's vision score (edition 0.3, Nace's '0.4 Vision board'). The column is chance-corrected skill × 100; R-Bench-M weighs 0.5 and MMMU-Pro vision 0.25 in the index, the rest 1. The run was replaced on 27 October: the first upload (commit bc74e68) gave 75.39 on a locally rebuilt suite whose Mind2Web images and 52 InfographicVQA images differed from the reference build; the stored run passes vision verify. Nace's Drex page shows accuracy, not skill, and its vision panel is a different run (see each row).

Checked / reported: 2026-11-06 · Samples: 1730

Snapshot: 2026-10-27 · Revision: 1c6b41a03b66d13f351b611c3193a0893b98bf11 · Published observations; result reuse terms not specified

Result source · Benchmark source