Examenos

BFCL formulated as typed decisions; published case exact accuracy for this board population.

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Raw 0.4764; {"requests": 1694, "answered": 1694, "unsupported": 0, "errors": 0}; coverage/error rules are source-defined.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported.

Checked / reported: 2026-10-17 · Samples: 1694

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

SGD/SGD-X formulated as typed decisions; published macro-F1 for this board population.

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Raw 0.6129; {"requests": 2500, "answered": 2500, "unsupported": 0, "errors": 0}; coverage/error rules are source-defined.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported.

Checked / reported: 2026-10-17 · Samples: 2500

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

ContractNLI formulated as typed decisions; published macro-F1 for this board population.

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Raw 0.6618; {"requests": 123, "answered": 123, "unsupported": 0, "errors": 0}; coverage/error rules are source-defined.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported.

Checked / reported: 2026-10-17 · Samples: 123

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

ANLI formulated as typed decisions; published macro-F1 for this board population.

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Raw 0.3599; {"requests": 3200, "answered": 3200, "unsupported": 0, "errors": 0}; coverage/error rules are source-defined.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported.

Checked / reported: 2026-10-17 · Samples: 3200

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

ToolRet formulated as typed decisions; published nDCG@10 for this board population.

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Raw 0.1566; {"requests": 685, "answered": 685, "unsupported": 0, "errors": 0}; coverage/error rules are source-defined.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported.

Checked / reported: 2026-10-17 · Samples: 685

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

BPoMP formulated as typed decisions; published accuracy for this board population.

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Raw 0.4572; {"requests": 5000, "answered": 5000, "unsupported": 0, "errors": 0}; coverage/error rules are source-defined.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported.

Checked / reported: 2026-10-17 · Samples: 5000

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

Humicroedit formulated as typed decisions; published accuracy for this board population.

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Raw 0.5114; {"requests": 2628, "answered": 2628, "unsupported": 0, "errors": 0}; coverage/error rules are source-defined.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported.

Checked / reported: 2026-10-17 · Samples: 2628

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

POP909-CL formulated as typed decisions; published accuracy for this board population.

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Raw 0.008; {"requests": 2000, "answered": 2000, "unsupported": 0, "errors": 0}; coverage/error rules are source-defined.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported.

Checked / reported: 2026-10-17 · Samples: 2000

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

cfcolor formulated as typed decisions; published accuracy for this board population.

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Raw 0.5638; {"requests": 5000, "answered": 5000, "unsupported": 0, "errors": 0}; coverage/error rules are source-defined.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported.

Checked / reported: 2026-10-17 · Samples: 5000

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

MMLU formulated as typed decisions; published accuracy for this board population.

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Raw 0.399; {"requests": 14033, "answered": 14033, "unsupported": 0, "errors": 0}; coverage/error rules are source-defined.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported.

Checked / reported: 2026-10-17 · Samples: 14033

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

GPQA Diamond formulated as typed decisions; published accuracy for this board population.

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Raw 0.2194; {"requests": 196, "answered": 196, "unsupported": 0, "errors": 0}; coverage/error rules are source-defined.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported.

Checked / reported: 2026-10-17 · Samples: 196

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

ARC-Easy formulated as typed decisions; published accuracy for this board population.

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Raw 0.702; {"requests": 2376, "answered": 2376, "unsupported": 0, "errors": 0}; coverage/error rules are source-defined.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported.

Checked / reported: 2026-10-17 · Samples: 2376

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

ARC-Challenge formulated as typed decisions; published accuracy for this board population.

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Raw 0.5137; {"requests": 1172, "answered": 1172, "unsupported": 0, "errors": 0}; coverage/error rules are source-defined.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported.

Checked / reported: 2026-10-17 · Samples: 1172

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

WinoGrande formulated as typed decisions; published accuracy for this board population.

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Raw 0.6046; {"requests": 1267, "answered": 1267, "unsupported": 0, "errors": 0}; coverage/error rules are source-defined.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported.

Checked / reported: 2026-10-17 · Samples: 1267

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

HellaSwag formulated as typed decisions; published accuracy for this board population.

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Raw 0.5998; {"requests": 10042, "answered": 10042, "unsupported": 0, "errors": 0}; coverage/error rules are source-defined.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported.

Checked / reported: 2026-10-17 · Samples: 10042

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

API-Bank formulated as typed decisions; published accuracy for this board population.

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Raw 0.3996; {"requests": 508, "answered": 508, "unsupported": 0, "errors": 0}; coverage/error rules are source-defined.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported.

Checked / reported: 2026-10-17 · Samples: 508

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

GSM8K formulated as typed decisions; published accuracy for this board population.

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Raw 0.1835; {"requests": 2638, "answered": 2638, "unsupported": 0, "errors": 0}; coverage/error rules are source-defined.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported.

Checked / reported: 2026-10-17 · Samples: 2638

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

ChessBench formulated as typed decisions; published accuracy for this board population.

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Raw 0.1294; {"requests": 5000, "answered": 5000, "unsupported": 0, "errors": 0}; coverage/error rules are source-defined.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported.

Checked / reported: 2026-10-17 · Samples: 5000

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

MuSR formulated as typed decisions; published accuracy for this board population.

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Raw 0.3803; {"requests": 752, "answered": 752, "unsupported": 0, "errors": 0}; coverage/error rules are source-defined.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported.

Checked / reported: 2026-10-17 · Samples: 752

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

SATA-Bench formulated as typed decisions; published case exact accuracy for this board population.

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Raw 0.0739; {"requests": 1650, "answered": 1650, "unsupported": 0, "errors": 0}; coverage/error rules are source-defined.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported.

Checked / reported: 2026-10-17 · Samples: 1650

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

BRIGHT formulated as typed decisions; published nDCG@10 for this board population.

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Raw 0.1039; {"requests": 220, "answered": 220, "unsupported": 0, "errors": 0}; coverage/error rules are source-defined.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported.

Checked / reported: 2026-10-17 · Samples: 220

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

Amazon ESCI formulated as typed decisions; published macro-F1 for this board population.

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Raw 0.2726; {"requests": 5000, "answered": 5000, "unsupported": 0, "errors": 0}; coverage/error rules are source-defined.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported.

Checked / reported: 2026-10-17 · Samples: 5000

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

ACOS formulated as typed decisions; published per-review F1 for this board population.

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Raw 0.005; {"requests": 1565, "answered": 1565, "unsupported": 0, "errors": 0}; coverage/error rules are source-defined.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported.

Checked / reported: 2026-10-17 · Samples: 1565

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

FinEntity formulated as typed decisions; published macro-F1 for this board population.

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Raw 0.6293; {"requests": 979, "answered": 979, "unsupported": 0, "errors": 0}; coverage/error rules are source-defined.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported.

Checked / reported: 2026-10-17 · Samples: 979

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

BANKING77 formulated as typed decisions; published macro-F1 for this board population.

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Raw 0.837; {"requests": 3080, "answered": 3080, "unsupported": 0, "errors": 0}; coverage/error rules are source-defined.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported.

Checked / reported: 2026-10-17 · Samples: 3080

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

iSarcasmEval formulated as typed decisions; published Sarcasm F1 · track A, English for this board population.

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Raw 0.2745; {"requests": 4600, "answered": 4600, "unsupported": 0, "errors": 0}; coverage/error rules are source-defined.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported.

Checked / reported: 2026-10-17 · Samples: 4600

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

VAST formulated as typed decisions; published macro-F1 for this board population.

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Raw 0.3878; {"requests": 3006, "answered": 3006, "unsupported": 0, "errors": 0}; coverage/error rules are source-defined.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported.

Checked / reported: 2026-10-17 · Samples: 3006

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

NLI4CT formulated as typed decisions; published macro-F1 for this board population.

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Raw 0.5325; {"requests": 5500, "answered": 5500, "unsupported": 0, "errors": 0}; coverage/error rules are source-defined.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported.

Checked / reported: 2026-10-17 · Samples: 5500

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

CRUXEval formulated as typed decisions; published accuracy for this board population.

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Raw 0.4088; {"requests": 570, "answered": 570, "unsupported": 0, "errors": 0}; coverage/error rules are source-defined.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported.

Checked / reported: 2026-10-17 · Samples: 570

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

CLadder formulated as typed decisions; published accuracy for this board population.

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Raw 0.4966; {"requests": 5000, "answered": 5000, "unsupported": 0, "errors": 0}; coverage/error rules are source-defined.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported.

Checked / reported: 2026-10-17 · Samples: 5000

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

HLE formulated as typed decisions; published accuracy for this board population.

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Raw 0.1477; {"requests": 501, "answered": 501, "unsupported": 0, "errors": 0}; coverage/error rules are source-defined.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported.

Checked / reported: 2026-10-17 · Samples: 501

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

CLINC150+OOS formulated as typed decisions; published macro-F1 for this board population.

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Raw 0.8528; {"requests": 5500, "answered": 5500, "unsupported": 0, "errors": 0}; coverage/error rules are source-defined.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported.

Checked / reported: 2026-10-17 · Samples: 5500

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

Habermas Machine formulated as typed decisions; published accuracy for this board population.

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Raw 0.3628; {"requests": 1676, "answered": 1676, "unsupported": 0, "errors": 0}; coverage/error rules are source-defined.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported.

Checked / reported: 2026-10-17 · Samples: 1676

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

PhishNChips phishing decisions formulated as typed decisions; published accuracy for this board population.

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Raw 0.4475; {"requests": 2000, "answered": 2000, "unsupported": 0, "errors": 0}; coverage/error rules are source-defined.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported.

Checked / reported: 2026-10-17 · Samples: 2000

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

MMLU-Pro formulated as typed decisions; published accuracy for this board population.

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Raw 0.2003; {"requests": 12032, "answered": 12032, "unsupported": 0, "errors": 0}; coverage/error rules are source-defined.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported.

Checked / reported: 2026-10-17 · Samples: 12032

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

BBH formulated as typed decisions; published accuracy for this board population.

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Raw 0.4324; {"requests": 5507, "answered": 5507, "unsupported": 0, "errors": 0}; coverage/error rules are source-defined.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported.

Checked / reported: 2026-10-17 · Samples: 5507

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

RAGTruth formulated as typed decisions; published F1 on hallucinated class for this board population.

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Raw 0.0228; {"requests": 2700, "answered": 2700, "unsupported": 0, "errors": 0}; coverage/error rules are source-defined.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported.

Checked / reported: 2026-10-17 · Samples: 2700

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

RouterBench formulated as typed decisions; published selected quality (quality objective) for this board population.

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Raw 0.5979; {"requests": 10000, "answered": 10000, "unsupported": 0, "errors": 0}; coverage/error rules are source-defined.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported.

Checked / reported: 2026-10-17 · Samples: 10000

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

HoVer formulated as typed decisions; published accuracy for this board population.

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Raw 0.598; {"requests": 4000, "answered": 4000, "unsupported": 0, "errors": 0}; coverage/error rules are source-defined.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported.

Checked / reported: 2026-10-17 · Samples: 4000

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

When2Call formulated as typed decisions; published accuracy for this board population.

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Raw 0.4077; {"requests": 3652, "answered": 3652, "unsupported": 0, "errors": 0}; coverage/error rules are source-defined.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported.

Checked / reported: 2026-10-17 · Samples: 3652

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

New Yorker formulated as typed decisions; published accuracy for this board population.

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Raw 0.3598; {"requests": 528, "answered": 528, "unsupported": 0, "errors": 0}; coverage/error rules are source-defined.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported.

Checked / reported: 2026-10-17 · Samples: 528

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

Home appliance simulator formulated as typed decisions; published case exact accuracy for this board population.

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Raw 0; {"requests": 88, "answered": 88, "unsupported": 0, "errors": 0}; coverage/error rules are source-defined.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported.

Checked / reported: 2026-10-17 · Samples: 88

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

Calibration on the source-defined text sample; confidence alone is not a quality ranking.

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Raw acc: 0.5298; 31 benchmarks. ECE uses the publisher bins and weighting; native Brier convention stays distinct from other studies.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported. Uses roughly one sixth of requests with discrete correct answers; benchmarks receive equal weight. ToolRet, BRIGHT and RouterBench are excluded. Known training exposure is penalized.

Checked / reported: 2026-10-17 · Samples: 34411

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

Calibration on the source-defined text sample; confidence alone is not a quality ranking.

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Raw brier: 0.586; 31 benchmarks. ECE uses the publisher bins and weighting; native Brier convention stays distinct from other studies.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported. Uses roughly one sixth of requests with discrete correct answers; benchmarks receive equal weight. ToolRet, BRIGHT and RouterBench are excluded. Known training exposure is penalized.

Checked / reported: 2026-10-17 · Samples: 34411

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

Calibration on the source-defined text sample; confidence alone is not a quality ranking.

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Raw conf: 0.6571; 31 benchmarks. ECE uses the publisher bins and weighting; native Brier convention stays distinct from other studies.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported. Uses roughly one sixth of requests with discrete correct answers; benchmarks receive equal weight. ToolRet, BRIGHT and RouterBench are excluded. Known training exposure is penalized.

Checked / reported: 2026-10-17 · Samples: 34411

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

Calibration on the source-defined text sample; confidence alone is not a quality ranking.

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Raw ece: 0.1284; 31 benchmarks. ECE uses the publisher bins and weighting; native Brier convention stays distinct from other studies.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported. Uses roughly one sixth of requests with discrete correct answers; benchmarks receive equal weight. ToolRet, BRIGHT and RouterBench are excluded. Known training exposure is penalized.

Checked / reported: 2026-10-17 · Samples: 34411

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

Published Median latency for the board setup; hosted network and local inference are separate.

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported. Local GPU/runtime can differ between submitted and evaluator runs; not isolated architecture speed.

Checked / reported: 2026-10-17 · Samples: Not published

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

Published p95 latency for the board setup; hosted network and local inference are separate.

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported. Local GPU/runtime can differ between submitted and evaluator runs; not isolated architecture speed.

Checked / reported: 2026-10-17 · Samples: Not published

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

Text Decision Index 0.3.2 · Private new-domain score

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported.

Checked / reported: 2026-10-17 · Samples: Not published

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

Text Decision Index 0.3.2 · Public score

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported.

Checked / reported: 2026-10-17 · Samples: Not published

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

Text Decision Index 0.3.2 · Private same-skill score

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported.

Checked / reported: 2026-10-17 · Samples: Not published

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

Text Decision Index 0.3.2 · Full score

Board identity d1-omni-600m; author-submitted public run; private tests evaluated by the board. Public model-card serving path; actual revision and precision not otherwise established. d1-omni default budget was lifted to 128,000 for overlong board requests.

Community Decision Index 0.3.2; distinct from AA. Full = 20% public + 50% private same-skills + 30% private new-domains on publisher-normalized scales. Public suite is chance-corrected and coverage-adjusted; unanswered counts wrong. Some public runs are author-submitted and private runs evaluator-run; each record preserves that status. Small differences can be tied by the publisher. Snapshot date is not execution date. No underlying private test text is imported.

Checked / reported: 2026-10-17 · Samples: Not published

Snapshot: 2026-10-16T16:39:08Z · Revision: 0ddf6758073eb77ae449a3541f57286d7f39d93f · Published observations; result reuse terms not specified

Benchmarks as decisions · BoolQ as reported by Liquid AI

Card LiquidAI/d1-omni-600M at 02b55d7076f15129e59ab3f94783f32c4b088674; table Benchmarks as decisions.

Published table label: BoolQ.

Vendor-published observation, distinct from independent and other vendor harnesses. Source-specific open-d1 public Decision Index 0.2.1 and decision adaptations; model-name sizes are not benchmark scores. Means refer only to each card’s named task panel.

Checked / reported: 2026-10-17 · Samples: Not published

Snapshot: 2026-10-07 · Revision: 02b55d7076f15129e59ab3f94783f32c4b088674 · Published observations; result reuse terms not specified

Benchmarks as decisions · Civil Comments as reported by Liquid AI

Card LiquidAI/d1-omni-600M at 02b55d7076f15129e59ab3f94783f32c4b088674; table Benchmarks as decisions.

Published table label: Civil Comments.

Vendor-published observation, distinct from independent and other vendor harnesses. Source-specific open-d1 public Decision Index 0.2.1 and decision adaptations; model-name sizes are not benchmark scores. Means refer only to each card’s named task panel.

Checked / reported: 2026-10-17 · Samples: Not published

Snapshot: 2026-10-07 · Revision: 02b55d7076f15129e59ab3f94783f32c4b088674 · Published observations; result reuse terms not specified

Benchmarks as decisions · MASSIVE intent as reported by Liquid AI

Card LiquidAI/d1-omni-600M at 02b55d7076f15129e59ab3f94783f32c4b088674; table Benchmarks as decisions.

Published table label: MASSIVE intent.

Vendor-published observation, distinct from independent and other vendor harnesses. Source-specific open-d1 public Decision Index 0.2.1 and decision adaptations; model-name sizes are not benchmark scores. Means refer only to each card’s named task panel.

Checked / reported: 2026-10-17 · Samples: Not published

Snapshot: 2026-10-07 · Revision: 02b55d7076f15129e59ab3f94783f32c4b088674 · Published observations; result reuse terms not specified

Benchmarks as decisions · Mean as reported by Liquid AI

Card LiquidAI/d1-omni-600M at 02b55d7076f15129e59ab3f94783f32c4b088674; table Benchmarks as decisions.

Published table label: Mean.

Vendor-published observation, distinct from independent and other vendor harnesses. Source-specific open-d1 public Decision Index 0.2.1 and decision adaptations; model-name sizes are not benchmark scores. Means refer only to each card’s named task panel.

Checked / reported: 2026-10-17 · Samples: Not published

Snapshot: 2026-10-07 · Revision: 02b55d7076f15129e59ab3f94783f32c4b088674 · Published observations; result reuse terms not specified

Benchmarks as decisions · PAWS-X as reported by Liquid AI

Card LiquidAI/d1-omni-600M at 02b55d7076f15129e59ab3f94783f32c4b088674; table Benchmarks as decisions.

Published table label: PAWS-X.

Vendor-published observation, distinct from independent and other vendor harnesses. Source-specific open-d1 public Decision Index 0.2.1 and decision adaptations; model-name sizes are not benchmark scores. Means refer only to each card’s named task panel.

Checked / reported: 2026-10-17 · Samples: Not published

Snapshot: 2026-10-07 · Revision: 02b55d7076f15129e59ab3f94783f32c4b088674 · Published observations; result reuse terms not specified

Benchmarks as decisions · PubMedQA as reported by Liquid AI

Card LiquidAI/d1-omni-600M at 02b55d7076f15129e59ab3f94783f32c4b088674; table Benchmarks as decisions.

Published table label: PubMedQA.

Vendor-published observation, distinct from independent and other vendor harnesses. Source-specific open-d1 public Decision Index 0.2.1 and decision adaptations; model-name sizes are not benchmark scores. Means refer only to each card’s named task panel.

Checked / reported: 2026-10-17 · Samples: Not published

Snapshot: 2026-10-07 · Revision: 02b55d7076f15129e59ab3f94783f32c4b088674 · Published observations; result reuse terms not specified

Benchmarks as decisions · SQuAD 2.0 as reported by Liquid AI

Card LiquidAI/d1-omni-600M at 02b55d7076f15129e59ab3f94783f32c4b088674; table Benchmarks as decisions.

Published table label: SQuAD 2.0.

Vendor-published observation, distinct from independent and other vendor harnesses. Source-specific open-d1 public Decision Index 0.2.1 and decision adaptations; model-name sizes are not benchmark scores. Means refer only to each card’s named task panel.

Checked / reported: 2026-10-17 · Samples: Not published

Snapshot: 2026-10-07 · Revision: 02b55d7076f15129e59ab3f94783f32c4b088674 · Published observations; result reuse terms not specified

Benchmarks as decisions · XNLI as reported by Liquid AI

Card LiquidAI/d1-omni-600M at 02b55d7076f15129e59ab3f94783f32c4b088674; table Benchmarks as decisions.

Published table label: XNLI.

Vendor-published observation, distinct from independent and other vendor harnesses. Source-specific open-d1 public Decision Index 0.2.1 and decision adaptations; model-name sizes are not benchmark scores. Means refer only to each card’s named task panel.

Checked / reported: 2026-10-17 · Samples: Not published

Snapshot: 2026-10-07 · Revision: 02b55d7076f15129e59ab3f94783f32c4b088674 · Published observations; result reuse terms not specified

Decision Index 0.2.1 · Arts as reported by Liquid AI

Card LiquidAI/d1-omni-600M at 02b55d7076f15129e59ab3f94783f32c4b088674; table Decision Index 0.2.1.

Published table label: Arts.

Vendor-published observation, distinct from independent and other vendor harnesses. Source-specific open-d1 public Decision Index 0.2.1 and decision adaptations; model-name sizes are not benchmark scores. Means refer only to each card’s named task panel.

Checked / reported: 2026-10-17 · Samples: Not published

Snapshot: 2026-10-07 · Revision: 051bcc464b01b9f92942b364d9586b0ef5912432 · Published observations; result reuse terms not specified

Decision Index 0.2.1 · Decision Index as reported by Liquid AI

Card LiquidAI/d1-omni-600M at 02b55d7076f15129e59ab3f94783f32c4b088674; table Decision Index 0.2.1.

Published table label: Decision Index.

Vendor-published observation, distinct from independent and other vendor harnesses. Source-specific open-d1 public Decision Index 0.2.1 and decision adaptations; model-name sizes are not benchmark scores. Means refer only to each card’s named task panel.

Checked / reported: 2026-10-17 · Samples: Not published

Snapshot: 2026-10-07 · Revision: 051bcc464b01b9f92942b364d9586b0ef5912432 · Published observations; result reuse terms not specified

Decision Index 0.2.1 · Knowledge as reported by Liquid AI

Card LiquidAI/d1-omni-600M at 02b55d7076f15129e59ab3f94783f32c4b088674; table Decision Index 0.2.1.

Published table label: Knowledge.

Vendor-published observation, distinct from independent and other vendor harnesses. Source-specific open-d1 public Decision Index 0.2.1 and decision adaptations; model-name sizes are not benchmark scores. Means refer only to each card’s named task panel.

Checked / reported: 2026-10-17 · Samples: Not published

Snapshot: 2026-10-07 · Revision: 051bcc464b01b9f92942b364d9586b0ef5912432 · Published observations; result reuse terms not specified

Decision Index 0.2.1 · Language as reported by Liquid AI

Card LiquidAI/d1-omni-600M at 02b55d7076f15129e59ab3f94783f32c4b088674; table Decision Index 0.2.1.

Published table label: Language.

Vendor-published observation, distinct from independent and other vendor harnesses. Source-specific open-d1 public Decision Index 0.2.1 and decision adaptations; model-name sizes are not benchmark scores. Means refer only to each card’s named task panel.

Checked / reported: 2026-10-17 · Samples: Not published

Snapshot: 2026-10-07 · Revision: 051bcc464b01b9f92942b364d9586b0ef5912432 · Published observations; result reuse terms not specified

Decision Index 0.2.1 · Retrieval as reported by Liquid AI

Card LiquidAI/d1-omni-600M at 02b55d7076f15129e59ab3f94783f32c4b088674; table Decision Index 0.2.1.

Published table label: Retrieval.

Vendor-published observation, distinct from independent and other vendor harnesses. Source-specific open-d1 public Decision Index 0.2.1 and decision adaptations; model-name sizes are not benchmark scores. Means refer only to each card’s named task panel.

Checked / reported: 2026-10-17 · Samples: Not published

Snapshot: 2026-10-07 · Revision: 051bcc464b01b9f92942b364d9586b0ef5912432 · Published observations; result reuse terms not specified

Decision Index 0.2.1 · Tools as reported by Liquid AI

Card LiquidAI/d1-omni-600M at 02b55d7076f15129e59ab3f94783f32c4b088674; table Decision Index 0.2.1.

Published table label: Tools.

Vendor-published observation, distinct from independent and other vendor harnesses. Source-specific open-d1 public Decision Index 0.2.1 and decision adaptations; model-name sizes are not benchmark scores. Means refer only to each card’s named task panel.

Checked / reported: 2026-10-17 · Samples: Not published

Snapshot: 2026-10-07 · Revision: 051bcc464b01b9f92942b364d9586b0ef5912432 · Published observations; result reuse terms not specified

Text: Jev Decision Index 0.3.2 · Jev Decision Index ↑ as reported by vLLM Semantic Router

Card vllm-sr/d3-edge at cab71e6ad3461b8086d51ddb572c656babd63b0b; table Text: Jev Decision Index 0.3.2.

Published table label: Jev Decision Index ↑. As reported by peer vendor vLLM Semantic Router.

Vendor-published observation, distinct from independent and other vendor harnesses. Card quotes the 12 October Decision Index 0.3.2 board; internal image tests use at most 1,000 rows and approximate rebuilds marked †. Perception Test is 19,140 three-option video questions; defaults 2 fps. Not a current board snapshot.

Checked / reported: 2026-10-17 · Samples: Not published

Snapshot: 2026-10-12 · Revision: cab71e6ad3461b8086d51ddb572c656babd63b0b · Published observations; result reuse terms not specified

Text: Jev Decision Index 0.3.2 · New-domain tasks ↑ as reported by vLLM Semantic Router

Card vllm-sr/d3-edge at cab71e6ad3461b8086d51ddb572c656babd63b0b; table Text: Jev Decision Index 0.3.2.

Published table label: New-domain tasks ↑. As reported by peer vendor vLLM Semantic Router.

Vendor-published observation, distinct from independent and other vendor harnesses. Card quotes the 12 October Decision Index 0.3.2 board; internal image tests use at most 1,000 rows and approximate rebuilds marked †. Perception Test is 19,140 three-option video questions; defaults 2 fps. Not a current board snapshot.

Checked / reported: 2026-10-17 · Samples: Not published

Snapshot: 2026-10-12 · Revision: cab71e6ad3461b8086d51ddb572c656babd63b0b · Published observations; result reuse terms not specified

Text: Jev Decision Index 0.3.2 · Public ↑ as reported by vLLM Semantic Router

Card vllm-sr/d3-edge at cab71e6ad3461b8086d51ddb572c656babd63b0b; table Text: Jev Decision Index 0.3.2.

Published table label: Public ↑. As reported by peer vendor vLLM Semantic Router.

Vendor-published observation, distinct from independent and other vendor harnesses. Card quotes the 12 October Decision Index 0.3.2 board; internal image tests use at most 1,000 rows and approximate rebuilds marked †. Perception Test is 19,140 three-option video questions; defaults 2 fps. Not a current board snapshot.

Checked / reported: 2026-10-17 · Samples: Not published

Snapshot: 2026-10-12 · Revision: cab71e6ad3461b8086d51ddb572c656babd63b0b · Published observations; result reuse terms not specified

Text: Jev Decision Index 0.3.2 · Same-skill tests ↑ as reported by vLLM Semantic Router

Card vllm-sr/d3-edge at cab71e6ad3461b8086d51ddb572c656babd63b0b; table Text: Jev Decision Index 0.3.2.

Published table label: Same-skill tests ↑. As reported by peer vendor vLLM Semantic Router.

Vendor-published observation, distinct from independent and other vendor harnesses. Card quotes the 12 October Decision Index 0.3.2 board; internal image tests use at most 1,000 rows and approximate rebuilds marked †. Perception Test is 19,140 three-option video questions; defaults 2 fps. Not a current board snapshot.

Checked / reported: 2026-10-17 · Samples: Not published

Snapshot: 2026-10-12 · Revision: cab71e6ad3461b8086d51ddb572c656babd63b0b · Published observations; result reuse terms not specified