Examenos

Correct answers over all 1,934 questions.

Liquid d1.1; Hosted native; returned identities {"liquid/d1.1-20261027": 1934}; collected 2026-10-27 to 2026-11-01 America/Toronto; one primary response per input, no scored retries.

Exact aggregate from the release statistics.

Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. A complete 1,934-call cost ledger has not been consolidated. Older 1,342-only scores are not converted into this bank. Not ranked here.

Checked / reported: 2026-11-01 · Samples: 1934

Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained

Equal-weight mean over the 41 categories.

Liquid d1.1; Hosted native; returned identities {"liquid/d1.1-20261027": 1934}; collected 2026-10-27 to 2026-11-01 America/Toronto; one primary response per input, no scored retries.

Exact aggregate from the release statistics.

Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. A complete 1,934-call cost ledger has not been consolidated. Older 1,342-only scores are not converted into this bank. Not ranked here.

Checked / reported: 2026-11-01 · Samples: 1934

Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained

Accuracy on the 592 questions new in v2.

Liquid d1.1; Hosted native; returned identities {"liquid/d1.1-20261027": 1934}; collected 2026-10-27 to 2026-11-01 America/Toronto; one primary response per input, no scored retries.

Exact aggregate from the release statistics.

Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. A complete 1,934-call cost ledger has not been consolidated. Older 1,342-only scores are not converted into this bank. Not ranked here.

Checked / reported: 2026-11-01 · Samples: 592

Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained

Accuracy on the 192 logical additions.

Liquid d1.1; Hosted native; returned identities {"liquid/d1.1-20261027": 1934}; collected 2026-10-27 to 2026-11-01 America/Toronto; one primary response per input, no scored retries.

Exact aggregate from the release statistics.

Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. A complete 1,934-call cost ledger has not been consolidated. Older 1,342-only scores are not converted into this bank. Not ranked here.

Checked / reported: 2026-11-01 · Samples: 192

Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained

Accuracy on the 400 practical additions.

Liquid d1.1; Hosted native; returned identities {"liquid/d1.1-20261027": 1934}; collected 2026-10-27 to 2026-11-01 America/Toronto; one primary response per input, no scored retries.

Exact aggregate from the release statistics.

Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. A complete 1,934-call cost ledger has not been consolidated. Older 1,342-only scores are not converted into this bank. Not ranked here.

Checked / reported: 2026-11-01 · Samples: 400

Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained

Accuracy on the frozen original inputs inside the v2 bank.

Liquid d1.1; Hosted native; returned identities {"liquid/d1.1-20261027": 1934}; collected 2026-10-27 to 2026-11-01 America/Toronto; one primary response per input, no scored retries.

Exact aggregate from the release statistics.

Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. A complete 1,934-call cost ledger has not been consolidated. Older 1,342-only scores are not converted into this bank. Not ranked here.

Checked / reported: 2026-11-01 · Samples: 1342

Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained

Pooled primary complete-response client time, network included.

Liquid d1.1; Hosted native; returned identities {"liquid/d1.1-20261027": 1934}; collected 2026-10-27 to 2026-11-01 America/Toronto; one primary response per input, no scored retries.

Exact aggregate from the release statistics.

Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. A complete 1,934-call cost ledger has not been consolidated. Older 1,342-only scores are not converted into this bank. Not ranked here.

Checked / reported: 2026-11-01 · Samples: 1934

Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained

Pooled primary complete-response client time, network included.

Liquid d1.1; Hosted native; returned identities {"liquid/d1.1-20261027": 1934}; collected 2026-10-27 to 2026-11-01 America/Toronto; one primary response per input, no scored retries.

Exact aggregate from the release statistics.

Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. A complete 1,934-call cost ledger has not been consolidated. Older 1,342-only scores are not converted into this bank. Not ranked here.

Checked / reported: 2026-11-01 · Samples: 1934

Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained

Lookup and filtering: 43 questions.

Liquid d1.1; Hosted native; returned identities {"liquid/d1.1-20261027": 1934}; collected 2026-10-27 to 2026-11-01 America/Toronto; one primary response per input, no scored retries.

Exact aggregate from the release statistics.

Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. A complete 1,934-call cost ledger has not been consolidated. Older 1,342-only scores are not converted into this bank. Not ranked here.

Checked / reported: 2026-11-01 · Samples: 43

Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained

Forward conditionals: 46 questions.

Liquid d1.1; Hosted native; returned identities {"liquid/d1.1-20261027": 1934}; collected 2026-10-27 to 2026-11-01 America/Toronto; one primary response per input, no scored retries.

Exact aggregate from the release statistics.

Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. A complete 1,934-call cost ledger has not been consolidated. Older 1,342-only scores are not converted into this bank. Not ranked here.

Checked / reported: 2026-11-01 · Samples: 46

Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained

Necessary conditions: 52 questions.

Liquid d1.1; Hosted native; returned identities {"liquid/d1.1-20261027": 1934}; collected 2026-10-27 to 2026-11-01 America/Toronto; one primary response per input, no scored retries.

Exact aggregate from the release statistics.

Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. A complete 1,934-call cost ledger has not been consolidated. Older 1,342-only scores are not converted into this bank. Not ranked here.

Checked / reported: 2026-11-01 · Samples: 52

Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained

Boolean scope: 54 questions.

Liquid d1.1; Hosted native; returned identities {"liquid/d1.1-20261027": 1934}; collected 2026-10-27 to 2026-11-01 America/Toronto; one primary response per input, no scored retries.

Exact aggregate from the release statistics.

Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. A complete 1,934-call cost ledger has not been consolidated. Older 1,342-only scores are not converted into this bank. Not ranked here.

Checked / reported: 2026-11-01 · Samples: 54

Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained

Quantifiers and sets: 49 questions.

Liquid d1.1; Hosted native; returned identities {"liquid/d1.1-20261027": 1934}; collected 2026-10-27 to 2026-11-01 America/Toronto; one primary response per input, no scored retries.

Exact aggregate from the release statistics.

Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. A complete 1,934-call cost ledger has not been consolidated. Older 1,342-only scores are not converted into this bank. Not ranked here.

Checked / reported: 2026-11-01 · Samples: 49

Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained

Comparisons: 40 questions.

Liquid d1.1; Hosted native; returned identities {"liquid/d1.1-20261027": 1934}; collected 2026-10-27 to 2026-11-01 America/Toronto; one primary response per input, no scored retries.

Exact aggregate from the release statistics.

Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. A complete 1,934-call cost ledger has not been consolidated. Older 1,342-only scores are not converted into this bank. Not ranked here.

Checked / reported: 2026-11-01 · Samples: 40

Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained

Scheduling: 76 questions.

Liquid d1.1; Hosted native; returned identities {"liquid/d1.1-20261027": 1934}; collected 2026-10-27 to 2026-11-01 America/Toronto; one primary response per input, no scored retries.

Exact aggregate from the release statistics.

Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. A complete 1,934-call cost ledger has not been consolidated. Older 1,342-only scores are not converted into this bank. Not ranked here.

Checked / reported: 2026-11-01 · Samples: 76

Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained

One-to-one assignments: 67 questions.

Liquid d1.1; Hosted native; returned identities {"liquid/d1.1-20261027": 1934}; collected 2026-10-27 to 2026-11-01 America/Toronto; one primary response per input, no scored retries.

Exact aggregate from the release statistics.

Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. A complete 1,934-call cost ledger has not been consolidated. Older 1,342-only scores are not converted into this bank. Not ranked here.

Checked / reported: 2026-11-01 · Samples: 67

Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained

Exact truth counting: 71 questions.

Liquid d1.1; Hosted native; returned identities {"liquid/d1.1-20261027": 1934}; collected 2026-10-27 to 2026-11-01 America/Toronto; one primary response per input, no scored retries.

Exact aggregate from the release statistics.

Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. A complete 1,934-call cost ledger has not been consolidated. Older 1,342-only scores are not converted into this bank. Not ranked here.

Checked / reported: 2026-11-01 · Samples: 71

Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained

Truth-teller consistency: 74 questions.

Liquid d1.1; Hosted native; returned identities {"liquid/d1.1-20261027": 1934}; collected 2026-10-27 to 2026-11-01 America/Toronto; one primary response per input, no scored retries.

Exact aggregate from the release statistics.

Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. A complete 1,934-call cost ledger has not been consolidated. Older 1,342-only scores are not converted into this bank. Not ranked here.

Checked / reported: 2026-11-01 · Samples: 74

Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained

Sufficiency and inconsistency: 41 questions.

Liquid d1.1; Hosted native; returned identities {"liquid/d1.1-20261027": 1934}; collected 2026-10-27 to 2026-11-01 America/Toronto; one primary response per input, no scored retries.

Exact aggregate from the release statistics.

Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. A complete 1,934-call cost ledger has not been consolidated. Older 1,342-only scores are not converted into this bank. Not ranked here.

Checked / reported: 2026-11-01 · Samples: 41

Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained

Object swaps: 52 questions.

Liquid d1.1; Hosted native; returned identities {"liquid/d1.1-20261027": 1934}; collected 2026-10-27 to 2026-11-01 America/Toronto; one primary response per input, no scored retries.

Exact aggregate from the release statistics.

Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. A complete 1,934-call cost ledger has not been consolidated. Older 1,342-only scores are not converted into this bank. Not ranked here.

Checked / reported: 2026-11-01 · Samples: 52

Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained

Sequential procedures: 48 questions.

Liquid d1.1; Hosted native; returned identities {"liquid/d1.1-20261027": 1934}; collected 2026-10-27 to 2026-11-01 America/Toronto; one primary response per input, no scored retries.

Exact aggregate from the release statistics.

Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. A complete 1,934-call cost ledger has not been consolidated. Older 1,342-only scores are not converted into this bank. Not ranked here.

Checked / reported: 2026-11-01 · Samples: 48

Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained

Temporal intervals: 42 questions.

Liquid d1.1; Hosted native; returned identities {"liquid/d1.1-20261027": 1934}; collected 2026-10-27 to 2026-11-01 America/Toronto; one primary response per input, no scored retries.

Exact aggregate from the release statistics.

Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. A complete 1,934-call cost ledger has not been consolidated. Older 1,342-only scores are not converted into this bank. Not ranked here.

Checked / reported: 2026-11-01 · Samples: 42

Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained

Spatial tracking: 49 questions.

Liquid d1.1; Hosted native; returned identities {"liquid/d1.1-20261027": 1934}; collected 2026-10-27 to 2026-11-01 America/Toronto; one primary response per input, no scored retries.

Exact aggregate from the release statistics.

Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. A complete 1,934-call cost ledger has not been consolidated. Older 1,342-only scores are not converted into this bank. Not ranked here.

Checked / reported: 2026-11-01 · Samples: 49

Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained

Reference binding: 50 questions.

Liquid d1.1; Hosted native; returned identities {"liquid/d1.1-20261027": 1934}; collected 2026-10-27 to 2026-11-01 America/Toronto; one primary response per input, no scored retries.

Exact aggregate from the release statistics.

Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. A complete 1,934-call cost ledger has not been consolidated. Older 1,342-only scores are not converted into this bank. Not ranked here.

Checked / reported: 2026-11-01 · Samples: 50

Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained

Beliefs and perspectives: 50 questions.

Liquid d1.1; Hosted native; returned identities {"liquid/d1.1-20261027": 1934}; collected 2026-10-27 to 2026-11-01 America/Toronto; one primary response per input, no scored retries.

Exact aggregate from the release statistics.

Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. A complete 1,934-call cost ledger has not been consolidated. Older 1,342-only scores are not converted into this bank. Not ranked here.

Checked / reported: 2026-11-01 · Samples: 50

Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained

Causal intervention: 50 questions.

Liquid d1.1; Hosted native; returned identities {"liquid/d1.1-20261027": 1934}; collected 2026-10-27 to 2026-11-01 America/Toronto; one primary response per input, no scored retries.

Exact aggregate from the release statistics.

Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. A complete 1,934-call cost ledger has not been consolidated. Older 1,342-only scores are not converted into this bank. Not ranked here.

Checked / reported: 2026-11-01 · Samples: 50

Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained

Exceptions and priorities: 58 questions.

Liquid d1.1; Hosted native; returned identities {"liquid/d1.1-20261027": 1934}; collected 2026-10-27 to 2026-11-01 America/Toronto; one primary response per input, no scored retries.

Exact aggregate from the release statistics.

Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. A complete 1,934-call cost ledger has not been consolidated. Older 1,342-only scores are not converted into this bank. Not ranked here.

Checked / reported: 2026-11-01 · Samples: 58

Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained

Planning: 43 questions.

Liquid d1.1; Hosted native; returned identities {"liquid/d1.1-20261027": 1934}; collected 2026-10-27 to 2026-11-01 America/Toronto; one primary response per input, no scored retries.

Exact aggregate from the release statistics.

Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. A complete 1,934-call cost ledger has not been consolidated. Older 1,342-only scores are not converted into this bank. Not ranked here.

Checked / reported: 2026-11-01 · Samples: 43

Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained

Directed reachability: 43 questions.

Liquid d1.1; Hosted native; returned identities {"liquid/d1.1-20261027": 1934}; collected 2026-10-27 to 2026-11-01 America/Toronto; one primary response per input, no scored retries.

Exact aggregate from the release statistics.

Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. A complete 1,934-call cost ledger has not been consolidated. Older 1,342-only scores are not converted into this bank. Not ranked here.

Checked / reported: 2026-11-01 · Samples: 43

Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained

Preference ordering: 51 questions.

Liquid d1.1; Hosted native; returned identities {"liquid/d1.1-20261027": 1934}; collected 2026-10-27 to 2026-11-01 America/Toronto; one primary response per input, no scored retries.

Exact aggregate from the release statistics.

Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. A complete 1,934-call cost ledger has not been consolidated. Older 1,342-only scores are not converted into this bank. Not ranked here.

Checked / reported: 2026-11-01 · Samples: 51

Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained

Rule counterexamples: 52 questions.

Liquid d1.1; Hosted native; returned identities {"liquid/d1.1-20261027": 1934}; collected 2026-10-27 to 2026-11-01 America/Toronto; one primary response per input, no scored retries.

Exact aggregate from the release statistics.

Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. A complete 1,934-call cost ledger has not been consolidated. Older 1,342-only scores are not converted into this bank. Not ranked here.

Checked / reported: 2026-11-01 · Samples: 52

Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained

Authority and stale records: 43 questions.

Liquid d1.1; Hosted native; returned identities {"liquid/d1.1-20261027": 1934}; collected 2026-10-27 to 2026-11-01 America/Toronto; one primary response per input, no scored retries.

Exact aggregate from the release statistics.

Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. A complete 1,934-call cost ledger has not been consolidated. Older 1,342-only scores are not converted into this bank. Not ranked here.

Checked / reported: 2026-11-01 · Samples: 43

Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained

Fault diagnosis: 50 questions.

Liquid d1.1; Hosted native; returned identities {"liquid/d1.1-20261027": 1934}; collected 2026-10-27 to 2026-11-01 America/Toronto; one primary response per input, no scored retries.

Exact aggregate from the release statistics.

Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. A complete 1,934-call cost ledger has not been consolidated. Older 1,342-only scores are not converted into this bank. Not ranked here.

Checked / reported: 2026-11-01 · Samples: 50

Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained

Probabilistic risk: 40 questions.

Liquid d1.1; Hosted native; returned identities {"liquid/d1.1-20261027": 1934}; collected 2026-10-27 to 2026-11-01 America/Toronto; one primary response per input, no scored retries.

Exact aggregate from the release statistics.

Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. A complete 1,934-call cost ledger has not been consolidated. Older 1,342-only scores are not converted into this bank. Not ranked here.

Checked / reported: 2026-11-01 · Samples: 40

Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained

Value of information: 40 questions.

Liquid d1.1; Hosted native; returned identities {"liquid/d1.1-20261027": 1934}; collected 2026-10-27 to 2026-11-01 America/Toronto; one primary response per input, no scored retries.

Exact aggregate from the release statistics.

Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. A complete 1,934-call cost ledger has not been consolidated. Older 1,342-only scores are not converted into this bank. Not ranked here.

Checked / reported: 2026-11-01 · Samples: 40

Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained

Robust decisions without a prior: 40 questions.

Liquid d1.1; Hosted native; returned identities {"liquid/d1.1-20261027": 1934}; collected 2026-10-27 to 2026-11-01 America/Toronto; one primary response per input, no scored retries.

Exact aggregate from the release statistics.

Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. A complete 1,934-call cost ledger has not been consolidated. Older 1,342-only scores are not converted into this bank. Not ranked here.

Checked / reported: 2026-11-01 · Samples: 40

Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained

Strategic decisions: 40 questions.

Liquid d1.1; Hosted native; returned identities {"liquid/d1.1-20261027": 1934}; collected 2026-10-27 to 2026-11-01 America/Toronto; one primary response per input, no scored retries.

Exact aggregate from the release statistics.

Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. A complete 1,934-call cost ledger has not been consolidated. Older 1,342-only scores are not converted into this bank. Not ranked here.

Checked / reported: 2026-11-01 · Samples: 40

Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained

Concurrent-history consistency: 40 questions.

Liquid d1.1; Hosted native; returned identities {"liquid/d1.1-20261027": 1934}; collected 2026-10-27 to 2026-11-01 America/Toronto; one primary response per input, no scored retries.

Exact aggregate from the release statistics.

Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. A complete 1,934-call cost ledger has not been consolidated. Older 1,342-only scores are not converted into this bank. Not ranked here.

Checked / reported: 2026-11-01 · Samples: 40

Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained

Information-flow security: 40 questions.

Liquid d1.1; Hosted native; returned identities {"liquid/d1.1-20261027": 1934}; collected 2026-10-27 to 2026-11-01 America/Toronto; one primary response per input, no scored retries.

Exact aggregate from the release statistics.

Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. A complete 1,934-call cost ledger has not been consolidated. Older 1,342-only scores are not converted into this bank. Not ranked here.

Checked / reported: 2026-11-01 · Samples: 40

Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained

Understanding requests and routing: 40 questions.

Liquid d1.1; Hosted native; returned identities {"liquid/d1.1-20261027": 1934}; collected 2026-10-27 to 2026-11-01 America/Toronto; one primary response per input, no scored retries.

Exact aggregate from the release statistics.

Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. A complete 1,934-call cost ledger has not been consolidated. Older 1,342-only scores are not converted into this bank. Not ranked here.

Checked / reported: 2026-11-01 · Samples: 40

Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained

Recognizing multiple requested actions: 40 questions.

Liquid d1.1; Hosted native; returned identities {"liquid/d1.1-20261027": 1934}; collected 2026-10-27 to 2026-11-01 America/Toronto; one primary response per input, no scored retries.

Exact aggregate from the release statistics.

Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. A complete 1,934-call cost ledger has not been consolidated. Older 1,342-only scores are not converted into this bank. Not ranked here.

Checked / reported: 2026-11-01 · Samples: 40

Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained

Tracking current conversational intention: 40 questions.

Liquid d1.1; Hosted native; returned identities {"liquid/d1.1-20261027": 1934}; collected 2026-10-27 to 2026-11-01 America/Toronto; one primary response per input, no scored retries.

Exact aggregate from the release statistics.

Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. A complete 1,934-call cost ledger has not been consolidated. Older 1,342-only scores are not converted into this bank. Not ranked here.

Checked / reported: 2026-11-01 · Samples: 40

Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained

Selecting a tool or requesting clarification: 40 questions.

Liquid d1.1; Hosted native; returned identities {"liquid/d1.1-20261027": 1934}; collected 2026-10-27 to 2026-11-01 America/Toronto; one primary response per input, no scored retries.

Exact aggregate from the release statistics.

Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. A complete 1,934-call cost ledger has not been consolidated. Older 1,342-only scores are not converted into this bank. Not ranked here.

Checked / reported: 2026-11-01 · Samples: 40

Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained

Checking authorization and scope: 40 questions.

Liquid d1.1; Hosted native; returned identities {"liquid/d1.1-20261027": 1934}; collected 2026-10-27 to 2026-11-01 America/Toronto; one primary response per input, no scored retries.

Exact aggregate from the release statistics.

Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. A complete 1,934-call cost ledger has not been consolidated. Older 1,342-only scores are not converted into this bank. Not ranked here.

Checked / reported: 2026-11-01 · Samples: 40

Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained

Making decisions with untrusted content: 40 questions.

Liquid d1.1; Hosted native; returned identities {"liquid/d1.1-20261027": 1934}; collected 2026-10-27 to 2026-11-01 America/Toronto; one primary response per input, no scored retries.

Exact aggregate from the release statistics.

Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. A complete 1,934-call cost ledger has not been consolidated. Older 1,342-only scores are not converted into this bank. Not ranked here.

Checked / reported: 2026-11-01 · Samples: 40

Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained

Applying a contextual content policy: 40 questions.

Liquid d1.1; Hosted native; returned identities {"liquid/d1.1-20261027": 1934}; collected 2026-10-27 to 2026-11-01 America/Toronto; one primary response per input, no scored retries.

Exact aggregate from the release statistics.

Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. A complete 1,934-call cost ledger has not been consolidated. Older 1,342-only scores are not converted into this bank. Not ranked here.

Checked / reported: 2026-11-01 · Samples: 40

Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained

Extracting and normalizing facts: 40 questions.

Liquid d1.1; Hosted native; returned identities {"liquid/d1.1-20261027": 1934}; collected 2026-10-27 to 2026-11-01 America/Toronto; one primary response per input, no scored retries.

Exact aggregate from the release statistics.

Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. A complete 1,934-call cost ledger has not been consolidated. Older 1,342-only scores are not converted into this bank. Not ranked here.

Checked / reported: 2026-11-01 · Samples: 40

Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained

Checking claims against supplied evidence: 40 questions.

Liquid d1.1; Hosted native; returned identities {"liquid/d1.1-20261027": 1934}; collected 2026-10-27 to 2026-11-01 America/Toronto; one primary response per input, no scored retries.

Exact aggregate from the release statistics.

Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. A complete 1,934-call cost ledger has not been consolidated. Older 1,342-only scores are not converted into this bank. Not ranked here.

Checked / reported: 2026-11-01 · Samples: 40

Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained

Assigning severity or priority from a rubric: 40 questions.

Liquid d1.1; Hosted native; returned identities {"liquid/d1.1-20261027": 1934}; collected 2026-10-27 to 2026-11-01 America/Toronto; one primary response per input, no scored retries.

Exact aggregate from the release statistics.

Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. A complete 1,934-call cost ledger has not been consolidated. Older 1,342-only scores are not converted into this bank. Not ranked here.

Checked / reported: 2026-11-01 · Samples: 40

Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained

Exact named hosted API observation; All-case accuracy.

Named source route liquid/d1.1; ModelTested runner v1; tested_on=openrouter. The route serves endpoint label liquid/d1.1-20261027, read from OpenRouter or a returned identity on 1 November 2026, not from ModelTested. Backend weight revision and API inference precision unpublished.

Publisher generated 2026-10-31; board added this route 2026-10-28. Execution dates, token usage and hashes remain in its per-run receipts. No private prompt/response archive imported.

56 authored situations, including 19 hard cases, each with two typed questions; 14 public and 42 hidden cases. Source aggregate averages per-case decision accuracy. Confidence score is 100×(1−mean multiclass Brier/2), not ECE or a calibration probability. Small single-run benchmark; current HF access/size does not inherit this evaluator’s stale closed/API-only metadata. No tariff inferred from rounded cost 0.0. Rows added 1 November 2026 use revision 668a52ad3b932ca910fd985f96dcdf0a85d2dae1, where the earlier 11 systems are unchanged.

Checked / reported: 2026-10-31 · Samples: 56

Snapshot: 2026-10-18 · Revision: 081e8f37130a4a9077b8cffe62827d4c3b9e3b23; 668a52ad3b932ca910fd985f96dcdf0a85d2dae1 for Drex Max, Jev 1.14 and d1.1 · Published aggregate observations; result reuse terms not separately specified

Exact named hosted API observation; Hard-case accuracy.

Named source route liquid/d1.1; ModelTested runner v1; tested_on=openrouter. The route serves endpoint label liquid/d1.1-20261027, read from OpenRouter or a returned identity on 1 November 2026, not from ModelTested. Backend weight revision and API inference precision unpublished.

Publisher generated 2026-10-31; board added this route 2026-10-28. Execution dates, token usage and hashes remain in its per-run receipts. No private prompt/response archive imported.

56 authored situations, including 19 hard cases, each with two typed questions; 14 public and 42 hidden cases. Source aggregate averages per-case decision accuracy. Confidence score is 100×(1−mean multiclass Brier/2), not ECE or a calibration probability. Small single-run benchmark; current HF access/size does not inherit this evaluator’s stale closed/API-only metadata. No tariff inferred from rounded cost 0.0. Rows added 1 November 2026 use revision 668a52ad3b932ca910fd985f96dcdf0a85d2dae1, where the earlier 11 systems are unchanged.

Checked / reported: 2026-10-31 · Samples: 56

Snapshot: 2026-10-18 · Revision: 081e8f37130a4a9077b8cffe62827d4c3b9e3b23; 668a52ad3b932ca910fd985f96dcdf0a85d2dae1 for Drex Max, Jev 1.14 and d1.1 · Published aggregate observations; result reuse terms not separately specified

Exact named hosted API observation; Public-case accuracy.

Named source route liquid/d1.1; ModelTested runner v1; tested_on=openrouter. The route serves endpoint label liquid/d1.1-20261027, read from OpenRouter or a returned identity on 1 November 2026, not from ModelTested. Backend weight revision and API inference precision unpublished.

Publisher generated 2026-10-31; board added this route 2026-10-28. Execution dates, token usage and hashes remain in its per-run receipts. No private prompt/response archive imported.

56 authored situations, including 19 hard cases, each with two typed questions; 14 public and 42 hidden cases. Source aggregate averages per-case decision accuracy. Confidence score is 100×(1−mean multiclass Brier/2), not ECE or a calibration probability. Small single-run benchmark; current HF access/size does not inherit this evaluator’s stale closed/API-only metadata. No tariff inferred from rounded cost 0.0. Rows added 1 November 2026 use revision 668a52ad3b932ca910fd985f96dcdf0a85d2dae1, where the earlier 11 systems are unchanged.

Checked / reported: 2026-10-31 · Samples: 56

Snapshot: 2026-10-18 · Revision: 081e8f37130a4a9077b8cffe62827d4c3b9e3b23; 668a52ad3b932ca910fd985f96dcdf0a85d2dae1 for Drex Max, Jev 1.14 and d1.1 · Published aggregate observations; result reuse terms not separately specified

Exact named hosted API observation; Hidden-case accuracy.

Named source route liquid/d1.1; ModelTested runner v1; tested_on=openrouter. The route serves endpoint label liquid/d1.1-20261027, read from OpenRouter or a returned identity on 1 November 2026, not from ModelTested. Backend weight revision and API inference precision unpublished.

Publisher generated 2026-10-31; board added this route 2026-10-28. Execution dates, token usage and hashes remain in its per-run receipts. No private prompt/response archive imported.

56 authored situations, including 19 hard cases, each with two typed questions; 14 public and 42 hidden cases. Source aggregate averages per-case decision accuracy. Confidence score is 100×(1−mean multiclass Brier/2), not ECE or a calibration probability. Small single-run benchmark; current HF access/size does not inherit this evaluator’s stale closed/API-only metadata. No tariff inferred from rounded cost 0.0. Rows added 1 November 2026 use revision 668a52ad3b932ca910fd985f96dcdf0a85d2dae1, where the earlier 11 systems are unchanged.

Checked / reported: 2026-10-31 · Samples: 56

Snapshot: 2026-10-18 · Revision: 081e8f37130a4a9077b8cffe62827d4c3b9e3b23; 668a52ad3b932ca910fd985f96dcdf0a85d2dae1 for Drex Max, Jev 1.14 and d1.1 · Published aggregate observations; result reuse terms not separately specified

Exact named hosted API observation; Brier-based confidence score.

Named source route liquid/d1.1; ModelTested runner v1; tested_on=openrouter. The route serves endpoint label liquid/d1.1-20261027, read from OpenRouter or a returned identity on 1 November 2026, not from ModelTested. Backend weight revision and API inference precision unpublished.

Publisher generated 2026-10-31; board added this route 2026-10-28. Execution dates, token usage and hashes remain in its per-run receipts. No private prompt/response archive imported.

56 authored situations, including 19 hard cases, each with two typed questions; 14 public and 42 hidden cases. Source aggregate averages per-case decision accuracy. Confidence score is 100×(1−mean multiclass Brier/2), not ECE or a calibration probability. Small single-run benchmark; current HF access/size does not inherit this evaluator’s stale closed/API-only metadata. No tariff inferred from rounded cost 0.0. Rows added 1 November 2026 use revision 668a52ad3b932ca910fd985f96dcdf0a85d2dae1, where the earlier 11 systems are unchanged.

Checked / reported: 2026-10-31 · Samples: 56

Snapshot: 2026-10-18 · Revision: 081e8f37130a4a9077b8cffe62827d4c3b9e3b23; 668a52ad3b932ca910fd985f96dcdf0a85d2dae1 for Drex Max, Jev 1.14 and d1.1 · Published aggregate observations; result reuse terms not separately specified