Turion Jev 31B Decision Model Results

Turion Jev 31B

Explore Turion Jev 31B: exact decision configuration, published specifications, source-linked benchmarks and API tariffs when available.

← All decision models · Compare this decision system →

379 recorded observations. Published results retain their source and setup; no Examenos evaluation was run. Missing results are not zero. How to read these comparisons →

Official / vendor · Turion Jev 31B model card (vendor measured)

Turion Jev 31B · Official / vendor · Turion Jev 31B model card (vendor measured)
Evaluation	Result	Evidence
Turion card · Decision Index 0.3 public index	66.16	Setup & source Own run of the public 0.3 suite. Own run of the public suite; FP8 on one NVIDIA RTX PRO 6000 (96 GB), one request at a time. Printed in the vendor's own table. Turion's own run of the public 0.3 suite: 140,620 requests, 140,393 ok, 140,178 scoreable, 227 unsupported, 0 errors, FP8 on one RTX PRO 6000. Not ranked here. Checked / reported: 2026-11-02 · Samples: 140178 Snapshot: 2026-10-24 · Revision: 866c0fc6e040cba23fcc72113a80e5c99d5ebab1 · Published observations; result reuse terms not specified Result source · Benchmark source
Turion card · Median request time	116 ms	Setup & source Median request time in the official run. Own run of the public suite; FP8 on one NVIDIA RTX PRO 6000 (96 GB), one request at a time. Printed in the vendor's own table. Turion's own run of the public 0.3 suite: 140,620 requests, 140,393 ok, 140,178 scoreable, 227 unsupported, 0 errors, FP8 on one RTX PRO 6000. Not ranked here. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-24 · Revision: 866c0fc6e040cba23fcc72113a80e5c99d5ebab1 · Published observations; result reuse terms not specified Result source · Benchmark source
Turion card · Mean request time	288 ms	Setup & source Mean request time in the official run. Own run of the public suite; FP8 on one NVIDIA RTX PRO 6000 (96 GB), one request at a time. Printed in the vendor's own table. Turion's own run of the public 0.3 suite: 140,620 requests, 140,393 ok, 140,178 scoreable, 227 unsupported, 0 errors, FP8 on one RTX PRO 6000. Not ranked here. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-24 · Revision: 866c0fc6e040cba23fcc72113a80e5c99d5ebab1 · Published observations; result reuse terms not specified Result source · Benchmark source
Turion card · P80 request time	352 ms	Setup & source P80 request time in the official run. Own run of the public suite; FP8 on one NVIDIA RTX PRO 6000 (96 GB), one request at a time. Printed in the vendor's own table. Turion's own run of the public 0.3 suite: 140,620 requests, 140,393 ok, 140,178 scoreable, 227 unsupported, 0 errors, FP8 on one RTX PRO 6000. Not ranked here. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-24 · Revision: 866c0fc6e040cba23fcc72113a80e5c99d5ebab1 · Published observations; result reuse terms not specified Result source · Benchmark source

Evaluator-published · Community Decision Index

Evaluator-published · etsabary System 1 Decision Benchmark

Turion Jev 31B · Evaluator-published · etsabary System 1 Decision Benchmark
Evaluation	Result	Evidence
System 1 Decision Benchmark v2 · All-question accuracy	79.886%	Setup & source Correct answers over all 1,934 questions. Turion Jev 31B; Hosted native; returned identities {"turion-jev-31b": 1934}; collected 2026-10-29 to 2026-10-31 America/Toronto; one primary response per input, no scored retries. Exact aggregate from the release statistics. Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. The source published a separate cost ledger on 1 November 2026, stored as decision-reference-v2-cost-per-1000, which supersedes its earlier “cost not consolidated” note. Older 1,342-only scores are not converted into this bank. Not ranked here. Checked / reported: 2026-11-02 · Samples: 1934 Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
System 1 Decision Benchmark v2 · Macro-category accuracy	79.640%	Setup & source Equal-weight mean over the 41 categories. Turion Jev 31B; Hosted native; returned identities {"turion-jev-31b": 1934}; collected 2026-10-29 to 2026-10-31 America/Toronto; one primary response per input, no scored retries. Exact aggregate from the release statistics. Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. The source published a separate cost ledger on 1 November 2026, stored as decision-reference-v2-cost-per-1000, which supersedes its earlier “cost not consolidated” note. Older 1,342-only scores are not converted into this bank. Not ranked here. Checked / reported: 2026-11-02 · Samples: 1934 Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
System 1 Decision Benchmark v2 · Added 592 questions	71.622%	Setup & source Accuracy on the 592 questions new in v2. Turion Jev 31B; Hosted native; returned identities {"turion-jev-31b": 1934}; collected 2026-10-29 to 2026-10-31 America/Toronto; one primary response per input, no scored retries. Exact aggregate from the release statistics. Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. The source published a separate cost ledger on 1 November 2026, stored as decision-reference-v2-cost-per-1000, which supersedes its earlier “cost not consolidated” note. Older 1,342-only scores are not converted into this bank. Not ranked here. Checked / reported: 2026-11-02 · Samples: 592 Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
System 1 Decision Benchmark v2 · Logical additions	62.500%	Setup & source Accuracy on the 192 logical additions. Turion Jev 31B; Hosted native; returned identities {"turion-jev-31b": 1934}; collected 2026-10-29 to 2026-10-31 America/Toronto; one primary response per input, no scored retries. Exact aggregate from the release statistics. Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. The source published a separate cost ledger on 1 November 2026, stored as decision-reference-v2-cost-per-1000, which supersedes its earlier “cost not consolidated” note. Older 1,342-only scores are not converted into this bank. Not ranked here. Checked / reported: 2026-11-02 · Samples: 192 Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
System 1 Decision Benchmark v2 · Practical additions	76.000%	Setup & source Accuracy on the 400 practical additions. Turion Jev 31B; Hosted native; returned identities {"turion-jev-31b": 1934}; collected 2026-10-29 to 2026-10-31 America/Toronto; one primary response per input, no scored retries. Exact aggregate from the release statistics. Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. The source published a separate cost ledger on 1 November 2026, stored as decision-reference-v2-cost-per-1000, which supersedes its earlier “cost not consolidated” note. Older 1,342-only scores are not converted into this bank. Not ranked here. Checked / reported: 2026-11-02 · Samples: 400 Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
System 1 Decision Benchmark v2 · Original 1,342 questions	83.532%	Setup & source Accuracy on the frozen original inputs inside the v2 bank. Turion Jev 31B; Hosted native; returned identities {"turion-jev-31b": 1934}; collected 2026-10-29 to 2026-10-31 America/Toronto; one primary response per input, no scored retries. Exact aggregate from the release statistics. Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. The source published a separate cost ledger on 1 November 2026, stored as decision-reference-v2-cost-per-1000, which supersedes its earlier “cost not consolidated” note. Older 1,342-only scores are not converted into this bank. Not ranked here. Checked / reported: 2026-11-02 · Samples: 1342 Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
System 1 Decision Benchmark v2 · Median client time	508.9 ms	Setup & source Pooled primary complete-response client time, network included. Turion Jev 31B; Hosted native; returned identities {"turion-jev-31b": 1934}; collected 2026-10-29 to 2026-10-31 America/Toronto; one primary response per input, no scored retries. Exact aggregate from the release statistics. Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. The source published a separate cost ledger on 1 November 2026, stored as decision-reference-v2-cost-per-1000, which supersedes its earlier “cost not consolidated” note. Older 1,342-only scores are not converted into this bank. Not ranked here. Checked / reported: 2026-11-02 · Samples: 1934 Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
System 1 Decision Benchmark v2 · P95 client time	909.4 ms	Setup & source Pooled primary complete-response client time, network included. Turion Jev 31B; Hosted native; returned identities {"turion-jev-31b": 1934}; collected 2026-10-29 to 2026-10-31 America/Toronto; one primary response per input, no scored retries. Exact aggregate from the release statistics. Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. The source published a separate cost ledger on 1 November 2026, stored as decision-reference-v2-cost-per-1000, which supersedes its earlier “cost not consolidated” note. Older 1,342-only scores are not converted into this bank. Not ranked here. Checked / reported: 2026-11-02 · Samples: 1934 Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
System 1 Decision Benchmark v2 · F01 · Lookup and filtering	97.674%	Setup & source Lookup and filtering: 43 questions. Turion Jev 31B; Hosted native; returned identities {"turion-jev-31b": 1934}; collected 2026-10-29 to 2026-10-31 America/Toronto; one primary response per input, no scored retries. Exact aggregate from the release statistics. Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. The source published a separate cost ledger on 1 November 2026, stored as decision-reference-v2-cost-per-1000, which supersedes its earlier “cost not consolidated” note. Older 1,342-only scores are not converted into this bank. Not ranked here. Checked / reported: 2026-11-02 · Samples: 43 Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
System 1 Decision Benchmark v2 · F02 · Forward conditionals	93.478%	Setup & source Forward conditionals: 46 questions. Turion Jev 31B; Hosted native; returned identities {"turion-jev-31b": 1934}; collected 2026-10-29 to 2026-10-31 America/Toronto; one primary response per input, no scored retries. Exact aggregate from the release statistics. Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. The source published a separate cost ledger on 1 November 2026, stored as decision-reference-v2-cost-per-1000, which supersedes its earlier “cost not consolidated” note. Older 1,342-only scores are not converted into this bank. Not ranked here. Checked / reported: 2026-11-02 · Samples: 46 Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
System 1 Decision Benchmark v2 · F03 · Necessary conditions	94.231%	Setup & source Necessary conditions: 52 questions. Turion Jev 31B; Hosted native; returned identities {"turion-jev-31b": 1934}; collected 2026-10-29 to 2026-10-31 America/Toronto; one primary response per input, no scored retries. Exact aggregate from the release statistics. Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. The source published a separate cost ledger on 1 November 2026, stored as decision-reference-v2-cost-per-1000, which supersedes its earlier “cost not consolidated” note. Older 1,342-only scores are not converted into this bank. Not ranked here. Checked / reported: 2026-11-02 · Samples: 52 Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
System 1 Decision Benchmark v2 · F04 · Boolean scope	98.148%	Setup & source Boolean scope: 54 questions. Turion Jev 31B; Hosted native; returned identities {"turion-jev-31b": 1934}; collected 2026-10-29 to 2026-10-31 America/Toronto; one primary response per input, no scored retries. Exact aggregate from the release statistics. Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. The source published a separate cost ledger on 1 November 2026, stored as decision-reference-v2-cost-per-1000, which supersedes its earlier “cost not consolidated” note. Older 1,342-only scores are not converted into this bank. Not ranked here. Checked / reported: 2026-11-02 · Samples: 54 Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
System 1 Decision Benchmark v2 · F05 · Quantifiers and sets	93.878%	Setup & source Quantifiers and sets: 49 questions. Turion Jev 31B; Hosted native; returned identities {"turion-jev-31b": 1934}; collected 2026-10-29 to 2026-10-31 America/Toronto; one primary response per input, no scored retries. Exact aggregate from the release statistics. Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. The source published a separate cost ledger on 1 November 2026, stored as decision-reference-v2-cost-per-1000, which supersedes its earlier “cost not consolidated” note. Older 1,342-only scores are not converted into this bank. Not ranked here. Checked / reported: 2026-11-02 · Samples: 49 Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
System 1 Decision Benchmark v2 · F06 · Comparisons	97.500%	Setup & source Comparisons: 40 questions. Turion Jev 31B; Hosted native; returned identities {"turion-jev-31b": 1934}; collected 2026-10-29 to 2026-10-31 America/Toronto; one primary response per input, no scored retries. Exact aggregate from the release statistics. Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. The source published a separate cost ledger on 1 November 2026, stored as decision-reference-v2-cost-per-1000, which supersedes its earlier “cost not consolidated” note. Older 1,342-only scores are not converted into this bank. Not ranked here. Checked / reported: 2026-11-02 · Samples: 40 Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
System 1 Decision Benchmark v2 · F07 · Scheduling	78.947%	Setup & source Scheduling: 76 questions. Turion Jev 31B; Hosted native; returned identities {"turion-jev-31b": 1934}; collected 2026-10-29 to 2026-10-31 America/Toronto; one primary response per input, no scored retries. Exact aggregate from the release statistics. Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. The source published a separate cost ledger on 1 November 2026, stored as decision-reference-v2-cost-per-1000, which supersedes its earlier “cost not consolidated” note. Older 1,342-only scores are not converted into this bank. Not ranked here. Checked / reported: 2026-11-02 · Samples: 76 Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
System 1 Decision Benchmark v2 · F08 · One-to-one assignments	95.522%	Setup & source One-to-one assignments: 67 questions. Turion Jev 31B; Hosted native; returned identities {"turion-jev-31b": 1934}; collected 2026-10-29 to 2026-10-31 America/Toronto; one primary response per input, no scored retries. Exact aggregate from the release statistics. Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. The source published a separate cost ledger on 1 November 2026, stored as decision-reference-v2-cost-per-1000, which supersedes its earlier “cost not consolidated” note. Older 1,342-only scores are not converted into this bank. Not ranked here. Checked / reported: 2026-11-02 · Samples: 67 Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
System 1 Decision Benchmark v2 · F09 · Exact truth counting	74.648%	Setup & source Exact truth counting: 71 questions. Turion Jev 31B; Hosted native; returned identities {"turion-jev-31b": 1934}; collected 2026-10-29 to 2026-10-31 America/Toronto; one primary response per input, no scored retries. Exact aggregate from the release statistics. Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. The source published a separate cost ledger on 1 November 2026, stored as decision-reference-v2-cost-per-1000, which supersedes its earlier “cost not consolidated” note. Older 1,342-only scores are not converted into this bank. Not ranked here. Checked / reported: 2026-11-02 · Samples: 71 Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
System 1 Decision Benchmark v2 · F10 · Truth-teller consistency	55.405%	Setup & source Truth-teller consistency: 74 questions. Turion Jev 31B; Hosted native; returned identities {"turion-jev-31b": 1934}; collected 2026-10-29 to 2026-10-31 America/Toronto; one primary response per input, no scored retries. Exact aggregate from the release statistics. Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. The source published a separate cost ledger on 1 November 2026, stored as decision-reference-v2-cost-per-1000, which supersedes its earlier “cost not consolidated” note. Older 1,342-only scores are not converted into this bank. Not ranked here. Checked / reported: 2026-11-02 · Samples: 74 Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
System 1 Decision Benchmark v2 · F11 · Sufficiency and inconsistency	95.122%	Setup & source Sufficiency and inconsistency: 41 questions. Turion Jev 31B; Hosted native; returned identities {"turion-jev-31b": 1934}; collected 2026-10-29 to 2026-10-31 America/Toronto; one primary response per input, no scored retries. Exact aggregate from the release statistics. Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. The source published a separate cost ledger on 1 November 2026, stored as decision-reference-v2-cost-per-1000, which supersedes its earlier “cost not consolidated” note. Older 1,342-only scores are not converted into this bank. Not ranked here. Checked / reported: 2026-11-02 · Samples: 41 Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
System 1 Decision Benchmark v2 · F12 · Object swaps	57.692%	Setup & source Object swaps: 52 questions. Turion Jev 31B; Hosted native; returned identities {"turion-jev-31b": 1934}; collected 2026-10-29 to 2026-10-31 America/Toronto; one primary response per input, no scored retries. Exact aggregate from the release statistics. Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. The source published a separate cost ledger on 1 November 2026, stored as decision-reference-v2-cost-per-1000, which supersedes its earlier “cost not consolidated” note. Older 1,342-only scores are not converted into this bank. Not ranked here. Checked / reported: 2026-11-02 · Samples: 52 Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
System 1 Decision Benchmark v2 · F13 · Sequential procedures	20.833%	Setup & source Sequential procedures: 48 questions. Turion Jev 31B; Hosted native; returned identities {"turion-jev-31b": 1934}; collected 2026-10-29 to 2026-10-31 America/Toronto; one primary response per input, no scored retries. Exact aggregate from the release statistics. Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. The source published a separate cost ledger on 1 November 2026, stored as decision-reference-v2-cost-per-1000, which supersedes its earlier “cost not consolidated” note. Older 1,342-only scores are not converted into this bank. Not ranked here. Checked / reported: 2026-11-02 · Samples: 48 Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
System 1 Decision Benchmark v2 · F14 · Temporal intervals	92.857%	Setup & source Temporal intervals: 42 questions. Turion Jev 31B; Hosted native; returned identities {"turion-jev-31b": 1934}; collected 2026-10-29 to 2026-10-31 America/Toronto; one primary response per input, no scored retries. Exact aggregate from the release statistics. Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. The source published a separate cost ledger on 1 November 2026, stored as decision-reference-v2-cost-per-1000, which supersedes its earlier “cost not consolidated” note. Older 1,342-only scores are not converted into this bank. Not ranked here. Checked / reported: 2026-11-02 · Samples: 42 Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
System 1 Decision Benchmark v2 · F15 · Spatial tracking	85.714%	Setup & source Spatial tracking: 49 questions. Turion Jev 31B; Hosted native; returned identities {"turion-jev-31b": 1934}; collected 2026-10-29 to 2026-10-31 America/Toronto; one primary response per input, no scored retries. Exact aggregate from the release statistics. Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. The source published a separate cost ledger on 1 November 2026, stored as decision-reference-v2-cost-per-1000, which supersedes its earlier “cost not consolidated” note. Older 1,342-only scores are not converted into this bank. Not ranked here. Checked / reported: 2026-11-02 · Samples: 49 Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
System 1 Decision Benchmark v2 · F16 · Reference binding	70.000%	Setup & source Reference binding: 50 questions. Turion Jev 31B; Hosted native; returned identities {"turion-jev-31b": 1934}; collected 2026-10-29 to 2026-10-31 America/Toronto; one primary response per input, no scored retries. Exact aggregate from the release statistics. Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. The source published a separate cost ledger on 1 November 2026, stored as decision-reference-v2-cost-per-1000, which supersedes its earlier “cost not consolidated” note. Older 1,342-only scores are not converted into this bank. Not ranked here. Checked / reported: 2026-11-02 · Samples: 50 Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
System 1 Decision Benchmark v2 · F17 · Beliefs and perspectives	94.000%	Setup & source Beliefs and perspectives: 50 questions. Turion Jev 31B; Hosted native; returned identities {"turion-jev-31b": 1934}; collected 2026-10-29 to 2026-10-31 America/Toronto; one primary response per input, no scored retries. Exact aggregate from the release statistics. Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. The source published a separate cost ledger on 1 November 2026, stored as decision-reference-v2-cost-per-1000, which supersedes its earlier “cost not consolidated” note. Older 1,342-only scores are not converted into this bank. Not ranked here. Checked / reported: 2026-11-02 · Samples: 50 Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
System 1 Decision Benchmark v2 · F18 · Causal intervention	92.000%	Setup & source Causal intervention: 50 questions. Turion Jev 31B; Hosted native; returned identities {"turion-jev-31b": 1934}; collected 2026-10-29 to 2026-10-31 America/Toronto; one primary response per input, no scored retries. Exact aggregate from the release statistics. Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. The source published a separate cost ledger on 1 November 2026, stored as decision-reference-v2-cost-per-1000, which supersedes its earlier “cost not consolidated” note. Older 1,342-only scores are not converted into this bank. Not ranked here. Checked / reported: 2026-11-02 · Samples: 50 Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
System 1 Decision Benchmark v2 · F19 · Exceptions and priorities	93.103%	Setup & source Exceptions and priorities: 58 questions. Turion Jev 31B; Hosted native; returned identities {"turion-jev-31b": 1934}; collected 2026-10-29 to 2026-10-31 America/Toronto; one primary response per input, no scored retries. Exact aggregate from the release statistics. Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. The source published a separate cost ledger on 1 November 2026, stored as decision-reference-v2-cost-per-1000, which supersedes its earlier “cost not consolidated” note. Older 1,342-only scores are not converted into this bank. Not ranked here. Checked / reported: 2026-11-02 · Samples: 58 Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
System 1 Decision Benchmark v2 · F20 · Planning	93.023%	Setup & source Planning: 43 questions. Turion Jev 31B; Hosted native; returned identities {"turion-jev-31b": 1934}; collected 2026-10-29 to 2026-10-31 America/Toronto; one primary response per input, no scored retries. Exact aggregate from the release statistics. Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. The source published a separate cost ledger on 1 November 2026, stored as decision-reference-v2-cost-per-1000, which supersedes its earlier “cost not consolidated” note. Older 1,342-only scores are not converted into this bank. Not ranked here. Checked / reported: 2026-11-02 · Samples: 43 Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
System 1 Decision Benchmark v2 · F21 · Directed reachability	93.023%	Setup & source Directed reachability: 43 questions. Turion Jev 31B; Hosted native; returned identities {"turion-jev-31b": 1934}; collected 2026-10-29 to 2026-10-31 America/Toronto; one primary response per input, no scored retries. Exact aggregate from the release statistics. Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. The source published a separate cost ledger on 1 November 2026, stored as decision-reference-v2-cost-per-1000, which supersedes its earlier “cost not consolidated” note. Older 1,342-only scores are not converted into this bank. Not ranked here. Checked / reported: 2026-11-02 · Samples: 43 Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
System 1 Decision Benchmark v2 · F22 · Preference ordering	90.196%	Setup & source Preference ordering: 51 questions. Turion Jev 31B; Hosted native; returned identities {"turion-jev-31b": 1934}; collected 2026-10-29 to 2026-10-31 America/Toronto; one primary response per input, no scored retries. Exact aggregate from the release statistics. Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. The source published a separate cost ledger on 1 November 2026, stored as decision-reference-v2-cost-per-1000, which supersedes its earlier “cost not consolidated” note. Older 1,342-only scores are not converted into this bank. Not ranked here. Checked / reported: 2026-11-02 · Samples: 51 Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
System 1 Decision Benchmark v2 · F23 · Rule counterexamples	98.077%	Setup & source Rule counterexamples: 52 questions. Turion Jev 31B; Hosted native; returned identities {"turion-jev-31b": 1934}; collected 2026-10-29 to 2026-10-31 America/Toronto; one primary response per input, no scored retries. Exact aggregate from the release statistics. Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. The source published a separate cost ledger on 1 November 2026, stored as decision-reference-v2-cost-per-1000, which supersedes its earlier “cost not consolidated” note. Older 1,342-only scores are not converted into this bank. Not ranked here. Checked / reported: 2026-11-02 · Samples: 52 Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
System 1 Decision Benchmark v2 · F24 · Authority and stale records	97.674%	Setup & source Authority and stale records: 43 questions. Turion Jev 31B; Hosted native; returned identities {"turion-jev-31b": 1934}; collected 2026-10-29 to 2026-10-31 America/Toronto; one primary response per input, no scored retries. Exact aggregate from the release statistics. Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. The source published a separate cost ledger on 1 November 2026, stored as decision-reference-v2-cost-per-1000, which supersedes its earlier “cost not consolidated” note. Older 1,342-only scores are not converted into this bank. Not ranked here. Checked / reported: 2026-11-02 · Samples: 43 Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
System 1 Decision Benchmark v2 · F25 · Fault diagnosis	90.000%	Setup & source Fault diagnosis: 50 questions. Turion Jev 31B; Hosted native; returned identities {"turion-jev-31b": 1934}; collected 2026-10-29 to 2026-10-31 America/Toronto; one primary response per input, no scored retries. Exact aggregate from the release statistics. Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. The source published a separate cost ledger on 1 November 2026, stored as decision-reference-v2-cost-per-1000, which supersedes its earlier “cost not consolidated” note. Older 1,342-only scores are not converted into this bank. Not ranked here. Checked / reported: 2026-11-02 · Samples: 50 Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
System 1 Decision Benchmark v2 · F26 · Probabilistic risk	72.500%	Setup & source Probabilistic risk: 40 questions. Turion Jev 31B; Hosted native; returned identities {"turion-jev-31b": 1934}; collected 2026-10-29 to 2026-10-31 America/Toronto; one primary response per input, no scored retries. Exact aggregate from the release statistics. Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. The source published a separate cost ledger on 1 November 2026, stored as decision-reference-v2-cost-per-1000, which supersedes its earlier “cost not consolidated” note. Older 1,342-only scores are not converted into this bank. Not ranked here. Checked / reported: 2026-11-02 · Samples: 40 Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
System 1 Decision Benchmark v2 · F27 · Value of information	65.000%	Setup & source Value of information: 40 questions. Turion Jev 31B; Hosted native; returned identities {"turion-jev-31b": 1934}; collected 2026-10-29 to 2026-10-31 America/Toronto; one primary response per input, no scored retries. Exact aggregate from the release statistics. Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. The source published a separate cost ledger on 1 November 2026, stored as decision-reference-v2-cost-per-1000, which supersedes its earlier “cost not consolidated” note. Older 1,342-only scores are not converted into this bank. Not ranked here. Checked / reported: 2026-11-02 · Samples: 40 Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
System 1 Decision Benchmark v2 · F28 · Robust decisions without a prior	35.000%	Setup & source Robust decisions without a prior: 40 questions. Turion Jev 31B; Hosted native; returned identities {"turion-jev-31b": 1934}; collected 2026-10-29 to 2026-10-31 America/Toronto; one primary response per input, no scored retries. Exact aggregate from the release statistics. Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. The source published a separate cost ledger on 1 November 2026, stored as decision-reference-v2-cost-per-1000, which supersedes its earlier “cost not consolidated” note. Older 1,342-only scores are not converted into this bank. Not ranked here. Checked / reported: 2026-11-02 · Samples: 40 Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
System 1 Decision Benchmark v2 · F29 · Strategic decisions	50.000%	Setup & source Strategic decisions: 40 questions. Turion Jev 31B; Hosted native; returned identities {"turion-jev-31b": 1934}; collected 2026-10-29 to 2026-10-31 America/Toronto; one primary response per input, no scored retries. Exact aggregate from the release statistics. Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. The source published a separate cost ledger on 1 November 2026, stored as decision-reference-v2-cost-per-1000, which supersedes its earlier “cost not consolidated” note. Older 1,342-only scores are not converted into this bank. Not ranked here. Checked / reported: 2026-11-02 · Samples: 40 Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
System 1 Decision Benchmark v2 · F30 · Concurrent-history consistency	57.500%	Setup & source Concurrent-history consistency: 40 questions. Turion Jev 31B; Hosted native; returned identities {"turion-jev-31b": 1934}; collected 2026-10-29 to 2026-10-31 America/Toronto; one primary response per input, no scored retries. Exact aggregate from the release statistics. Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. The source published a separate cost ledger on 1 November 2026, stored as decision-reference-v2-cost-per-1000, which supersedes its earlier “cost not consolidated” note. Older 1,342-only scores are not converted into this bank. Not ranked here. Checked / reported: 2026-11-02 · Samples: 40 Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
System 1 Decision Benchmark v2 · F31 · Information-flow security	82.500%	Setup & source Information-flow security: 40 questions. Turion Jev 31B; Hosted native; returned identities {"turion-jev-31b": 1934}; collected 2026-10-29 to 2026-10-31 America/Toronto; one primary response per input, no scored retries. Exact aggregate from the release statistics. Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. The source published a separate cost ledger on 1 November 2026, stored as decision-reference-v2-cost-per-1000, which supersedes its earlier “cost not consolidated” note. Older 1,342-only scores are not converted into this bank. Not ranked here. Checked / reported: 2026-11-02 · Samples: 40 Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
System 1 Decision Benchmark v2 · P01 · Understanding requests and routing	85.000%	Setup & source Understanding requests and routing: 40 questions. Turion Jev 31B; Hosted native; returned identities {"turion-jev-31b": 1934}; collected 2026-10-29 to 2026-10-31 America/Toronto; one primary response per input, no scored retries. Exact aggregate from the release statistics. Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. The source published a separate cost ledger on 1 November 2026, stored as decision-reference-v2-cost-per-1000, which supersedes its earlier “cost not consolidated” note. Older 1,342-only scores are not converted into this bank. Not ranked here. Checked / reported: 2026-11-02 · Samples: 40 Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
System 1 Decision Benchmark v2 · P02 · Recognizing multiple requested actions	90.000%	Setup & source Recognizing multiple requested actions: 40 questions. Turion Jev 31B; Hosted native; returned identities {"turion-jev-31b": 1934}; collected 2026-10-29 to 2026-10-31 America/Toronto; one primary response per input, no scored retries. Exact aggregate from the release statistics. Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. The source published a separate cost ledger on 1 November 2026, stored as decision-reference-v2-cost-per-1000, which supersedes its earlier “cost not consolidated” note. Older 1,342-only scores are not converted into this bank. Not ranked here. Checked / reported: 2026-11-02 · Samples: 40 Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
System 1 Decision Benchmark v2 · P03 · Tracking current conversational intention	97.500%	Setup & source Tracking current conversational intention: 40 questions. Turion Jev 31B; Hosted native; returned identities {"turion-jev-31b": 1934}; collected 2026-10-29 to 2026-10-31 America/Toronto; one primary response per input, no scored retries. Exact aggregate from the release statistics. Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. The source published a separate cost ledger on 1 November 2026, stored as decision-reference-v2-cost-per-1000, which supersedes its earlier “cost not consolidated” note. Older 1,342-only scores are not converted into this bank. Not ranked here. Checked / reported: 2026-11-02 · Samples: 40 Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
System 1 Decision Benchmark v2 · P04 · Selecting a tool or requesting clarification	52.500%	Setup & source Selecting a tool or requesting clarification: 40 questions. Turion Jev 31B; Hosted native; returned identities {"turion-jev-31b": 1934}; collected 2026-10-29 to 2026-10-31 America/Toronto; one primary response per input, no scored retries. Exact aggregate from the release statistics. Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. The source published a separate cost ledger on 1 November 2026, stored as decision-reference-v2-cost-per-1000, which supersedes its earlier “cost not consolidated” note. Older 1,342-only scores are not converted into this bank. Not ranked here. Checked / reported: 2026-11-02 · Samples: 40 Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
System 1 Decision Benchmark v2 · P05 · Checking authorization and scope	62.500%	Setup & source Checking authorization and scope: 40 questions. Turion Jev 31B; Hosted native; returned identities {"turion-jev-31b": 1934}; collected 2026-10-29 to 2026-10-31 America/Toronto; one primary response per input, no scored retries. Exact aggregate from the release statistics. Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. The source published a separate cost ledger on 1 November 2026, stored as decision-reference-v2-cost-per-1000, which supersedes its earlier “cost not consolidated” note. Older 1,342-only scores are not converted into this bank. Not ranked here. Checked / reported: 2026-11-02 · Samples: 40 Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
System 1 Decision Benchmark v2 · P06 · Making decisions with untrusted content	97.500%	Setup & source Making decisions with untrusted content: 40 questions. Turion Jev 31B; Hosted native; returned identities {"turion-jev-31b": 1934}; collected 2026-10-29 to 2026-10-31 America/Toronto; one primary response per input, no scored retries. Exact aggregate from the release statistics. Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. The source published a separate cost ledger on 1 November 2026, stored as decision-reference-v2-cost-per-1000, which supersedes its earlier “cost not consolidated” note. Older 1,342-only scores are not converted into this bank. Not ranked here. Checked / reported: 2026-11-02 · Samples: 40 Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
System 1 Decision Benchmark v2 · P07 · Applying a contextual content policy	77.500%	Setup & source Applying a contextual content policy: 40 questions. Turion Jev 31B; Hosted native; returned identities {"turion-jev-31b": 1934}; collected 2026-10-29 to 2026-10-31 America/Toronto; one primary response per input, no scored retries. Exact aggregate from the release statistics. Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. The source published a separate cost ledger on 1 November 2026, stored as decision-reference-v2-cost-per-1000, which supersedes its earlier “cost not consolidated” note. Older 1,342-only scores are not converted into this bank. Not ranked here. Checked / reported: 2026-11-02 · Samples: 40 Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
System 1 Decision Benchmark v2 · P08 · Extracting and normalizing facts	52.500%	Setup & source Extracting and normalizing facts: 40 questions. Turion Jev 31B; Hosted native; returned identities {"turion-jev-31b": 1934}; collected 2026-10-29 to 2026-10-31 America/Toronto; one primary response per input, no scored retries. Exact aggregate from the release statistics. Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. The source published a separate cost ledger on 1 November 2026, stored as decision-reference-v2-cost-per-1000, which supersedes its earlier “cost not consolidated” note. Older 1,342-only scores are not converted into this bank. Not ranked here. Checked / reported: 2026-11-02 · Samples: 40 Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
System 1 Decision Benchmark v2 · P09 · Checking claims against supplied evidence	70.000%	Setup & source Checking claims against supplied evidence: 40 questions. Turion Jev 31B; Hosted native; returned identities {"turion-jev-31b": 1934}; collected 2026-10-29 to 2026-10-31 America/Toronto; one primary response per input, no scored retries. Exact aggregate from the release statistics. Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. The source published a separate cost ledger on 1 November 2026, stored as decision-reference-v2-cost-per-1000, which supersedes its earlier “cost not consolidated” note. Older 1,342-only scores are not converted into this bank. Not ranked here. Checked / reported: 2026-11-02 · Samples: 40 Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
System 1 Decision Benchmark v2 · P10 · Assigning severity or priority from a rubric	75.000%	Setup & source Assigning severity or priority from a rubric: 40 questions. Turion Jev 31B; Hosted native; returned identities {"turion-jev-31b": 1934}; collected 2026-10-29 to 2026-10-31 America/Toronto; one primary response per input, no scored retries. Exact aggregate from the release statistics. Development benchmark, not an independently sampled test: 1,934 questions in 41 categories, the frozen 1,342-question bank plus 192 logical and 400 practical additions. The bank was built with model-guided development, and Jev plus retained Microsoft and Drex feedback are development exposure. Related variants and a single recorded primary response per input limit generalization. The scoring key stays private, so public checks cover coverage, timing and aggregate consistency but cannot rescore answers. Strict accuracy counts a wrong usable answer and an unsuccessful response in the same fixed denominator. Timing pools primary client times with the network included; providers, precision, concurrency, routes and dates differ, retained and new timings can span sessions, and quick failures can reduce all-primary latency. The source published a separate cost ledger on 1 November 2026, stored as decision-reference-v2-cost-per-1000, which supersedes its earlier “cost not consolidated” note. Older 1,342-only scores are not converted into this bank. Not ranked here. Checked / reported: 2026-11-02 · Samples: 40 Snapshot: 2026-11-01 · Revision: f5fa9cfafccd97fcfbdb0336e14284faaa8d2d35 · Published summary observations; upstream task/result terms retained Result source · Benchmark source

Evaluator-published · Benchmark Heaven

Turion Jev 31B · Evaluator-published · Benchmark Heaven
Evaluation	Result	Evidence
Benchmark Heaven JevBench v1.8 · Capability Score	80.879	Setup & source Capability Score on the rendered board. Turion Jev 31B · Open weights · LLM decoder. Board key turion-jev-31b; method tag v1.7. Measured on the Second regular draw (v1.7.1), 2026-10-24; put on the v1.6.1 scale by the draw's anchor offset (see How it works). Source link https://huggingface.co/turion-ai/turion-jev-31b. Rendered board row. Benchmark Heaven's rendered board, read 2 November 2026: 283 ranked systems · 1,500 decisions each (600 for 19 equated API re-runs) · 131 newer ranked rows tagged with their draw · 14 older rows dated separately. Newer rows are measured on dated draws and put on the v1.6.1 scale by the draw's anchor offset, so a row's draw is part of its identity. Distinct from Leanmcp JevBench, the community Decision Index and the stored Benchmark Heaven v1.6.1 feed. Cost is the source's model on a GPU-time basis for self-hosted rows, not a provider tariff. Self-hosted latency is timed on the GPU over loopback and API latency end to end with the network; the source says they are not directly comparable, so they stay in separate datasets. No Examenos recomputation. Checked / reported: 2026-11-02 · Evaluated: 2026-10-24 · Samples: Not published Snapshot: 2026-10-31 · Revision: Board v1.7.48, method v1.8, updated 2026-10-31; page sha256 df9093384c9cdf5854e065f71dd3abd83a127793f22f4ca70268e9981e0a0b17 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
Benchmark Heaven JevBench v1.8 · Intelligence	70.9	Setup & source Intelligence on the rendered board. Turion Jev 31B · Open weights · LLM decoder. Board key turion-jev-31b; method tag v1.7. Measured on the Second regular draw (v1.7.1), 2026-10-24; put on the v1.6.1 scale by the draw's anchor offset (see How it works). Source link https://huggingface.co/turion-ai/turion-jev-31b. Rendered board row. Benchmark Heaven's rendered board, read 2 November 2026: 283 ranked systems · 1,500 decisions each (600 for 19 equated API re-runs) · 131 newer ranked rows tagged with their draw · 14 older rows dated separately. Newer rows are measured on dated draws and put on the v1.6.1 scale by the draw's anchor offset, so a row's draw is part of its identity. Distinct from Leanmcp JevBench, the community Decision Index and the stored Benchmark Heaven v1.6.1 feed. Cost is the source's model on a GPU-time basis for self-hosted rows, not a provider tariff. Self-hosted latency is timed on the GPU over loopback and API latency end to end with the network; the source says they are not directly comparable, so they stay in separate datasets. No Examenos recomputation. Checked / reported: 2026-11-02 · Evaluated: 2026-10-24 · Samples: Not published Snapshot: 2026-10-31 · Revision: Board v1.7.48, method v1.8, updated 2026-10-31; page sha256 df9093384c9cdf5854e065f71dd3abd83a127793f22f4ca70268e9981e0a0b17 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
Benchmark Heaven JevBench v1.8 · Calibration	90.9	Setup & source Calibration on the rendered board. Turion Jev 31B · Open weights · LLM decoder. Board key turion-jev-31b; method tag v1.7. Measured on the Second regular draw (v1.7.1), 2026-10-24; put on the v1.6.1 scale by the draw's anchor offset (see How it works). Source link https://huggingface.co/turion-ai/turion-jev-31b. Rendered board row. Benchmark Heaven's rendered board, read 2 November 2026: 283 ranked systems · 1,500 decisions each (600 for 19 equated API re-runs) · 131 newer ranked rows tagged with their draw · 14 older rows dated separately. Newer rows are measured on dated draws and put on the v1.6.1 scale by the draw's anchor offset, so a row's draw is part of its identity. Distinct from Leanmcp JevBench, the community Decision Index and the stored Benchmark Heaven v1.6.1 feed. Cost is the source's model on a GPU-time basis for self-hosted rows, not a provider tariff. Self-hosted latency is timed on the GPU over loopback and API latency end to end with the network; the source says they are not directly comparable, so they stay in separate datasets. No Examenos recomputation. Checked / reported: 2026-11-02 · Evaluated: 2026-10-24 · Samples: Not published Snapshot: 2026-10-31 · Revision: Board v1.7.48, method v1.8, updated 2026-10-31; page sha256 df9093384c9cdf5854e065f71dd3abd83a127793f22f4ca70268e9981e0a0b17 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
Benchmark Heaven JevBench v1.8 · Cost Score	46.6	Setup & source Cost Score on the rendered board. Turion Jev 31B · Open weights · LLM decoder. Board key turion-jev-31b; method tag v1.7. Measured on the Second regular draw (v1.7.1), 2026-10-24; put on the v1.6.1 scale by the draw's anchor offset (see How it works). Source link https://huggingface.co/turion-ai/turion-jev-31b. Rendered board row. Benchmark Heaven's rendered board, read 2 November 2026: 283 ranked systems · 1,500 decisions each (600 for 19 equated API re-runs) · 131 newer ranked rows tagged with their draw · 14 older rows dated separately. Newer rows are measured on dated draws and put on the v1.6.1 scale by the draw's anchor offset, so a row's draw is part of its identity. Distinct from Leanmcp JevBench, the community Decision Index and the stored Benchmark Heaven v1.6.1 feed. Cost is the source's model on a GPU-time basis for self-hosted rows, not a provider tariff. Self-hosted latency is timed on the GPU over loopback and API latency end to end with the network; the source says they are not directly comparable, so they stay in separate datasets. No Examenos recomputation. Checked / reported: 2026-11-02 · Evaluated: 2026-10-24 · Samples: Not published Snapshot: 2026-10-31 · Revision: Board v1.7.48, method v1.8, updated 2026-10-31; page sha256 df9093384c9cdf5854e065f71dd3abd83a127793f22f4ca70268e9981e0a0b17 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
Benchmark Heaven JevBench v1.8 · Modelled cost per 1,000 decisions	0.06032 USD/1k decisions	Setup & source Modelled cost per 1,000 decisions on the rendered board. Turion Jev 31B · Open weights · LLM decoder. Board key turion-jev-31b; method tag v1.7. Measured on the Second regular draw (v1.7.1), 2026-10-24; put on the v1.6.1 scale by the draw's anchor offset (see How it works). Source link https://huggingface.co/turion-ai/turion-jev-31b. Rendered board row. Benchmark Heaven's rendered board, read 2 November 2026: 283 ranked systems · 1,500 decisions each (600 for 19 equated API re-runs) · 131 newer ranked rows tagged with their draw · 14 older rows dated separately. Newer rows are measured on dated draws and put on the v1.6.1 scale by the draw's anchor offset, so a row's draw is part of its identity. Distinct from Leanmcp JevBench, the community Decision Index and the stored Benchmark Heaven v1.6.1 feed. Cost is the source's model on a GPU-time basis for self-hosted rows, not a provider tariff. Self-hosted latency is timed on the GPU over loopback and API latency end to end with the network; the source says they are not directly comparable, so they stay in separate datasets. No Examenos recomputation. Checked / reported: 2026-11-02 · Evaluated: 2026-10-24 · Samples: Not published Snapshot: 2026-10-31 · Revision: Board v1.7.48, method v1.8, updated 2026-10-31; page sha256 df9093384c9cdf5854e065f71dd3abd83a127793f22f4ca70268e9981e0a0b17 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
Benchmark Heaven JevBench v1.8 · Self-hosted p50 on the GPU, loopback	0.124 s	Setup & source Self-hosted p50 on the GPU, loopback on the rendered board. Turion Jev 31B · Open weights · LLM decoder. Board key turion-jev-31b; method tag v1.7. Measured on the Second regular draw (v1.7.1), 2026-10-24; put on the v1.6.1 scale by the draw's anchor offset (see How it works). Source link https://huggingface.co/turion-ai/turion-jev-31b. Rendered board row. Benchmark Heaven's rendered board, read 2 November 2026: 283 ranked systems · 1,500 decisions each (600 for 19 equated API re-runs) · 131 newer ranked rows tagged with their draw · 14 older rows dated separately. Newer rows are measured on dated draws and put on the v1.6.1 scale by the draw's anchor offset, so a row's draw is part of its identity. Distinct from Leanmcp JevBench, the community Decision Index and the stored Benchmark Heaven v1.6.1 feed. Cost is the source's model on a GPU-time basis for self-hosted rows, not a provider tariff. Self-hosted latency is timed on the GPU over loopback and API latency end to end with the network; the source says they are not directly comparable, so they stay in separate datasets. No Examenos recomputation. Checked / reported: 2026-11-02 · Evaluated: 2026-10-24 · Samples: Not published Snapshot: 2026-10-31 · Revision: Board v1.7.48, method v1.8, updated 2026-10-31; page sha256 df9093384c9cdf5854e065f71dd3abd83a127793f22f4ca70268e9981e0a0b17 · Published summary observations; upstream task/result terms retained Result source · Benchmark source
Benchmark Heaven JevBench v1.8 · Self-hosted estimate including network (2x + 150 ms)	0.40 s	Setup & source Self-hosted estimate including network (2x + 150 ms) on the rendered board. Turion Jev 31B · Open weights · LLM decoder. Board key turion-jev-31b; method tag v1.7. Measured on the Second regular draw (v1.7.1), 2026-10-24; put on the v1.6.1 scale by the draw's anchor offset (see How it works). Source link https://huggingface.co/turion-ai/turion-jev-31b. Rendered board row. Benchmark Heaven's rendered board, read 2 November 2026: 283 ranked systems · 1,500 decisions each (600 for 19 equated API re-runs) · 131 newer ranked rows tagged with their draw · 14 older rows dated separately. Newer rows are measured on dated draws and put on the v1.6.1 scale by the draw's anchor offset, so a row's draw is part of its identity. Distinct from Leanmcp JevBench, the community Decision Index and the stored Benchmark Heaven v1.6.1 feed. Cost is the source's model on a GPU-time basis for self-hosted rows, not a provider tariff. Self-hosted latency is timed on the GPU over loopback and API latency end to end with the network; the source says they are not directly comparable, so they stay in separate datasets. No Examenos recomputation. Checked / reported: 2026-11-02 · Evaluated: 2026-10-24 · Samples: Not published Snapshot: 2026-10-31 · Revision: Board v1.7.48, method v1.8, updated 2026-10-31; page sha256 df9093384c9cdf5854e065f71dd3abd83a127793f22f4ca70268e9981e0a0b17 · Published summary observations; upstream task/result terms retained Result source · Benchmark source

Turion Jev 31B · Evaluator-published · Community Decision Index
Evaluation	Result	Evidence
HF text 0.4.1 · Full score	70.47	Setup & source HF text 0.4.1 · Full score Exact source engine turion-jev-31b; {"kind": "LoRA", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 31273086512, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/turion-ai/turion-jev-31b", "code_url": null, "base_model": "google/gemma-4-31B-it", "base_url": "https://huggingface.co/google/gemma-4-31B-it", "weights_repo": null, "served_checkpoint": null, "org": {"id": "turion-ai", "name": "Turion.AI", "logo": "data/orgs/turion-ai.png"}, "pr": 286, "new": true}. New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. The board does not name a served checkpoint in this repository history. Community Decision Index 0.4.1: expanded/refreshed harder private new-domain tasks and equating; Full remains 60% private same-skill +40% private new domains, zero public contribution. This population revision is not a model upgrade/regression. Public/native/calibration data remain on their unchanged 0.4 definitions. Source publication/generation is not a model run date. Public submitted runs plus evaluator private measurements are Evaluator-published, not wholly independently executed. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-22T05:40:06Z · Revision: d9962113a1acc95c2d7522c2babfb989afbeb034; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source
HF text 0.4 · Public index	66.16	Setup & source HF text 0.4 · Public index Exact source engine turion-jev-31b; {"kind": "LoRA", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 31273086512, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/turion-ai/turion-jev-31b", "code_url": null, "base_model": "google/gemma-4-31B-it", "base_url": "https://huggingface.co/google/gemma-4-31B-it", "weights_repo": null, "served_checkpoint": null, "org": {"id": "turion-ai", "name": "Turion.AI", "logo": "data/orgs/turion-ai.png"}, "pr": 286, "new": true}. New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. The board does not name a served checkpoint in this repository history. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source
HF text 0.4 · Private same-skill component	65.34	Setup & source HF text 0.4 · Private same-skill component Exact source engine turion-jev-31b; {"kind": "LoRA", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 31273086512, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/turion-ai/turion-jev-31b", "code_url": null, "base_model": "google/gemma-4-31B-it", "base_url": "https://huggingface.co/google/gemma-4-31B-it", "weights_repo": null, "served_checkpoint": null, "org": {"id": "turion-ai", "name": "Turion.AI", "logo": "data/orgs/turion-ai.png"}, "pr": 286, "new": true}. New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. The board does not name a served checkpoint in this repository history. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source
HF text 0.4.1 · Private new-domain component	61.50	Setup & source HF text 0.4.1 · Private new-domain component Exact source engine turion-jev-31b; {"kind": "LoRA", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 31273086512, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/turion-ai/turion-jev-31b", "code_url": null, "base_model": "google/gemma-4-31B-it", "base_url": "https://huggingface.co/google/gemma-4-31B-it", "weights_repo": null, "served_checkpoint": null, "org": {"id": "turion-ai", "name": "Turion.AI", "logo": "data/orgs/turion-ai.png"}, "pr": 286, "new": true}. New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. The board does not name a served checkpoint in this repository history. Community Decision Index 0.4.1: expanded/refreshed harder private new-domain tasks and equating; Full remains 60% private same-skill +40% private new domains, zero public contribution. This population revision is not a model upgrade/regression. Public/native/calibration data remain on their unchanged 0.4 definitions. Source publication/generation is not a model run date. Public submitted runs plus evaluator private measurements are Evaluator-published, not wholly independently executed. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-22T05:40:06Z · Revision: d9962113a1acc95c2d7522c2babfb989afbeb034; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source
HF text 0.4 · Raw public index	73.96	Setup & source HF text 0.4 · Raw public index Exact source engine turion-jev-31b; {"kind": "LoRA", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 31273086512, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/turion-ai/turion-jev-31b", "code_url": null, "base_model": "google/gemma-4-31B-it", "base_url": "https://huggingface.co/google/gemma-4-31B-it", "weights_repo": null, "served_checkpoint": null, "org": {"id": "turion-ai", "name": "Turion.AI", "logo": "data/orgs/turion-ai.png"}, "pr": 286, "new": true}. New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. The board does not name a served checkpoint in this repository history. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source
HF text 0.4 · Public breadth index	65.56	Setup & source HF text 0.4 · Public breadth index Exact source engine turion-jev-31b; {"kind": "LoRA", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 31273086512, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/turion-ai/turion-jev-31b", "code_url": null, "base_model": "google/gemma-4-31B-it", "base_url": "https://huggingface.co/google/gemma-4-31B-it", "weights_repo": null, "served_checkpoint": null, "org": {"id": "turion-ai", "name": "Turion.AI", "logo": "data/orgs/turion-ai.png"}, "pr": 286, "new": true}. New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. The board does not name a served checkpoint in this repository history. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source
HF text 0.4 · Equated private same-skill	65.04	Setup & source HF text 0.4 · Equated private same-skill Exact source engine turion-jev-31b; {"kind": "LoRA", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 31273086512, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/turion-ai/turion-jev-31b", "code_url": null, "base_model": "google/gemma-4-31B-it", "base_url": "https://huggingface.co/google/gemma-4-31B-it", "weights_repo": null, "served_checkpoint": null, "org": {"id": "turion-ai", "name": "Turion.AI", "logo": "data/orgs/turion-ai.png"}, "pr": 286, "new": true}. New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. The board does not name a served checkpoint in this repository history. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source
HF text 0.4.1 · Equated private new domains	78.60	Setup & source HF text 0.4.1 · Equated private new domains Exact source engine turion-jev-31b; {"kind": "LoRA", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 31273086512, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/turion-ai/turion-jev-31b", "code_url": null, "base_model": "google/gemma-4-31B-it", "base_url": "https://huggingface.co/google/gemma-4-31B-it", "weights_repo": null, "served_checkpoint": null, "org": {"id": "turion-ai", "name": "Turion.AI", "logo": "data/orgs/turion-ai.png"}, "pr": 286, "new": true}. New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. The board does not name a served checkpoint in this repository history. Community Decision Index 0.4.1: expanded/refreshed harder private new-domain tasks and equating; Full remains 60% private same-skill +40% private new domains, zero public contribution. This population revision is not a model upgrade/regression. Public/native/calibration data remain on their unchanged 0.4 definitions. Source publication/generation is not a model run date. Public submitted runs plus evaluator private measurements are Evaluator-published, not wholly independently executed. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-22T05:40:06Z · Revision: d9962113a1acc95c2d7522c2babfb989afbeb034; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source
HF text 0.4 · Full contribution · public	0.00	Setup & source HF text 0.4 · Full contribution · public Exact source engine turion-jev-31b; {"kind": "LoRA", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 31273086512, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/turion-ai/turion-jev-31b", "code_url": null, "base_model": "google/gemma-4-31B-it", "base_url": "https://huggingface.co/google/gemma-4-31B-it", "weights_repo": null, "served_checkpoint": null, "org": {"id": "turion-ai", "name": "Turion.AI", "logo": "data/orgs/turion-ai.png"}, "pr": 286, "new": true}. New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published weighted contribution; not a distinct benchmark execution. The board does not name a served checkpoint in this repository history. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source
HF text 0.4 · Full contribution · same_skills	39.02	Setup & source HF text 0.4 · Full contribution · same_skills Exact source engine turion-jev-31b; {"kind": "LoRA", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 31273086512, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/turion-ai/turion-jev-31b", "code_url": null, "base_model": "google/gemma-4-31B-it", "base_url": "https://huggingface.co/google/gemma-4-31B-it", "weights_repo": null, "served_checkpoint": null, "org": {"id": "turion-ai", "name": "Turion.AI", "logo": "data/orgs/turion-ai.png"}, "pr": 286, "new": true}. New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published weighted contribution; not a distinct benchmark execution. The board does not name a served checkpoint in this repository history. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source
HF text 0.4.1 · Full contribution · new_domains	31.44	Setup & source HF text 0.4.1 · Full contribution · new_domains Exact source engine turion-jev-31b; {"kind": "LoRA", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 31273086512, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/turion-ai/turion-jev-31b", "code_url": null, "base_model": "google/gemma-4-31B-it", "base_url": "https://huggingface.co/google/gemma-4-31B-it", "weights_repo": null, "served_checkpoint": null, "org": {"id": "turion-ai", "name": "Turion.AI", "logo": "data/orgs/turion-ai.png"}, "pr": 286, "new": true}. New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published weighted contribution; not a distinct benchmark execution. The board does not name a served checkpoint in this repository history. Community Decision Index 0.4.1: expanded/refreshed harder private new-domain tasks and equating; Full remains 60% private same-skill +40% private new domains, zero public contribution. This population revision is not a model upgrade/regression. Public/native/calibration data remain on their unchanged 0.4 definitions. Source publication/generation is not a model run date. Public submitted runs plus evaluator private measurements are Evaluator-published, not wholly independently executed. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-22T05:40:06Z · Revision: d9962113a1acc95c2d7522c2babfb989afbeb034; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source
HF text 0.4 · Knowledge · raw	64.32	Setup & source HF text 0.4 · Knowledge · raw Exact source engine turion-jev-31b; {"kind": "LoRA", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 31273086512, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/turion-ai/turion-jev-31b", "code_url": null, "base_model": "google/gemma-4-31B-it", "base_url": "https://huggingface.co/google/gemma-4-31B-it", "weights_repo": null, "served_checkpoint": null, "org": {"id": "turion-ai", "name": "Turion.AI", "logo": "data/orgs/turion-ai.png"}, "pr": 286, "new": true}. New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Count is contributing benchmarks, not requests. Source area context: {"id": "knowledge", "raw": 0.6432, "skill": 0.5542, "combined": 0.5247, "coverage": 1, "pending": 0, "n": 11} The board does not name a served checkpoint in this repository history. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 11 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source
HF text 0.4 · Knowledge · skill	55.42	Setup & source HF text 0.4 · Knowledge · skill Exact source engine turion-jev-31b; {"kind": "LoRA", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 31273086512, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/turion-ai/turion-jev-31b", "code_url": null, "base_model": "google/gemma-4-31B-it", "base_url": "https://huggingface.co/google/gemma-4-31B-it", "weights_repo": null, "served_checkpoint": null, "org": {"id": "turion-ai", "name": "Turion.AI", "logo": "data/orgs/turion-ai.png"}, "pr": 286, "new": true}. New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Count is contributing benchmarks, not requests. Source area context: {"id": "knowledge", "raw": 0.6432, "skill": 0.5542, "combined": 0.5247, "coverage": 1, "pending": 0, "n": 11} The board does not name a served checkpoint in this repository history. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 11 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source
HF text 0.4 · Knowledge · combined	52.47	Setup & source HF text 0.4 · Knowledge · combined Exact source engine turion-jev-31b; {"kind": "LoRA", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 31273086512, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/turion-ai/turion-jev-31b", "code_url": null, "base_model": "google/gemma-4-31B-it", "base_url": "https://huggingface.co/google/gemma-4-31B-it", "weights_repo": null, "served_checkpoint": null, "org": {"id": "turion-ai", "name": "Turion.AI", "logo": "data/orgs/turion-ai.png"}, "pr": 286, "new": true}. New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Count is contributing benchmarks, not requests. Source area context: {"id": "knowledge", "raw": 0.6432, "skill": 0.5542, "combined": 0.5247, "coverage": 1, "pending": 0, "n": 11} The board does not name a served checkpoint in this repository history. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 11 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source
HF text 0.4 · Language · raw	78.71	Setup & source HF text 0.4 · Language · raw Exact source engine turion-jev-31b; {"kind": "LoRA", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 31273086512, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/turion-ai/turion-jev-31b", "code_url": null, "base_model": "google/gemma-4-31B-it", "base_url": "https://huggingface.co/google/gemma-4-31B-it", "weights_repo": null, "served_checkpoint": null, "org": {"id": "turion-ai", "name": "Turion.AI", "logo": "data/orgs/turion-ai.png"}, "pr": 286, "new": true}. New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Count is contributing benchmarks, not requests. Source area context: {"id": "language", "raw": 0.7871, "skill": 0.6991, "combined": 0.6526, "coverage": 1, "pending": 0, "n": 9} The board does not name a served checkpoint in this repository history. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 9 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source
HF text 0.4 · Language · skill	69.91	Setup & source HF text 0.4 · Language · skill Exact source engine turion-jev-31b; {"kind": "LoRA", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 31273086512, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/turion-ai/turion-jev-31b", "code_url": null, "base_model": "google/gemma-4-31B-it", "base_url": "https://huggingface.co/google/gemma-4-31B-it", "weights_repo": null, "served_checkpoint": null, "org": {"id": "turion-ai", "name": "Turion.AI", "logo": "data/orgs/turion-ai.png"}, "pr": 286, "new": true}. New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Count is contributing benchmarks, not requests. Source area context: {"id": "language", "raw": 0.7871, "skill": 0.6991, "combined": 0.6526, "coverage": 1, "pending": 0, "n": 9} The board does not name a served checkpoint in this repository history. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 9 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source
HF text 0.4 · Language · combined	65.26	Setup & source HF text 0.4 · Language · combined Exact source engine turion-jev-31b; {"kind": "LoRA", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 31273086512, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/turion-ai/turion-jev-31b", "code_url": null, "base_model": "google/gemma-4-31B-it", "base_url": "https://huggingface.co/google/gemma-4-31B-it", "weights_repo": null, "served_checkpoint": null, "org": {"id": "turion-ai", "name": "Turion.AI", "logo": "data/orgs/turion-ai.png"}, "pr": 286, "new": true}. New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Count is contributing benchmarks, not requests. Source area context: {"id": "language", "raw": 0.7871, "skill": 0.6991, "combined": 0.6526, "coverage": 1, "pending": 0, "n": 9} The board does not name a served checkpoint in this repository history. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 9 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source
HF text 0.4 · Retrieval · raw	77.37	Setup & source HF text 0.4 · Retrieval · raw Exact source engine turion-jev-31b; {"kind": "LoRA", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 31273086512, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/turion-ai/turion-jev-31b", "code_url": null, "base_model": "google/gemma-4-31B-it", "base_url": "https://huggingface.co/google/gemma-4-31B-it", "weights_repo": null, "served_checkpoint": null, "org": {"id": "turion-ai", "name": "Turion.AI", "logo": "data/orgs/turion-ai.png"}, "pr": 286, "new": true}. New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Count is contributing benchmarks, not requests. Source area context: {"id": "retrieval", "raw": 0.7737, "skill": 0.7117, "combined": 0.7158, "coverage": 1, "pending": 0, "n": 6} The board does not name a served checkpoint in this repository history. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 6 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source
HF text 0.4 · Retrieval · skill	71.17	Setup & source HF text 0.4 · Retrieval · skill Exact source engine turion-jev-31b; {"kind": "LoRA", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 31273086512, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/turion-ai/turion-jev-31b", "code_url": null, "base_model": "google/gemma-4-31B-it", "base_url": "https://huggingface.co/google/gemma-4-31B-it", "weights_repo": null, "served_checkpoint": null, "org": {"id": "turion-ai", "name": "Turion.AI", "logo": "data/orgs/turion-ai.png"}, "pr": 286, "new": true}. New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Count is contributing benchmarks, not requests. Source area context: {"id": "retrieval", "raw": 0.7737, "skill": 0.7117, "combined": 0.7158, "coverage": 1, "pending": 0, "n": 6} The board does not name a served checkpoint in this repository history. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 6 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source
HF text 0.4 · Retrieval · combined	71.58	Setup & source HF text 0.4 · Retrieval · combined Exact source engine turion-jev-31b; {"kind": "LoRA", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 31273086512, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/turion-ai/turion-jev-31b", "code_url": null, "base_model": "google/gemma-4-31B-it", "base_url": "https://huggingface.co/google/gemma-4-31B-it", "weights_repo": null, "served_checkpoint": null, "org": {"id": "turion-ai", "name": "Turion.AI", "logo": "data/orgs/turion-ai.png"}, "pr": 286, "new": true}. New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Count is contributing benchmarks, not requests. Source area context: {"id": "retrieval", "raw": 0.7737, "skill": 0.7117, "combined": 0.7158, "coverage": 1, "pending": 0, "n": 6} The board does not name a served checkpoint in this repository history. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 6 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source
HF text 0.4 · Tools · raw	80.89	Setup & source HF text 0.4 · Tools · raw Exact source engine turion-jev-31b; {"kind": "LoRA", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 31273086512, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/turion-ai/turion-jev-31b", "code_url": null, "base_model": "google/gemma-4-31B-it", "base_url": "https://huggingface.co/google/gemma-4-31B-it", "weights_repo": null, "served_checkpoint": null, "org": {"id": "turion-ai", "name": "Turion.AI", "logo": "data/orgs/turion-ai.png"}, "pr": 286, "new": true}. New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Count is contributing benchmarks, not requests. Source area context: {"id": "tools", "raw": 0.8089, "skill": 0.7868, "combined": 0.7773, "coverage": 1, "pending": 0, "n": 5} The board does not name a served checkpoint in this repository history. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 5 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source
HF text 0.4 · Tools · skill	78.68	Setup & source HF text 0.4 · Tools · skill Exact source engine turion-jev-31b; {"kind": "LoRA", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 31273086512, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/turion-ai/turion-jev-31b", "code_url": null, "base_model": "google/gemma-4-31B-it", "base_url": "https://huggingface.co/google/gemma-4-31B-it", "weights_repo": null, "served_checkpoint": null, "org": {"id": "turion-ai", "name": "Turion.AI", "logo": "data/orgs/turion-ai.png"}, "pr": 286, "new": true}. New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Count is contributing benchmarks, not requests. Source area context: {"id": "tools", "raw": 0.8089, "skill": 0.7868, "combined": 0.7773, "coverage": 1, "pending": 0, "n": 5} The board does not name a served checkpoint in this repository history. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 5 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source
HF text 0.4 · Tools · combined	77.73	Setup & source HF text 0.4 · Tools · combined Exact source engine turion-jev-31b; {"kind": "LoRA", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 31273086512, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/turion-ai/turion-jev-31b", "code_url": null, "base_model": "google/gemma-4-31B-it", "base_url": "https://huggingface.co/google/gemma-4-31B-it", "weights_repo": null, "served_checkpoint": null, "org": {"id": "turion-ai", "name": "Turion.AI", "logo": "data/orgs/turion-ai.png"}, "pr": 286, "new": true}. New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Count is contributing benchmarks, not requests. Source area context: {"id": "tools", "raw": 0.8089, "skill": 0.7868, "combined": 0.7773, "coverage": 1, "pending": 0, "n": 5} The board does not name a served checkpoint in this repository history. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 5 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source
HF text 0.4 · Arts · raw	67.13	Setup & source HF text 0.4 · Arts · raw Exact source engine turion-jev-31b; {"kind": "LoRA", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 31273086512, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/turion-ai/turion-jev-31b", "code_url": null, "base_model": "google/gemma-4-31B-it", "base_url": "https://huggingface.co/google/gemma-4-31B-it", "weights_repo": null, "served_checkpoint": null, "org": {"id": "turion-ai", "name": "Turion.AI", "logo": "data/orgs/turion-ai.png"}, "pr": 286, "new": true}. New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Count is contributing benchmarks, not requests. Source area context: {"id": "arts", "raw": 0.6713, "skill": 0.5126, "combined": 0.56, "coverage": 1, "pending": 0, "n": 6} The board does not name a served checkpoint in this repository history. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 6 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source
HF text 0.4 · Arts · skill	51.26	Setup & source HF text 0.4 · Arts · skill Exact source engine turion-jev-31b; {"kind": "LoRA", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 31273086512, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/turion-ai/turion-jev-31b", "code_url": null, "base_model": "google/gemma-4-31B-it", "base_url": "https://huggingface.co/google/gemma-4-31B-it", "weights_repo": null, "served_checkpoint": null, "org": {"id": "turion-ai", "name": "Turion.AI", "logo": "data/orgs/turion-ai.png"}, "pr": 286, "new": true}. New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Count is contributing benchmarks, not requests. Source area context: {"id": "arts", "raw": 0.6713, "skill": 0.5126, "combined": 0.56, "coverage": 1, "pending": 0, "n": 6} The board does not name a served checkpoint in this repository history. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 6 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source
HF text 0.4 · Arts · combined	56.00	Setup & source HF text 0.4 · Arts · combined Exact source engine turion-jev-31b; {"kind": "LoRA", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 31273086512, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/turion-ai/turion-jev-31b", "code_url": null, "base_model": "google/gemma-4-31B-it", "base_url": "https://huggingface.co/google/gemma-4-31B-it", "weights_repo": null, "served_checkpoint": null, "org": {"id": "turion-ai", "name": "Turion.AI", "logo": "data/orgs/turion-ai.png"}, "pr": 286, "new": true}. New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Count is contributing benchmarks, not requests. Source area context: {"id": "arts", "raw": 0.6713, "skill": 0.5126, "combined": 0.56, "coverage": 1, "pending": 0, "n": 6} The board does not name a served checkpoint in this repository history. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 6 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source
HF text calibration 0.4 · ECE	1.93 pp	Setup & source HF text calibration 0.4 · ECE Exact source engine turion-jev-31b; {"kind": "LoRA", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 31273086512, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/turion-ai/turion-jev-31b", "code_url": null, "base_model": "google/gemma-4-31B-it", "base_url": "https://huggingface.co/google/gemma-4-31B-it", "weights_repo": null, "served_checkpoint": null, "org": {"id": "turion-ai", "name": "Turion.AI", "logo": "data/orgs/turion-ai.png"}, "pr": 286, "new": true}. New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. 32 benchmarks with a per-field right or wrong answer (ToolRet, BRIGHT and RouterBench excluded), each weighted equally; a 1-in-6 sample of requests; confidence is the probability placed on the chosen option. Rows an entrant trained on count as wrong here too. Contributing benchmarks 31. The board does not name a served checkpoint in this repository history. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 34411 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source
HF text calibration 0.4 · Brier	0.3077 Brier	Setup & source HF text calibration 0.4 · Brier Exact source engine turion-jev-31b; {"kind": "LoRA", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 31273086512, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/turion-ai/turion-jev-31b", "code_url": null, "base_model": "google/gemma-4-31B-it", "base_url": "https://huggingface.co/google/gemma-4-31B-it", "weights_repo": null, "served_checkpoint": null, "org": {"id": "turion-ai", "name": "Turion.AI", "logo": "data/orgs/turion-ai.png"}, "pr": 286, "new": true}. New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. 32 benchmarks with a per-field right or wrong answer (ToolRet, BRIGHT and RouterBench excluded), each weighted equally; a 1-in-6 sample of requests; confidence is the probability placed on the chosen option. Rows an entrant trained on count as wrong here too. Contributing benchmarks 31. The board does not name a served checkpoint in this repository history. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 34411 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source
HF text calibration 0.4 · Sample accuracy	76.84%	Setup & source HF text calibration 0.4 · Sample accuracy Exact source engine turion-jev-31b; {"kind": "LoRA", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 31273086512, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/turion-ai/turion-jev-31b", "code_url": null, "base_model": "google/gemma-4-31B-it", "base_url": "https://huggingface.co/google/gemma-4-31B-it", "weights_repo": null, "served_checkpoint": null, "org": {"id": "turion-ai", "name": "Turion.AI", "logo": "data/orgs/turion-ai.png"}, "pr": 286, "new": true}. New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. 32 benchmarks with a per-field right or wrong answer (ToolRet, BRIGHT and RouterBench excluded), each weighted equally; a 1-in-6 sample of requests; confidence is the probability placed on the chosen option. Rows an entrant trained on count as wrong here too. Contributing benchmarks 31. The board does not name a served checkpoint in this repository history. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 34411 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source
HF text calibration 0.4 · Mean chosen confidence	76.74%	Setup & source HF text calibration 0.4 · Mean chosen confidence Exact source engine turion-jev-31b; {"kind": "LoRA", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 31273086512, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/turion-ai/turion-jev-31b", "code_url": null, "base_model": "google/gemma-4-31B-it", "base_url": "https://huggingface.co/google/gemma-4-31B-it", "weights_repo": null, "served_checkpoint": null, "org": {"id": "turion-ai", "name": "Turion.AI", "logo": "data/orgs/turion-ai.png"}, "pr": 286, "new": true}. New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. 32 benchmarks with a per-field right or wrong answer (ToolRet, BRIGHT and RouterBench excluded), each weighted equally; a 1-in-6 sample of requests; confidence is the probability placed on the chosen option. Rows an entrant trained on count as wrong here too. Contributing benchmarks 31. The board does not name a served checkpoint in this repository history. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 34411 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source
HF text calibration 0.4 · Wrong among answers at ≥95% confidence	0.64%	Setup & source HF text calibration 0.4 · Wrong among answers at ≥95% confidence Exact source engine turion-jev-31b; {"kind": "LoRA", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 31273086512, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/turion-ai/turion-jev-31b", "code_url": null, "base_model": "google/gemma-4-31B-it", "base_url": "https://huggingface.co/google/gemma-4-31B-it", "weights_repo": null, "served_checkpoint": null, "org": {"id": "turion-ai", "name": "Turion.AI", "logo": "data/orgs/turion-ai.png"}, "pr": 286, "new": true}. New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. 32 benchmarks with a per-field right or wrong answer (ToolRet, BRIGHT and RouterBench excluded), each weighted equally; a 1-in-6 sample of requests; confidence is the probability placed on the chosen option. Rows an entrant trained on count as wrong here too. Contributing benchmarks 31. The board does not name a served checkpoint in this repository history. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 34411 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source
HF text calibration 0.4 · Knowledge · ECE	2.86 pp	Setup & source HF text calibration 0.4 · Knowledge · ECE Exact source engine turion-jev-31b; {"kind": "LoRA", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 31273086512, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/turion-ai/turion-jev-31b", "code_url": null, "base_model": "google/gemma-4-31B-it", "base_url": "https://huggingface.co/google/gemma-4-31B-it", "weights_repo": null, "served_checkpoint": null, "org": {"id": "turion-ai", "name": "Turion.AI", "logo": "data/orgs/turion-ai.png"}, "pr": 286, "new": true}. New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Area-specific item counts unpublished; do not use whole-sample count. The board does not name a served checkpoint in this repository history. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source
HF text calibration 0.4 · Knowledge · Sample accuracy	71.66%	Setup & source HF text calibration 0.4 · Knowledge · Sample accuracy Exact source engine turion-jev-31b; {"kind": "LoRA", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 31273086512, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/turion-ai/turion-jev-31b", "code_url": null, "base_model": "google/gemma-4-31B-it", "base_url": "https://huggingface.co/google/gemma-4-31B-it", "weights_repo": null, "served_checkpoint": null, "org": {"id": "turion-ai", "name": "Turion.AI", "logo": "data/orgs/turion-ai.png"}, "pr": 286, "new": true}. New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Area-specific item counts unpublished; do not use whole-sample count. The board does not name a served checkpoint in this repository history. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source
HF text calibration 0.4 · Knowledge · Mean chosen confidence	73.17%	Setup & source HF text calibration 0.4 · Knowledge · Mean chosen confidence Exact source engine turion-jev-31b; {"kind": "LoRA", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 31273086512, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/turion-ai/turion-jev-31b", "code_url": null, "base_model": "google/gemma-4-31B-it", "base_url": "https://huggingface.co/google/gemma-4-31B-it", "weights_repo": null, "served_checkpoint": null, "org": {"id": "turion-ai", "name": "Turion.AI", "logo": "data/orgs/turion-ai.png"}, "pr": 286, "new": true}. New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Area-specific item counts unpublished; do not use whole-sample count. The board does not name a served checkpoint in this repository history. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source
HF text calibration 0.4 · Language · ECE	5.44 pp	Setup & source HF text calibration 0.4 · Language · ECE Exact source engine turion-jev-31b; {"kind": "LoRA", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 31273086512, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/turion-ai/turion-jev-31b", "code_url": null, "base_model": "google/gemma-4-31B-it", "base_url": "https://huggingface.co/google/gemma-4-31B-it", "weights_repo": null, "served_checkpoint": null, "org": {"id": "turion-ai", "name": "Turion.AI", "logo": "data/orgs/turion-ai.png"}, "pr": 286, "new": true}. New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Area-specific item counts unpublished; do not use whole-sample count. The board does not name a served checkpoint in this repository history. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source
HF text calibration 0.4 · Language · Sample accuracy	88.96%	Setup & source HF text calibration 0.4 · Language · Sample accuracy Exact source engine turion-jev-31b; {"kind": "LoRA", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 31273086512, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/turion-ai/turion-jev-31b", "code_url": null, "base_model": "google/gemma-4-31B-it", "base_url": "https://huggingface.co/google/gemma-4-31B-it", "weights_repo": null, "served_checkpoint": null, "org": {"id": "turion-ai", "name": "Turion.AI", "logo": "data/orgs/turion-ai.png"}, "pr": 286, "new": true}. New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Area-specific item counts unpublished; do not use whole-sample count. The board does not name a served checkpoint in this repository history. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source
HF text calibration 0.4 · Language · Mean chosen confidence	83.52%	Setup & source HF text calibration 0.4 · Language · Mean chosen confidence Exact source engine turion-jev-31b; {"kind": "LoRA", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 31273086512, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/turion-ai/turion-jev-31b", "code_url": null, "base_model": "google/gemma-4-31B-it", "base_url": "https://huggingface.co/google/gemma-4-31B-it", "weights_repo": null, "served_checkpoint": null, "org": {"id": "turion-ai", "name": "Turion.AI", "logo": "data/orgs/turion-ai.png"}, "pr": 286, "new": true}. New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Area-specific item counts unpublished; do not use whole-sample count. The board does not name a served checkpoint in this repository history. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source
HF text calibration 0.4 · Retrieval · ECE	15.43 pp	Setup & source HF text calibration 0.4 · Retrieval · ECE Exact source engine turion-jev-31b; {"kind": "LoRA", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 31273086512, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/turion-ai/turion-jev-31b", "code_url": null, "base_model": "google/gemma-4-31B-it", "base_url": "https://huggingface.co/google/gemma-4-31B-it", "weights_repo": null, "served_checkpoint": null, "org": {"id": "turion-ai", "name": "Turion.AI", "logo": "data/orgs/turion-ai.png"}, "pr": 286, "new": true}. New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Area-specific item counts unpublished; do not use whole-sample count. The board does not name a served checkpoint in this repository history. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source
HF text calibration 0.4 · Retrieval · Sample accuracy	64.72%	Setup & source HF text calibration 0.4 · Retrieval · Sample accuracy Exact source engine turion-jev-31b; {"kind": "LoRA", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 31273086512, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/turion-ai/turion-jev-31b", "code_url": null, "base_model": "google/gemma-4-31B-it", "base_url": "https://huggingface.co/google/gemma-4-31B-it", "weights_repo": null, "served_checkpoint": null, "org": {"id": "turion-ai", "name": "Turion.AI", "logo": "data/orgs/turion-ai.png"}, "pr": 286, "new": true}. New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Area-specific item counts unpublished; do not use whole-sample count. The board does not name a served checkpoint in this repository history. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source
HF text calibration 0.4 · Retrieval · Mean chosen confidence	79.12%	Setup & source HF text calibration 0.4 · Retrieval · Mean chosen confidence Exact source engine turion-jev-31b; {"kind": "LoRA", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 31273086512, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/turion-ai/turion-jev-31b", "code_url": null, "base_model": "google/gemma-4-31B-it", "base_url": "https://huggingface.co/google/gemma-4-31B-it", "weights_repo": null, "served_checkpoint": null, "org": {"id": "turion-ai", "name": "Turion.AI", "logo": "data/orgs/turion-ai.png"}, "pr": 286, "new": true}. New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-27 PR batch (PR #286). Submitted public 0.3 run adopted (kit rescore 66.16, equal to the claim). Private tests run by the lab on one RTX PRO 6000 with the author's serving (FP8 at load); decision agreement with the submitted rows 98.59% on 829 rows (bar 96%). Served in FP8 at load as in the submitted run, so the quantized agreement bar applies. Training includes a distillation corpus of TypeSafe Jev teacher distributions and synthetic labels (author-declared). Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Area-specific item counts unpublished; do not use whole-sample count. The board does not name a served checkpoint in this repository history. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source