GLiDE v1.2
Explore GLiDE v1.2: exact decision configuration, published specifications, source-linked benchmarks and API tariffs when available.
← All decision models · Compare this decision system →
Published API tariff
Fastino · checked 2026-11-02
Fastino docs: $0.04 input and $0 output for fastino/GLiDE.
No output-token charge does not mean free requests. These are provider tariffs, separate from benchmark workload costs.
374 recorded observations. Published results retain their source and setup; no Examenos evaluation was run. Missing results are not zero. How to read these comparisons →
Official / vendor · Fastino GLiDE v1.2 post (vendor measured)
| Evaluation | Result | Evidence |
|---|---|---|
| Fastino · Decision Index public suite, own complete run | 71.5 | Setup & sourceFastino run of the official harness on the current public suite. GLiDE v1.2, own complete run of the official harness. Printed in the vendor's own table. Fastino's own complete runs of the official harness and its own held-out panels, not a leaderboard result. Jev comparison columns name Jev 1.13, which is unregistered, so they are not stored. Not ranked here. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-22 · Revision: Read 2026-11-02 · Published observations; result reuse terms not specified Result source · Benchmark source |
| Fastino · Decision Index 0.2.1 edition, own run | 71.12 | Setup & sourceThe edition of the launch post: 64.81 for the September checkpoint, and 71.12 for v1.2 on what Fastino calls the same edition. Own runs with the official scorer; Fastino prints v1.1 at 65.12, which is unregistered. Printed in the vendor's own table. Fastino's own complete runs of the official harness and its own held-out panels, not a leaderboard result. Jev comparison columns name Jev 1.13, which is unregistered, so they are not stored. Not ranked here. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-22 · Revision: Read 2026-11-02 · Published observations; result reuse terms not specified Result source · Benchmark source |
| Fastino held-out panels · All eight panels · accuracy | 83.0% | Setup & sourceAll eight panels: 4,482 held-out items. One forward pass, no temperature tuning. Printed in the vendor's own table. Fastino's own complete runs of the official harness and its own held-out panels, not a leaderboard result. Jev comparison columns name Jev 1.13, which is unregistered, so they are not stored. Not ranked here. Checked / reported: 2026-11-02 · Samples: 4482 Snapshot: 2026-10-22 · Revision: Read 2026-11-02 · Published observations; result reuse terms not specified Result source · Benchmark source |
| Fastino held-out panels · All eight panels · calibration error | 1.9 pp | Setup & sourceAll eight panels: 4,482 held-out items; lower is better. One forward pass, no temperature tuning. Printed in the vendor's own table. Fastino's own complete runs of the official harness and its own held-out panels, not a leaderboard result. Jev comparison columns name Jev 1.13, which is unregistered, so they are not stored. Not ranked here. Checked / reported: 2026-11-02 · Samples: 4482 Snapshot: 2026-10-22 · Revision: Read 2026-11-02 · Published observations; result reuse terms not specified Result source · Benchmark source |
| Fastino held-out panels · Same-skill decisions · accuracy | 90.2% | Setup & sourceSame-skill decisions: 1,282 held-out items. One forward pass, no temperature tuning. Printed in the vendor's own table. Fastino's own complete runs of the official harness and its own held-out panels, not a leaderboard result. Jev comparison columns name Jev 1.13, which is unregistered, so they are not stored. Not ranked here. Checked / reported: 2026-11-02 · Samples: 1282 Snapshot: 2026-10-22 · Revision: Read 2026-11-02 · Published observations; result reuse terms not specified Result source · Benchmark source |
| Fastino held-out panels · Same-skill decisions · calibration error | 2.4 pp | Setup & sourceSame-skill decisions: 1,282 held-out items; lower is better. One forward pass, no temperature tuning. Printed in the vendor's own table. Fastino's own complete runs of the official harness and its own held-out panels, not a leaderboard result. Jev comparison columns name Jev 1.13, which is unregistered, so they are not stored. Not ranked here. Checked / reported: 2026-11-02 · Samples: 1282 Snapshot: 2026-10-22 · Revision: Read 2026-11-02 · Published observations; result reuse terms not specified Result source · Benchmark source |
| Fastino held-out panels · Independent new-domain decisions · accuracy | 94.0% | Setup & sourceIndependent new-domain decisions: 554 held-out items. One forward pass, no temperature tuning. Printed in the vendor's own table. Fastino's own complete runs of the official harness and its own held-out panels, not a leaderboard result. Jev comparison columns name Jev 1.13, which is unregistered, so they are not stored. Not ranked here. Checked / reported: 2026-11-02 · Samples: 554 Snapshot: 2026-10-22 · Revision: Read 2026-11-02 · Published observations; result reuse terms not specified Result source · Benchmark source |
| Fastino held-out panels · Independent new-domain decisions · calibration error | 2.6 pp | Setup & sourceIndependent new-domain decisions: 554 held-out items; lower is better. One forward pass, no temperature tuning. Printed in the vendor's own table. Fastino's own complete runs of the official harness and its own held-out panels, not a leaderboard result. Jev comparison columns name Jev 1.13, which is unregistered, so they are not stored. Not ranked here. Checked / reported: 2026-11-02 · Samples: 554 Snapshot: 2026-10-22 · Revision: Read 2026-11-02 · Published observations; result reuse terms not specified Result source · Benchmark source |
| Fastino held-out panels · Tool-call decisions · accuracy | 98.3% | Setup & sourceTool-call decisions: 300 held-out items. One forward pass, no temperature tuning. Printed in the vendor's own table. Fastino's own complete runs of the official harness and its own held-out panels, not a leaderboard result. Jev comparison columns name Jev 1.13, which is unregistered, so they are not stored. Not ranked here. Checked / reported: 2026-11-02 · Samples: 300 Snapshot: 2026-10-22 · Revision: Read 2026-11-02 · Published observations; result reuse terms not specified Result source · Benchmark source |
| Fastino held-out panels · Tool-call decisions · calibration error | 1.8 pp | Setup & sourceTool-call decisions: 300 held-out items; lower is better. One forward pass, no temperature tuning. Printed in the vendor's own table. Fastino's own complete runs of the official harness and its own held-out panels, not a leaderboard result. Jev comparison columns name Jev 1.13, which is unregistered, so they are not stored. Not ranked here. Checked / reported: 2026-11-02 · Samples: 300 Snapshot: 2026-10-22 · Revision: Read 2026-11-02 · Published observations; result reuse terms not specified Result source · Benchmark source |
| Fastino held-out panels · Safety classification · accuracy | 90.7% | Setup & sourceSafety classification: 300 held-out items. One forward pass, no temperature tuning. Printed in the vendor's own table. Fastino's own complete runs of the official harness and its own held-out panels, not a leaderboard result. Jev comparison columns name Jev 1.13, which is unregistered, so they are not stored. Not ranked here. Checked / reported: 2026-11-02 · Samples: 300 Snapshot: 2026-10-22 · Revision: Read 2026-11-02 · Published observations; result reuse terms not specified Result source · Benchmark source |
| Fastino held-out panels · Safety classification · calibration error | 5.0 pp | Setup & sourceSafety classification: 300 held-out items; lower is better. One forward pass, no temperature tuning. Printed in the vendor's own table. Fastino's own complete runs of the official harness and its own held-out panels, not a leaderboard result. Jev comparison columns name Jev 1.13, which is unregistered, so they are not stored. Not ranked here. Checked / reported: 2026-11-02 · Samples: 300 Snapshot: 2026-10-22 · Revision: Read 2026-11-02 · Published observations; result reuse terms not specified Result source · Benchmark source |
| Fastino held-out panels · Expert multiple choice · accuracy | 61.2% | Setup & sourceExpert multiple choice: 577 held-out items. One forward pass, no temperature tuning. Printed in the vendor's own table. Fastino's own complete runs of the official harness and its own held-out panels, not a leaderboard result. Jev comparison columns name Jev 1.13, which is unregistered, so they are not stored. Not ranked here. Checked / reported: 2026-11-02 · Samples: 577 Snapshot: 2026-10-22 · Revision: Read 2026-11-02 · Published observations; result reuse terms not specified Result source · Benchmark source |
| Fastino held-out panels · Expert multiple choice · calibration error | 6.9 pp | Setup & sourceExpert multiple choice: 577 held-out items; lower is better. One forward pass, no temperature tuning. Printed in the vendor's own table. Fastino's own complete runs of the official harness and its own held-out panels, not a leaderboard result. Jev comparison columns name Jev 1.13, which is unregistered, so they are not stored. Not ranked here. Checked / reported: 2026-11-02 · Samples: 577 Snapshot: 2026-10-22 · Revision: Read 2026-11-02 · Published observations; result reuse terms not specified Result source · Benchmark source |
| Fastino · Median latency | 82 ms | Setup & sourceOne forward pass per question. One RTX PRO 6000, 52 GB of GPU memory. Printed in the vendor's own table. Fastino's own complete runs of the official harness and its own held-out panels, not a leaderboard result. Jev comparison columns name Jev 1.13, which is unregistered, so they are not stored. Not ranked here. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-22 · Revision: Read 2026-11-02 · Published observations; result reuse terms not specified Result source · Benchmark source |
| Fastino · P80 latency | 245 ms | Setup & sourceOne forward pass per question. One RTX PRO 6000, 52 GB of GPU memory. Printed in the vendor's own table. Fastino's own complete runs of the official harness and its own held-out panels, not a leaderboard result. Jev comparison columns name Jev 1.13, which is unregistered, so they are not stored. Not ranked here. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-22 · Revision: Read 2026-11-02 · Published observations; result reuse terms not specified Result source · Benchmark source |
| Fastino · Median latency with images | 93 ms | Setup & sourceA full request with images. One RTX PRO 6000, 52 GB of GPU memory. Printed in the vendor's own table. Fastino's own complete runs of the official harness and its own held-out panels, not a leaderboard result. Jev comparison columns name Jev 1.13, which is unregistered, so they are not stored. Not ranked here. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-22 · Revision: Read 2026-11-02 · Published observations; result reuse terms not specified Result source · Benchmark source |
Evaluator-published · Community Decision Index
| Evaluation | Result | Evidence |
|---|---|---|
| HF text 0.4.1 · Full score | 71.52 | Setup & sourceHF text 0.4.1 · Full score Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Community Decision Index 0.4.1: expanded/refreshed harder private new-domain tasks and equating; Full remains 60% private same-skill +40% private new domains, zero public contribution. This population revision is not a model upgrade/regression. Public/native/calibration data remain on their unchanged 0.4 definitions. Source publication/generation is not a model run date. Public submitted runs plus evaluator private measurements are Evaluator-published, not wholly independently executed. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-22T05:40:06Z · Revision: d9962113a1acc95c2d7522c2babfb989afbeb034; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · Public index | 71.99 | Setup & sourceHF text 0.4 · Public index Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · Private same-skill component | 68.57 | Setup & sourceHF text 0.4 · Private same-skill component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4.1 · Private new-domain component | 59.66 | Setup & sourceHF text 0.4.1 · Private new-domain component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Community Decision Index 0.4.1: expanded/refreshed harder private new-domain tasks and equating; Full remains 60% private same-skill +40% private new domains, zero public contribution. This population revision is not a model upgrade/regression. Public/native/calibration data remain on their unchanged 0.4 definitions. Source publication/generation is not a model run date. Public submitted runs plus evaluator private measurements are Evaluator-published, not wholly independently executed. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-22T05:40:06Z · Revision: d9962113a1acc95c2d7522c2babfb989afbeb034; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · Raw public index | 78.89 | Setup & sourceHF text 0.4 · Raw public index Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · Public breadth index | 71.44 | Setup & sourceHF text 0.4 · Public breadth index Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · Equated private same-skill | 68.31 | Setup & sourceHF text 0.4 · Equated private same-skill Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4.1 · Equated private new domains | 76.32 | Setup & sourceHF text 0.4.1 · Equated private new domains Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Community Decision Index 0.4.1: expanded/refreshed harder private new-domain tasks and equating; Full remains 60% private same-skill +40% private new domains, zero public contribution. This population revision is not a model upgrade/regression. Public/native/calibration data remain on their unchanged 0.4 definitions. Source publication/generation is not a model run date. Public submitted runs plus evaluator private measurements are Evaluator-published, not wholly independently executed. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-22T05:40:06Z · Revision: d9962113a1acc95c2d7522c2babfb989afbeb034; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · Full contribution · public | 0.00 | Setup & sourceHF text 0.4 · Full contribution · public Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published weighted contribution; not a distinct benchmark execution. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · Full contribution · same_skills | 40.99 | Setup & sourceHF text 0.4 · Full contribution · same_skills Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published weighted contribution; not a distinct benchmark execution. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4.1 · Full contribution · new_domains | 30.53 | Setup & sourceHF text 0.4.1 · Full contribution · new_domains Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published weighted contribution; not a distinct benchmark execution. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Community Decision Index 0.4.1: expanded/refreshed harder private new-domain tasks and equating; Full remains 60% private same-skill +40% private new domains, zero public contribution. This population revision is not a model upgrade/regression. Public/native/calibration data remain on their unchanged 0.4 definitions. Source publication/generation is not a model run date. Public submitted runs plus evaluator private measurements are Evaluator-published, not wholly independently executed. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-22T05:40:06Z · Revision: d9962113a1acc95c2d7522c2babfb989afbeb034; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · Knowledge · raw | 68.16 | Setup & sourceHF text 0.4 · Knowledge · raw Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Count is contributing benchmarks, not requests. Source area context: {"id": "knowledge", "raw": 0.6816, "skill": 0.6059, "combined": 0.5727, "coverage": 1, "pending": 0, "n": 11} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 11 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · Knowledge · skill | 60.59 | Setup & sourceHF text 0.4 · Knowledge · skill Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Count is contributing benchmarks, not requests. Source area context: {"id": "knowledge", "raw": 0.6816, "skill": 0.6059, "combined": 0.5727, "coverage": 1, "pending": 0, "n": 11} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 11 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · Knowledge · combined | 57.27 | Setup & sourceHF text 0.4 · Knowledge · combined Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Count is contributing benchmarks, not requests. Source area context: {"id": "knowledge", "raw": 0.6816, "skill": 0.6059, "combined": 0.5727, "coverage": 1, "pending": 0, "n": 11} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 11 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · Language · raw | 82.85 | Setup & sourceHF text 0.4 · Language · raw Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Count is contributing benchmarks, not requests. Source area context: {"id": "language", "raw": 0.8285, "skill": 0.7549, "combined": 0.6564, "coverage": 1, "pending": 0, "n": 9} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 9 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · Language · skill | 75.49 | Setup & sourceHF text 0.4 · Language · skill Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Count is contributing benchmarks, not requests. Source area context: {"id": "language", "raw": 0.8285, "skill": 0.7549, "combined": 0.6564, "coverage": 1, "pending": 0, "n": 9} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 9 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · Language · combined | 65.64 | Setup & sourceHF text 0.4 · Language · combined Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Count is contributing benchmarks, not requests. Source area context: {"id": "language", "raw": 0.8285, "skill": 0.7549, "combined": 0.6564, "coverage": 1, "pending": 0, "n": 9} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 9 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · Retrieval · raw | 78.79 | Setup & sourceHF text 0.4 · Retrieval · raw Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Count is contributing benchmarks, not requests. Source area context: {"id": "retrieval", "raw": 0.7879, "skill": 0.7224, "combined": 0.7307, "coverage": 1, "pending": 0, "n": 6} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 6 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · Retrieval · skill | 72.24 | Setup & sourceHF text 0.4 · Retrieval · skill Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Count is contributing benchmarks, not requests. Source area context: {"id": "retrieval", "raw": 0.7879, "skill": 0.7224, "combined": 0.7307, "coverage": 1, "pending": 0, "n": 6} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 6 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · Retrieval · combined | 73.07 | Setup & sourceHF text 0.4 · Retrieval · combined Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Count is contributing benchmarks, not requests. Source area context: {"id": "retrieval", "raw": 0.7879, "skill": 0.7224, "combined": 0.7307, "coverage": 1, "pending": 0, "n": 6} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 6 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · Tools · raw | 89.64 | Setup & sourceHF text 0.4 · Tools · raw Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Count is contributing benchmarks, not requests. Source area context: {"id": "tools", "raw": 0.8964, "skill": 0.8804, "combined": 0.8491, "coverage": 1, "pending": 0, "n": 5} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 5 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · Tools · skill | 88.04 | Setup & sourceHF text 0.4 · Tools · skill Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Count is contributing benchmarks, not requests. Source area context: {"id": "tools", "raw": 0.8964, "skill": 0.8804, "combined": 0.8491, "coverage": 1, "pending": 0, "n": 5} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 5 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · Tools · combined | 84.91 | Setup & sourceHF text 0.4 · Tools · combined Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Count is contributing benchmarks, not requests. Source area context: {"id": "tools", "raw": 0.8964, "skill": 0.8804, "combined": 0.8491, "coverage": 1, "pending": 0, "n": 5} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 5 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · Arts · raw | 76.90 | Setup & sourceHF text 0.4 · Arts · raw Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Count is contributing benchmarks, not requests. Source area context: {"id": "arts", "raw": 0.769, "skill": 0.6259, "combined": 0.5867, "coverage": 1, "pending": 0, "n": 6} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 6 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · Arts · skill | 62.59 | Setup & sourceHF text 0.4 · Arts · skill Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Count is contributing benchmarks, not requests. Source area context: {"id": "arts", "raw": 0.769, "skill": 0.6259, "combined": 0.5867, "coverage": 1, "pending": 0, "n": 6} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 6 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · Arts · combined | 58.67 | Setup & sourceHF text 0.4 · Arts · combined Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Count is contributing benchmarks, not requests. Source area context: {"id": "arts", "raw": 0.769, "skill": 0.6259, "combined": 0.5867, "coverage": 1, "pending": 0, "n": 6} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 6 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text calibration 0.4 · ECE | 2.04 pp | Setup & sourceHF text calibration 0.4 · ECE Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. 32 benchmarks with a per-field right or wrong answer (ToolRet, BRIGHT and RouterBench excluded), each weighted equally; a 1-in-6 sample of requests; confidence is the probability placed on the chosen option. Rows an entrant trained on count as wrong here too. Contributing benchmarks 31. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 34411 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text calibration 0.4 · Brier | 0.2568 Brier | Setup & sourceHF text calibration 0.4 · Brier Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. 32 benchmarks with a per-field right or wrong answer (ToolRet, BRIGHT and RouterBench excluded), each weighted equally; a 1-in-6 sample of requests; confidence is the probability placed on the chosen option. Rows an entrant trained on count as wrong here too. Contributing benchmarks 31. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 34411 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text calibration 0.4 · Sample accuracy | 81.49% | Setup & sourceHF text calibration 0.4 · Sample accuracy Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. 32 benchmarks with a per-field right or wrong answer (ToolRet, BRIGHT and RouterBench excluded), each weighted equally; a 1-in-6 sample of requests; confidence is the probability placed on the chosen option. Rows an entrant trained on count as wrong here too. Contributing benchmarks 31. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 34411 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text calibration 0.4 · Mean chosen confidence | 82.62% | Setup & sourceHF text calibration 0.4 · Mean chosen confidence Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. 32 benchmarks with a per-field right or wrong answer (ToolRet, BRIGHT and RouterBench excluded), each weighted equally; a 1-in-6 sample of requests; confidence is the probability placed on the chosen option. Rows an entrant trained on count as wrong here too. Contributing benchmarks 31. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 34411 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text calibration 0.4 · Wrong among answers at ≥95% confidence | 0.72% | Setup & sourceHF text calibration 0.4 · Wrong among answers at ≥95% confidence Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. 32 benchmarks with a per-field right or wrong answer (ToolRet, BRIGHT and RouterBench excluded), each weighted equally; a 1-in-6 sample of requests; confidence is the probability placed on the chosen option. Rows an entrant trained on count as wrong here too. Contributing benchmarks 31. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 34411 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text calibration 0.4 · Knowledge · ECE | 7.53 pp | Setup & sourceHF text calibration 0.4 · Knowledge · ECE Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Area-specific item counts unpublished; do not use whole-sample count. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text calibration 0.4 · Knowledge · Sample accuracy | 72.87% | Setup & sourceHF text calibration 0.4 · Knowledge · Sample accuracy Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Area-specific item counts unpublished; do not use whole-sample count. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text calibration 0.4 · Knowledge · Mean chosen confidence | 77.53% | Setup & sourceHF text calibration 0.4 · Knowledge · Mean chosen confidence Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Area-specific item counts unpublished; do not use whole-sample count. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text calibration 0.4 · Language · ECE | 1.81 pp | Setup & sourceHF text calibration 0.4 · Language · ECE Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Area-specific item counts unpublished; do not use whole-sample count. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text calibration 0.4 · Language · Sample accuracy | 90.15% | Setup & sourceHF text calibration 0.4 · Language · Sample accuracy Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Area-specific item counts unpublished; do not use whole-sample count. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text calibration 0.4 · Language · Mean chosen confidence | 88.34% | Setup & sourceHF text calibration 0.4 · Language · Mean chosen confidence Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Area-specific item counts unpublished; do not use whole-sample count. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text calibration 0.4 · Retrieval · ECE | 3.48 pp | Setup & sourceHF text calibration 0.4 · Retrieval · ECE Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Area-specific item counts unpublished; do not use whole-sample count. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text calibration 0.4 · Retrieval · Sample accuracy | 81.63% | Setup & sourceHF text calibration 0.4 · Retrieval · Sample accuracy Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Area-specific item counts unpublished; do not use whole-sample count. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text calibration 0.4 · Retrieval · Mean chosen confidence | 83.58% | Setup & sourceHF text calibration 0.4 · Retrieval · Mean chosen confidence Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Area-specific item counts unpublished; do not use whole-sample count. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text calibration 0.4 · Tools · ECE | 3.88 pp | Setup & sourceHF text calibration 0.4 · Tools · ECE Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Area-specific item counts unpublished; do not use whole-sample count. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text calibration 0.4 · Tools · Sample accuracy | 94.74% | Setup & sourceHF text calibration 0.4 · Tools · Sample accuracy Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Area-specific item counts unpublished; do not use whole-sample count. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text calibration 0.4 · Tools · Mean chosen confidence | 98.60% | Setup & sourceHF text calibration 0.4 · Tools · Mean chosen confidence Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Area-specific item counts unpublished; do not use whole-sample count. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text calibration 0.4 · Arts · ECE | 4.15 pp | Setup & sourceHF text calibration 0.4 · Arts · ECE Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Area-specific item counts unpublished; do not use whole-sample count. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text calibration 0.4 · Arts · Sample accuracy | 75.10% | Setup & sourceHF text calibration 0.4 · Arts · Sample accuracy Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Area-specific item counts unpublished; do not use whole-sample count. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text calibration 0.4 · Arts · Mean chosen confidence | 72.16% | Setup & sourceHF text calibration 0.4 · Arts · Mean chosen confidence Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Area-specific item counts unpublished; do not use whole-sample count. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text calibration 0.4 · Confidence bin 0–0.1 · Sample weight | 0.90% | Setup & sourceHF text calibration 0.4 · Confidence bin 0–0.1 · Sample weight Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Reliability bin; source weighted fraction, not sample count. Lower boundary 0. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text calibration 0.4 · Confidence bin 0–0.1 · Mean confidence | 8.16% | Setup & sourceHF text calibration 0.4 · Confidence bin 0–0.1 · Mean confidence Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Reliability bin; source weighted fraction, not sample count. Lower boundary 0. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text calibration 0.4 · Confidence bin 0–0.1 · Sample accuracy | 11.35% | Setup & sourceHF text calibration 0.4 · Confidence bin 0–0.1 · Sample accuracy Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Reliability bin; source weighted fraction, not sample count. Lower boundary 0. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text calibration 0.4 · Confidence bin 0.1–0.2 · Sample weight | 1.87% | Setup & sourceHF text calibration 0.4 · Confidence bin 0.1–0.2 · Sample weight Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Reliability bin; source weighted fraction, not sample count. Lower boundary 0.1. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text calibration 0.4 · Confidence bin 0.1–0.2 · Mean confidence | 14.04% | Setup & sourceHF text calibration 0.4 · Confidence bin 0.1–0.2 · Mean confidence Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Reliability bin; source weighted fraction, not sample count. Lower boundary 0.1. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text calibration 0.4 · Confidence bin 0.1–0.2 · Sample accuracy | 22.70% | Setup & sourceHF text calibration 0.4 · Confidence bin 0.1–0.2 · Sample accuracy Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Reliability bin; source weighted fraction, not sample count. Lower boundary 0.1. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text calibration 0.4 · Confidence bin 0.2–0.3 · Sample weight | 0.66% | Setup & sourceHF text calibration 0.4 · Confidence bin 0.2–0.3 · Sample weight Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Reliability bin; source weighted fraction, not sample count. Lower boundary 0.2. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text calibration 0.4 · Confidence bin 0.2–0.3 · Mean confidence | 24.48% | Setup & sourceHF text calibration 0.4 · Confidence bin 0.2–0.3 · Mean confidence Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Reliability bin; source weighted fraction, not sample count. Lower boundary 0.2. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text calibration 0.4 · Confidence bin 0.2–0.3 · Sample accuracy | 36.39% | Setup & sourceHF text calibration 0.4 · Confidence bin 0.2–0.3 · Sample accuracy Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Reliability bin; source weighted fraction, not sample count. Lower boundary 0.2. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text calibration 0.4 · Confidence bin 0.3–0.4 · Sample weight | 2.31% | Setup & sourceHF text calibration 0.4 · Confidence bin 0.3–0.4 · Sample weight Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Reliability bin; source weighted fraction, not sample count. Lower boundary 0.3. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text calibration 0.4 · Confidence bin 0.3–0.4 · Mean confidence | 35.29% | Setup & sourceHF text calibration 0.4 · Confidence bin 0.3–0.4 · Mean confidence Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Reliability bin; source weighted fraction, not sample count. Lower boundary 0.3. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text calibration 0.4 · Confidence bin 0.3–0.4 · Sample accuracy | 43.47% | Setup & sourceHF text calibration 0.4 · Confidence bin 0.3–0.4 · Sample accuracy Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Reliability bin; source weighted fraction, not sample count. Lower boundary 0.3. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text calibration 0.4 · Confidence bin 0.4–0.5 · Sample weight | 3.47% | Setup & sourceHF text calibration 0.4 · Confidence bin 0.4–0.5 · Sample weight Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Reliability bin; source weighted fraction, not sample count. Lower boundary 0.4. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text calibration 0.4 · Confidence bin 0.4–0.5 · Mean confidence | 45.22% | Setup & sourceHF text calibration 0.4 · Confidence bin 0.4–0.5 · Mean confidence Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Reliability bin; source weighted fraction, not sample count. Lower boundary 0.4. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text calibration 0.4 · Confidence bin 0.4–0.5 · Sample accuracy | 42.16% | Setup & sourceHF text calibration 0.4 · Confidence bin 0.4–0.5 · Sample accuracy Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Reliability bin; source weighted fraction, not sample count. Lower boundary 0.4. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text calibration 0.4 · Confidence bin 0.5–0.6 · Sample weight | 7.89% | Setup & sourceHF text calibration 0.4 · Confidence bin 0.5–0.6 · Sample weight Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Reliability bin; source weighted fraction, not sample count. Lower boundary 0.5. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text calibration 0.4 · Confidence bin 0.5–0.6 · Mean confidence | 54.84% | Setup & sourceHF text calibration 0.4 · Confidence bin 0.5–0.6 · Mean confidence Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Reliability bin; source weighted fraction, not sample count. Lower boundary 0.5. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text calibration 0.4 · Confidence bin 0.5–0.6 · Sample accuracy | 51.37% | Setup & sourceHF text calibration 0.4 · Confidence bin 0.5–0.6 · Sample accuracy Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Reliability bin; source weighted fraction, not sample count. Lower boundary 0.5. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text calibration 0.4 · Confidence bin 0.6–0.7 · Sample weight | 6.84% | Setup & sourceHF text calibration 0.4 · Confidence bin 0.6–0.7 · Sample weight Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Reliability bin; source weighted fraction, not sample count. Lower boundary 0.6. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text calibration 0.4 · Confidence bin 0.6–0.7 · Mean confidence | 64.94% | Setup & sourceHF text calibration 0.4 · Confidence bin 0.6–0.7 · Mean confidence Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Reliability bin; source weighted fraction, not sample count. Lower boundary 0.6. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text calibration 0.4 · Confidence bin 0.6–0.7 · Sample accuracy | 62.23% | Setup & sourceHF text calibration 0.4 · Confidence bin 0.6–0.7 · Sample accuracy Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Reliability bin; source weighted fraction, not sample count. Lower boundary 0.6. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text calibration 0.4 · Confidence bin 0.7–0.8 · Sample weight | 8.16% | Setup & sourceHF text calibration 0.4 · Confidence bin 0.7–0.8 · Sample weight Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Reliability bin; source weighted fraction, not sample count. Lower boundary 0.7. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text calibration 0.4 · Confidence bin 0.7–0.8 · Mean confidence | 75.02% | Setup & sourceHF text calibration 0.4 · Confidence bin 0.7–0.8 · Mean confidence Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Reliability bin; source weighted fraction, not sample count. Lower boundary 0.7. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text calibration 0.4 · Confidence bin 0.7–0.8 · Sample accuracy | 66.83% | Setup & sourceHF text calibration 0.4 · Confidence bin 0.7–0.8 · Sample accuracy Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Reliability bin; source weighted fraction, not sample count. Lower boundary 0.7. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text calibration 0.4 · Confidence bin 0.8–0.9 · Sample weight | 11.89% | Setup & sourceHF text calibration 0.4 · Confidence bin 0.8–0.9 · Sample weight Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Reliability bin; source weighted fraction, not sample count. Lower boundary 0.8. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text calibration 0.4 · Confidence bin 0.8–0.9 · Mean confidence | 85.62% | Setup & sourceHF text calibration 0.4 · Confidence bin 0.8–0.9 · Mean confidence Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Reliability bin; source weighted fraction, not sample count. Lower boundary 0.8. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text calibration 0.4 · Confidence bin 0.8–0.9 · Sample accuracy | 83.80% | Setup & sourceHF text calibration 0.4 · Confidence bin 0.8–0.9 · Sample accuracy Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Reliability bin; source weighted fraction, not sample count. Lower boundary 0.8. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text calibration 0.4 · Confidence bin 0.9–1.0 · Sample weight | 56.00% | Setup & sourceHF text calibration 0.4 · Confidence bin 0.9–1.0 · Sample weight Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Reliability bin; source weighted fraction, not sample count. Lower boundary 0.9. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text calibration 0.4 · Confidence bin 0.9–1.0 · Mean confidence | 97.60% | Setup & sourceHF text calibration 0.4 · Confidence bin 0.9–1.0 · Mean confidence Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Reliability bin; source weighted fraction, not sample count. Lower boundary 0.9. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text calibration 0.4 · Confidence bin 0.9–1.0 · Sample accuracy | 97.36% | Setup & sourceHF text calibration 0.4 · Confidence bin 0.9–1.0 · Sample accuracy Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Reliability bin; source weighted fraction, not sample count. Lower boundary 0.9. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · Local median latency | 92.90 ms | Setup & sourceHF text 0.4 · Local median latency Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Latency is measured on its own, after scoring: every entrant runs the same 750 rows (stratified by benchmark and prompt length across the 0.2 scope, plus 10 untimed warm-up rows) as one process sending one request at a time on 1 x NVIDIA RTX PRO 6000, using the fastest inference path the model or its code supports. The figure is the wall time of one row, request in to all answers out, measured the same way for in-process and HTTP engines; board medians and p95s come from this run, not from the scoring runs. Entrant-specific serving/hardware caveats in configuration take precedence; HTTPS Jev is not isolated local inference. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · Local p95 latency | 1121.10 ms | Setup & sourceHF text 0.4 · Local p95 latency Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Latency is measured on its own, after scoring: every entrant runs the same 750 rows (stratified by benchmark and prompt length across the 0.2 scope, plus 10 untimed warm-up rows) as one process sending one request at a time on 1 x NVIDIA RTX PRO 6000, using the fastest inference path the model or its code supports. The figure is the wall time of one row, request in to all answers out, measured the same way for in-process and HTTP engines; board medians and p95s come from this run, not from the scoring runs. Entrant-specific serving/hardware caveats in configuration take precedence; HTTPS Jev is not isolated local inference. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · Local mean latency | 284.00 ms | Setup & sourceHF text 0.4 · Local mean latency Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Latency is measured on its own, after scoring: every entrant runs the same 750 rows (stratified by benchmark and prompt length across the 0.2 scope, plus 10 untimed warm-up rows) as one process sending one request at a time on 1 x NVIDIA RTX PRO 6000, using the fastest inference path the model or its code supports. The figure is the wall time of one row, request in to all answers out, measured the same way for in-process and HTTP engines; board medians and p95s come from this run, not from the scoring runs. Entrant-specific serving/hardware caveats in configuration take precedence; HTTPS Jev is not isolated local inference. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · BFCL · case exact accuracy | 97.34% | Setup & sourceHF text 0.4 · BFCL · case exact accuracy Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Native source result: {"score": 0.9734, "jev": null, "metric": "case exact accuracy", "requests": 1694, "answered": 1694, "unsupported": 0, "errors": 0, "median_ms": 308.2}. Benchmark contract: {"id": 1, "dataset": "BFCL", "short": "BFCL", "metric": "case exact accuracy", "explainer": "Says yes or no for each supplied function: call it for this request? All must be right.", "baseline": {"value": 0.2592, "label": "Random whole-case guesses"}, "lower": false, "range": null, "cases": 1694, "group": "tools", "in_suite": true, "interactive": false, "references": [{"kind": "paper", "url": "https://arxiv.org/abs/2305.15334"}, {"kind": "code", "url": "https://github.com/gorilla-llm/gorilla"}], "gold": 1.2, "private": true} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 1694 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · BFCL · median_ms | 308.20 ms | Setup & sourceHF text 0.4 · BFCL · median_ms Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published measured timing; excludes null and zero batch placeholders. Median and p95 over the timed rows that returned an answer; per-benchmark medians are shown only where the sample holds at least 5 rows of that benchmark. A bootstrap on the full single-process runs of ten entrants put the sample median within 5% and the p95 within 10% of a full run at 95% confidence. Earlier board figures came from the scoring runs, some timed with 6 to 12 processes sharing a card or with queue waits removed; they are no longer shown. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · BFCL · Raw index component | 97.34 | Setup & sourceHF text 0.4 · BFCL · Raw index component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native case exact accuracy. Source normalization: {"raw": 0.9734, "skill": 0.9641, "coverage": 1, "random": 0.2592, "tracks": [], "combined": 0.9465, "private_eq": 0.9601} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 1694 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · BFCL · Chance-corrected public skill | 96.41 | Setup & sourceHF text 0.4 · BFCL · Chance-corrected public skill Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native case exact accuracy. Source normalization: {"raw": 0.9734, "skill": 0.9641, "coverage": 1, "random": 0.2592, "tracks": [], "combined": 0.9465, "private_eq": 0.9601} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 1694 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · BFCL · Combined public/private component | 94.65 | Setup & sourceHF text 0.4 · BFCL · Combined public/private component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native case exact accuracy. Source normalization: {"raw": 0.9734, "skill": 0.9641, "coverage": 1, "random": 0.2592, "tracks": [], "combined": 0.9465, "private_eq": 0.9601} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · BFCL · Equated private same-skill component | 96.01 | Setup & sourceHF text 0.4 · BFCL · Equated private same-skill component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native case exact accuracy. Source normalization: {"raw": 0.9734, "skill": 0.9641, "coverage": 1, "random": 0.2592, "tracks": [], "combined": 0.9465, "private_eq": 0.9601} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · ToolRet · nDCG@10 | 71.22% | Setup & sourceHF text 0.4 · ToolRet · nDCG@10 Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Native source result: {"score": 0.7122, "jev": null, "metric": "nDCG@10", "requests": 685, "answered": 685, "unsupported": 0, "errors": 0, "median_ms": 3217.8}. Benchmark contract: {"id": 2, "dataset": "ToolRet", "short": "ToolRet", "metric": "nDCG@10", "explainer": "Rates how useful each of 32 search-hit tools is for a request; ranked by nDCG@10, on requests where at least one of the 32 is relevant.", "baseline": {"value": 0.1341, "label": "Random ranking, answerable queries", "previous": 0.0937}, "lower": false, "range": null, "cases": 685, "group": "tools", "in_suite": true, "interactive": false, "references": [{"kind": "paper", "url": "https://arxiv.org/abs/2503.01763"}, {"kind": "dataset", "url": "https://huggingface.co/datasets/mangopy/ToolRet-Queries"}], "private": true} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 685 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · ToolRet · median_ms | 3217.80 ms | Setup & sourceHF text 0.4 · ToolRet · median_ms Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published measured timing; excludes null and zero batch placeholders. Median and p95 over the timed rows that returned an answer; per-benchmark medians are shown only where the sample holds at least 5 rows of that benchmark. A bootstrap on the full single-process runs of ten entrants put the sample median within 5% and the p95 within 10% of a full run at 95% confidence. Earlier board figures came from the scoring runs, some timed with 6 to 12 processes sharing a card or with queue waits removed; they are no longer shown. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · ToolRet · Raw index component | 71.22 | Setup & sourceHF text 0.4 · ToolRet · Raw index component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native nDCG@10. Source normalization: {"raw": 0.7122, "skill": 0.6676, "coverage": 1, "random": 0.1341, "tracks": [], "combined": 0.6994, "private_eq": 0.7418} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 685 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · ToolRet · Chance-corrected public skill | 66.76 | Setup & sourceHF text 0.4 · ToolRet · Chance-corrected public skill Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native nDCG@10. Source normalization: {"raw": 0.7122, "skill": 0.6676, "coverage": 1, "random": 0.1341, "tracks": [], "combined": 0.6994, "private_eq": 0.7418} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 685 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · ToolRet · Combined public/private component | 69.94 | Setup & sourceHF text 0.4 · ToolRet · Combined public/private component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native nDCG@10. Source normalization: {"raw": 0.7122, "skill": 0.6676, "coverage": 1, "random": 0.1341, "tracks": [], "combined": 0.6994, "private_eq": 0.7418} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · ToolRet · Equated private same-skill component | 74.18 | Setup & sourceHF text 0.4 · ToolRet · Equated private same-skill component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native nDCG@10. Source normalization: {"raw": 0.7122, "skill": 0.6676, "coverage": 1, "random": 0.1341, "tracks": [], "combined": 0.6994, "private_eq": 0.7418} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · API-Bank · accuracy | 87.01% | Setup & sourceHF text 0.4 · API-Bank · accuracy Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Native source result: {"score": 0.8701, "jev": null, "metric": "accuracy", "requests": 508, "answered": 508, "unsupported": 0, "errors": 0, "median_ms": 1613.4}. Benchmark contract: {"id": 3, "dataset": "API-Bank", "short": "API-Bank", "metric": "accuracy", "explainer": "Reads an assistant conversation and picks the next API to call from a catalog of 53.", "baseline": {"value": 0.0189, "label": "Uniform random choice"}, "lower": false, "range": null, "cases": 508, "group": "tools", "in_suite": true, "interactive": false, "references": [{"kind": "paper", "url": "https://arxiv.org/abs/2304.08244"}, {"kind": "code", "url": "https://github.com/AlibabaResearch/DAMO-ConvAI/tree/main/api-bank"}], "gold": 1.2, "private": true} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 508 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · API-Bank · median_ms | 1613.40 ms | Setup & sourceHF text 0.4 · API-Bank · median_ms Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published measured timing; excludes null and zero batch placeholders. Median and p95 over the timed rows that returned an answer; per-benchmark medians are shown only where the sample holds at least 5 rows of that benchmark. A bootstrap on the full single-process runs of ten entrants put the sample median within 5% and the p95 within 10% of a full run at 95% confidence. Earlier board figures came from the scoring runs, some timed with 6 to 12 processes sharing a card or with queue waits removed; they are no longer shown. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · API-Bank · Raw index component | 87.01 | Setup & sourceHF text 0.4 · API-Bank · Raw index component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.8701, "skill": 0.8676, "coverage": 1, "random": 0.0189, "tracks": [], "combined": 0.9433, "private_eq": 0.944} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 508 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · API-Bank · Chance-corrected public skill | 86.76 | Setup & sourceHF text 0.4 · API-Bank · Chance-corrected public skill Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.8701, "skill": 0.8676, "coverage": 1, "random": 0.0189, "tracks": [], "combined": 0.9433, "private_eq": 0.944} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 508 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · API-Bank · Combined public/private component | 94.33 | Setup & sourceHF text 0.4 · API-Bank · Combined public/private component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.8701, "skill": 0.8676, "coverage": 1, "random": 0.0189, "tracks": [], "combined": 0.9433, "private_eq": 0.944} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · API-Bank · Equated private same-skill component | 94.40 | Setup & sourceHF text 0.4 · API-Bank · Equated private same-skill component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.8701, "skill": 0.8676, "coverage": 1, "random": 0.0189, "tracks": [], "combined": 0.9433, "private_eq": 0.944} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · BANKING77 · macro-F1 | 92.01% | Setup & sourceHF text 0.4 · BANKING77 · macro-F1 Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Native source result: {"score": 0.9201, "jev": null, "metric": "macro-F1", "requests": 3080, "answered": 3080, "unsupported": 0, "errors": 0, "median_ms": 187.8}. Benchmark contract: {"id": 4, "dataset": "BANKING77", "short": "BANKING77", "metric": "macro-F1", "explainer": "Picks the intent of a bank customer's message, e.g. \"How do I locate my card?\", from 77.", "baseline": {"value": 0.0127, "label": "Random choices · F1"}, "lower": false, "range": null, "cases": 3080, "group": "retrieval", "in_suite": true, "interactive": false, "references": [{"kind": "paper", "url": "https://arxiv.org/abs/2003.04807"}, {"kind": "dataset", "url": "https://github.com/PolyAI-LDN/task-specific-datasets"}], "gold": 1.2, "private": true} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 3080 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · BANKING77 · median_ms | 187.80 ms | Setup & sourceHF text 0.4 · BANKING77 · median_ms Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published measured timing; excludes null and zero batch placeholders. Median and p95 over the timed rows that returned an answer; per-benchmark medians are shown only where the sample holds at least 5 rows of that benchmark. A bootstrap on the full single-process runs of ten entrants put the sample median within 5% and the p95 within 10% of a full run at 95% confidence. Earlier board figures came from the scoring runs, some timed with 6 to 12 processes sharing a card or with queue waits removed; they are no longer shown. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · BANKING77 · Raw index component | 92.01 | Setup & sourceHF text 0.4 · BANKING77 · Raw index component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native macro-F1. Source normalization: {"raw": 0.9201, "skill": 0.9191, "coverage": 1, "random": 0.0127, "tracks": [], "combined": 0.8854, "private_eq": 0.8871} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 3080 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · BANKING77 · Chance-corrected public skill | 91.91 | Setup & sourceHF text 0.4 · BANKING77 · Chance-corrected public skill Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native macro-F1. Source normalization: {"raw": 0.9201, "skill": 0.9191, "coverage": 1, "random": 0.0127, "tracks": [], "combined": 0.8854, "private_eq": 0.8871} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 3080 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · BANKING77 · Combined public/private component | 88.54 | Setup & sourceHF text 0.4 · BANKING77 · Combined public/private component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native macro-F1. Source normalization: {"raw": 0.9201, "skill": 0.9191, "coverage": 1, "random": 0.0127, "tracks": [], "combined": 0.8854, "private_eq": 0.8871} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · BANKING77 · Equated private same-skill component | 88.71 | Setup & sourceHF text 0.4 · BANKING77 · Equated private same-skill component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native macro-F1. Source normalization: {"raw": 0.9201, "skill": 0.9191, "coverage": 1, "random": 0.0127, "tracks": [], "combined": 0.8854, "private_eq": 0.8871} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · CLINC150+OOS · macro-F1 | 95.89% | Setup & sourceHF text 0.4 · CLINC150+OOS · macro-F1 Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Native source result: {"score": 0.9589, "jev": null, "metric": "macro-F1", "requests": 5500, "answered": 5500, "unsupported": 0, "errors": 0, "median_ms": 325.4}. Benchmark contract: {"id": 5, "dataset": "CLINC150+OOS", "short": "CLINC150", "metric": "macro-F1", "explainer": "Reads a short assistant request and picks its intent from 150, or \"out of scope\" when none fits.", "baseline": {"value": 0.006, "label": "Random choices · F1"}, "lower": false, "range": null, "cases": 5500, "group": "retrieval", "in_suite": true, "interactive": false, "references": [{"kind": "dataset", "url": "https://github.com/clinc/oos-eval"}], "gold": 1.2, "private": true} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 5500 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · CLINC150+OOS · median_ms | 325.40 ms | Setup & sourceHF text 0.4 · CLINC150+OOS · median_ms Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published measured timing; excludes null and zero batch placeholders. Median and p95 over the timed rows that returned an answer; per-benchmark medians are shown only where the sample holds at least 5 rows of that benchmark. A bootstrap on the full single-process runs of ten entrants put the sample median within 5% and the p95 within 10% of a full run at 95% confidence. Earlier board figures came from the scoring runs, some timed with 6 to 12 processes sharing a card or with queue waits removed; they are no longer shown. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · CLINC150+OOS · Raw index component | 95.89 | Setup & sourceHF text 0.4 · CLINC150+OOS · Raw index component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native macro-F1. Source normalization: {"raw": 0.9589, "skill": 0.9587, "coverage": 1, "random": 0.006, "tracks": [], "combined": 0.8829, "private_eq": 0.8839} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 5500 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · CLINC150+OOS · Chance-corrected public skill | 95.87 | Setup & sourceHF text 0.4 · CLINC150+OOS · Chance-corrected public skill Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native macro-F1. Source normalization: {"raw": 0.9589, "skill": 0.9587, "coverage": 1, "random": 0.006, "tracks": [], "combined": 0.8829, "private_eq": 0.8839} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 5500 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · CLINC150+OOS · Combined public/private component | 88.29 | Setup & sourceHF text 0.4 · CLINC150+OOS · Combined public/private component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native macro-F1. Source normalization: {"raw": 0.9589, "skill": 0.9587, "coverage": 1, "random": 0.006, "tracks": [], "combined": 0.8829, "private_eq": 0.8839} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · CLINC150+OOS · Equated private same-skill component | 88.39 | Setup & sourceHF text 0.4 · CLINC150+OOS · Equated private same-skill component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native macro-F1. Source normalization: {"raw": 0.9589, "skill": 0.9587, "coverage": 1, "random": 0.006, "tracks": [], "combined": 0.8829, "private_eq": 0.8839} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · RouterBench · selected quality (quality objective) | 79.64% | Setup & sourceHF text 0.4 · RouterBench · selected quality (quality objective) Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Native source result: {"score": 0.7964, "jev": null, "metric": "selected quality (quality objective)", "requests": 10000, "answered": 10000, "unsupported": 0, "errors": 0, "median_ms": 906}. Benchmark contract: {"id": 6, "dataset": "RouterBench", "short": "RouterBench", "metric": "selected quality (quality objective)", "explainer": "Picks which of 11 AI models should answer a prompt; scored by its real answer.", "baseline": {"value": 0.5735, "label": "Random model selection"}, "lower": false, "range": null, "cases": 5001, "group": "tools", "in_suite": true, "interactive": false, "index_note": "Not in the index: the prompt reveals that GPT-4 is the best route, so the top models all pick GPT-4 and score within a fraction of a point of each other. Scores stay visible.", "references": [{"kind": "paper", "url": "https://arxiv.org/abs/2403.12031"}, {"kind": "dataset", "url": "https://huggingface.co/datasets/withmartian/routerbench"}]} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 10000 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · RouterBench · median_ms | 906.00 ms | Setup & sourceHF text 0.4 · RouterBench · median_ms Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published measured timing; excludes null and zero batch placeholders. Median and p95 over the timed rows that returned an answer; per-benchmark medians are shown only where the sample holds at least 5 rows of that benchmark. A bootstrap on the full single-process runs of ten entrants put the sample median within 5% and the p95 within 10% of a full run at 95% confidence. Earlier board figures came from the scoring runs, some timed with 6 to 12 processes sharing a card or with queue waits removed; they are no longer shown. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · RouterBench · Raw index component | 79.64 | Setup & sourceHF text 0.4 · RouterBench · Raw index component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native selected quality (quality objective). Source normalization: {"raw": 0.7964, "skill": 0.5226, "coverage": 1, "random": 0.5735, "tracks": []} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 10000 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · RouterBench · Chance-corrected public skill | 52.26 | Setup & sourceHF text 0.4 · RouterBench · Chance-corrected public skill Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native selected quality (quality objective). Source normalization: {"raw": 0.7964, "skill": 0.5226, "coverage": 1, "random": 0.5735, "tracks": []} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 10000 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · Home appliance simulator · case exact accuracy | 100.00% | Setup & sourceHF text 0.4 · Home appliance simulator · case exact accuracy Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Native source result: {"score": 1, "jev": null, "metric": "case exact accuracy", "requests": 88, "answered": 88, "unsupported": 0, "errors": 0, "median_ms": 3996.2}. Benchmark contract: {"id": 9, "dataset": "Home appliance simulator", "short": "Home appliances", "metric": "case exact accuracy", "explainer": "Given a simulated home and a command, answers ~18 questions on handling it; all must be right. Duplicate and dev-set rows removed.", "baseline": {"value": 0, "label": "Random whole-case guesses"}, "lower": false, "range": null, "cases": 88, "group": "tools", "in_suite": true, "interactive": false, "references": [{"kind": "code", "url": "https://github.com/apolinario/decision-index/blob/main/decision_index/suite/build/home_appliance.py"}], "private": true} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 88 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · Home appliance simulator · median_ms | 3996.20 ms | Setup & sourceHF text 0.4 · Home appliance simulator · median_ms Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published measured timing; excludes null and zero batch placeholders. Median and p95 over the timed rows that returned an answer; per-benchmark medians are shown only where the sample holds at least 5 rows of that benchmark. A bootstrap on the full single-process runs of ten entrants put the sample median within 5% and the p95 within 10% of a full run at 95% confidence. Earlier board figures came from the scoring runs, some timed with 6 to 12 processes sharing a card or with queue waits removed; they are no longer shown. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · Home appliance simulator · Raw index component | 100.00 | Setup & sourceHF text 0.4 · Home appliance simulator · Raw index component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native case exact accuracy. Source normalization: {"raw": 1, "skill": 1, "coverage": 1, "random": 0, "tracks": [], "combined": 0.9252, "private_eq": 0.925} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 88 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · Home appliance simulator · Chance-corrected public skill | 100.00 | Setup & sourceHF text 0.4 · Home appliance simulator · Chance-corrected public skill Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native case exact accuracy. Source normalization: {"raw": 1, "skill": 1, "coverage": 1, "random": 0, "tracks": [], "combined": 0.9252, "private_eq": 0.925} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 88 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · Home appliance simulator · Combined public/private component | 92.52 | Setup & sourceHF text 0.4 · Home appliance simulator · Combined public/private component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native case exact accuracy. Source normalization: {"raw": 1, "skill": 1, "coverage": 1, "random": 0, "tracks": [], "combined": 0.9252, "private_eq": 0.925} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · Home appliance simulator · Equated private same-skill component | 92.50 | Setup & sourceHF text 0.4 · Home appliance simulator · Equated private same-skill component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native case exact accuracy. Source normalization: {"raw": 1, "skill": 1, "coverage": 1, "random": 0, "tracks": [], "combined": 0.9252, "private_eq": 0.925} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · SGD/SGD-X · macro-F1 | 67.27% | Setup & sourceHF text 0.4 · SGD/SGD-X · macro-F1 Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Native source result: {"score": 0.6727, "jev": null, "metric": "macro-F1", "requests": 2500, "answered": 2500, "unsupported": 0, "errors": 0, "median_ms": 233.7}. Benchmark contract: {"id": 10, "dataset": "SGD/SGD-X", "short": "SGD", "metric": "macro-F1", "explainer": "Reads a service dialogue so far and picks the intent the user is pursuing now, or NONE.", "baseline": {"value": 0.399, "label": "Random choices · F1"}, "lower": false, "range": null, "cases": 2500, "group": "retrieval", "in_suite": true, "interactive": false, "index_note": "Not in the index: build bug, pending re-run. The builder gave every SGD row the whole dialogue, including the turns after the one being classified. Scores stay visible; SGD returns to the index once re-run with the fixed builder.", "references": [{"kind": "paper", "url": "https://arxiv.org/abs/1909.05855"}, {"kind": "dataset", "url": "https://github.com/google-research-datasets/dstc8-schema-guided-dialogue"}]} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 2500 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · SGD/SGD-X · median_ms | 233.70 ms | Setup & sourceHF text 0.4 · SGD/SGD-X · median_ms Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published measured timing; excludes null and zero batch placeholders. Median and p95 over the timed rows that returned an answer; per-benchmark medians are shown only where the sample holds at least 5 rows of that benchmark. A bootstrap on the full single-process runs of ten entrants put the sample median within 5% and the p95 within 10% of a full run at 95% confidence. Earlier board figures came from the scoring runs, some timed with 6 to 12 processes sharing a card or with queue waits removed; they are no longer shown. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · SGD/SGD-X · Raw index component | 67.27 | Setup & sourceHF text 0.4 · SGD/SGD-X · Raw index component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native macro-F1. Source normalization: {"raw": 0.6727, "skill": 0.4554, "coverage": 1, "random": 0.399, "tracks": []} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 2500 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · SGD/SGD-X · Chance-corrected public skill | 45.54 | Setup & sourceHF text 0.4 · SGD/SGD-X · Chance-corrected public skill Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native macro-F1. Source normalization: {"raw": 0.6727, "skill": 0.4554, "coverage": 1, "random": 0.399, "tracks": []} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 2500 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · ContractNLI · macro-F1 | 84.70% | Setup & sourceHF text 0.4 · ContractNLI · macro-F1 Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Native source result: {"score": 0.847, "jev": null, "metric": "macro-F1", "requests": 123, "answered": 123, "unsupported": 0, "errors": 0, "median_ms": 6667.3}. Benchmark contract: {"id": 11, "dataset": "ContractNLI", "short": "ContractNLI", "metric": "macro-F1", "explainer": "Says whether a full NDA supports, contradicts or omits each of 17 fixed statements.", "baseline": {"value": 0.3085, "label": "Random choices · F1"}, "lower": false, "range": null, "cases": 123, "group": "language", "in_suite": true, "interactive": false, "references": [{"kind": "paper", "url": "https://aclanthology.org/2021.findings-emnlp.164"}, {"kind": "dataset", "url": "https://stanfordnlp.github.io/contract-nli/"}]} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 123 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · ContractNLI · median_ms | 6667.30 ms | Setup & sourceHF text 0.4 · ContractNLI · median_ms Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published measured timing; excludes null and zero batch placeholders. Median and p95 over the timed rows that returned an answer; per-benchmark medians are shown only where the sample holds at least 5 rows of that benchmark. A bootstrap on the full single-process runs of ten entrants put the sample median within 5% and the p95 within 10% of a full run at 95% confidence. Earlier board figures came from the scoring runs, some timed with 6 to 12 processes sharing a card or with queue waits removed; they are no longer shown. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · ContractNLI · Raw index component | 84.70 | Setup & sourceHF text 0.4 · ContractNLI · Raw index component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native macro-F1. Source normalization: {"raw": 0.847, "skill": 0.7787, "coverage": 1, "random": 0.3085, "tracks": []} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 123 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · ContractNLI · Chance-corrected public skill | 77.87 | Setup & sourceHF text 0.4 · ContractNLI · Chance-corrected public skill Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native macro-F1. Source normalization: {"raw": 0.847, "skill": 0.7787, "coverage": 1, "random": 0.3085, "tracks": []} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 123 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · ANLI · macro-F1 | 80.60% | Setup & sourceHF text 0.4 · ANLI · macro-F1 Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Native source result: {"score": 0.806, "jev": null, "metric": "macro-F1", "requests": 3200, "answered": 3200, "unsupported": 0, "errors": 0, "median_ms": 64.6}. Benchmark contract: {"id": 12, "dataset": "ANLI", "short": "ANLI", "metric": "macro-F1", "explainer": "Decides whether a claim follows from, contradicts, or is neutral to a premise written to fool AI models.", "baseline": {"value": 0.3324, "label": "Random choices · F1"}, "lower": false, "range": null, "cases": 3200, "group": "language", "in_suite": true, "interactive": false, "references": [{"kind": "paper", "url": "https://arxiv.org/abs/1910.14599"}, {"kind": "dataset", "url": "https://huggingface.co/datasets/facebook/anli"}], "gold": 1.2, "private": true} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 3200 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · ANLI · median_ms | 64.60 ms | Setup & sourceHF text 0.4 · ANLI · median_ms Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published measured timing; excludes null and zero batch placeholders. Median and p95 over the timed rows that returned an answer; per-benchmark medians are shown only where the sample holds at least 5 rows of that benchmark. A bootstrap on the full single-process runs of ten entrants put the sample median within 5% and the p95 within 10% of a full run at 95% confidence. Earlier board figures came from the scoring runs, some timed with 6 to 12 processes sharing a card or with queue waits removed; they are no longer shown. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · ANLI · Raw index component | 80.60 | Setup & sourceHF text 0.4 · ANLI · Raw index component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native macro-F1. Source normalization: {"raw": 0.806, "skill": 0.7094, "coverage": 1, "random": 0.3324, "tracks": [], "combined": 0.5298, "private_eq": 0.689} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 3200 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · ANLI · Chance-corrected public skill | 70.94 | Setup & sourceHF text 0.4 · ANLI · Chance-corrected public skill Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native macro-F1. Source normalization: {"raw": 0.806, "skill": 0.7094, "coverage": 1, "random": 0.3324, "tracks": [], "combined": 0.5298, "private_eq": 0.689} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 3200 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · ANLI · Combined public/private component | 52.98 | Setup & sourceHF text 0.4 · ANLI · Combined public/private component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native macro-F1. Source normalization: {"raw": 0.806, "skill": 0.7094, "coverage": 1, "random": 0.3324, "tracks": [], "combined": 0.5298, "private_eq": 0.689} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · ANLI · Equated private same-skill component | 68.90 | Setup & sourceHF text 0.4 · ANLI · Equated private same-skill component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native macro-F1. Source normalization: {"raw": 0.806, "skill": 0.7094, "coverage": 1, "random": 0.3324, "tracks": [], "combined": 0.5298, "private_eq": 0.689} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · BPoMP · accuracy | 98.38% | Setup & sourceHF text 0.4 · BPoMP · accuracy Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Native source result: {"score": 0.9838, "jev": null, "metric": "accuracy", "requests": 5000, "answered": 5000, "unsupported": 0, "errors": 0, "median_ms": 65}. Benchmark contract: {"id": 20, "dataset": "BPoMP", "short": "BPoMP", "metric": "accuracy", "explainer": "Given two versions of a limerick, one with its rhyme, meter or sense broken, picks the original.", "baseline": {"value": 0.5, "label": "Uniform random choice"}, "lower": false, "range": null, "cases": 811, "group": "arts", "in_suite": true, "interactive": false, "references": [{"kind": "dataset", "url": "https://zenodo.org/records/7299879"}], "private": true} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 5000 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · BPoMP · median_ms | 65.00 ms | Setup & sourceHF text 0.4 · BPoMP · median_ms Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published measured timing; excludes null and zero batch placeholders. Median and p95 over the timed rows that returned an answer; per-benchmark medians are shown only where the sample holds at least 5 rows of that benchmark. A bootstrap on the full single-process runs of ten entrants put the sample median within 5% and the p95 within 10% of a full run at 95% confidence. Earlier board figures came from the scoring runs, some timed with 6 to 12 processes sharing a card or with queue waits removed; they are no longer shown. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · BPoMP · Raw index component | 98.40 | Setup & sourceHF text 0.4 · BPoMP · Raw index component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.984, "skill": 0.9679, "coverage": 1, "random": 0.5, "tracks": [], "combined": 0.9577, "private_eq": 0.9786} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 5000 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · BPoMP · Chance-corrected public skill | 96.79 | Setup & sourceHF text 0.4 · BPoMP · Chance-corrected public skill Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.984, "skill": 0.9679, "coverage": 1, "random": 0.5, "tracks": [], "combined": 0.9577, "private_eq": 0.9786} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 5000 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · BPoMP · Combined public/private component | 95.77 | Setup & sourceHF text 0.4 · BPoMP · Combined public/private component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.984, "skill": 0.9679, "coverage": 1, "random": 0.5, "tracks": [], "combined": 0.9577, "private_eq": 0.9786} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · BPoMP · Equated private same-skill component | 97.86 | Setup & sourceHF text 0.4 · BPoMP · Equated private same-skill component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.984, "skill": 0.9679, "coverage": 1, "random": 0.5, "tracks": [], "combined": 0.9577, "private_eq": 0.9786} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · Humicroedit · accuracy | 68.61% | Setup & sourceHF text 0.4 · Humicroedit · accuracy Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Native source result: {"score": 0.6861, "jev": null, "metric": "accuracy", "requests": 2628, "answered": 2628, "unsupported": 0, "errors": 0, "median_ms": 55.1}. Benchmark contract: {"id": 21, "dataset": "Humicroedit", "short": "Humicroedit", "metric": "accuracy", "explainer": "Given two one-word edits of a news headline, picks the one people rated funnier.", "baseline": {"value": 0.5, "label": "Uniform random choice"}, "lower": false, "range": null, "cases": 2628, "group": "arts", "in_suite": true, "interactive": false, "references": [{"kind": "paper", "url": "https://arxiv.org/abs/1906.00274"}, {"kind": "dataset", "url": "https://cs.rochester.edu/u/nhossain/humicroedit.html"}], "private": true} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 2628 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · Humicroedit · median_ms | 55.10 ms | Setup & sourceHF text 0.4 · Humicroedit · median_ms Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published measured timing; excludes null and zero batch placeholders. Median and p95 over the timed rows that returned an answer; per-benchmark medians are shown only where the sample holds at least 5 rows of that benchmark. A bootstrap on the full single-process runs of ten entrants put the sample median within 5% and the p95 within 10% of a full run at 95% confidence. Earlier board figures came from the scoring runs, some timed with 6 to 12 processes sharing a card or with queue waits removed; they are no longer shown. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · Humicroedit · Raw index component | 68.61 | Setup & sourceHF text 0.4 · Humicroedit · Raw index component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.6861, "skill": 0.3721, "coverage": 1, "random": 0.5, "tracks": [], "combined": 0.2968, "private_eq": 0.6519} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 2628 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · Humicroedit · Chance-corrected public skill | 37.21 | Setup & sourceHF text 0.4 · Humicroedit · Chance-corrected public skill Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.6861, "skill": 0.3721, "coverage": 1, "random": 0.5, "tracks": [], "combined": 0.2968, "private_eq": 0.6519} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 2628 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · Humicroedit · Combined public/private component | 29.68 | Setup & sourceHF text 0.4 · Humicroedit · Combined public/private component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.6861, "skill": 0.3721, "coverage": 1, "random": 0.5, "tracks": [], "combined": 0.2968, "private_eq": 0.6519} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · Humicroedit · Equated private same-skill component | 65.19 | Setup & sourceHF text 0.4 · Humicroedit · Equated private same-skill component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.6861, "skill": 0.3721, "coverage": 1, "random": 0.5, "tracks": [], "combined": 0.2968, "private_eq": 0.6519} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · POP909-CL · accuracy | 79.35% | Setup & sourceHF text 0.4 · POP909-CL · accuracy Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Native source result: {"score": 0.7935, "jev": null, "metric": "accuracy", "requests": 2000, "answered": 2000, "unsupported": 0, "errors": 0, "median_ms": 1388.7}. Benchmark contract: {"id": 22, "dataset": "POP909-CL", "short": "POP909", "metric": "accuracy", "explainer": "Given the notes around a beat in a pop song (not audio), picks the chord playing from 129.", "baseline": {"value": 0.0078, "label": "Uniform random choice"}, "lower": false, "range": null, "cases": 2000, "group": "arts", "in_suite": true, "interactive": false, "references": [{"kind": "paper", "url": "https://arxiv.org/abs/2510.06528"}, {"kind": "dataset", "url": "https://github.com/AndyWeasley2004/POP909-CL-Dataset"}], "private": true} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 2000 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · POP909-CL · median_ms | 1388.70 ms | Setup & sourceHF text 0.4 · POP909-CL · median_ms Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published measured timing; excludes null and zero batch placeholders. Median and p95 over the timed rows that returned an answer; per-benchmark medians are shown only where the sample holds at least 5 rows of that benchmark. A bootstrap on the full single-process runs of ten entrants put the sample median within 5% and the p95 within 10% of a full run at 95% confidence. Earlier board figures came from the scoring runs, some timed with 6 to 12 processes sharing a card or with queue waits removed; they are no longer shown. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · POP909-CL · Raw index component | 79.40 | Setup & sourceHF text 0.4 · POP909-CL · Raw index component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.794, "skill": 0.7924, "coverage": 1, "random": 0.0078, "tracks": [], "combined": 0.5675, "private_eq": 0.5748} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 2000 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · POP909-CL · Chance-corrected public skill | 79.24 | Setup & sourceHF text 0.4 · POP909-CL · Chance-corrected public skill Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.794, "skill": 0.7924, "coverage": 1, "random": 0.0078, "tracks": [], "combined": 0.5675, "private_eq": 0.5748} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 2000 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · POP909-CL · Combined public/private component | 56.75 | Setup & sourceHF text 0.4 · POP909-CL · Combined public/private component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.794, "skill": 0.7924, "coverage": 1, "random": 0.0078, "tracks": [], "combined": 0.5675, "private_eq": 0.5748} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · POP909-CL · Equated private same-skill component | 57.48 | Setup & sourceHF text 0.4 · POP909-CL · Equated private same-skill component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.794, "skill": 0.7924, "coverage": 1, "random": 0.0078, "tracks": [], "combined": 0.5675, "private_eq": 0.5748} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · cfcolor · accuracy | 66.28% | Setup & sourceHF text 0.4 · cfcolor · accuracy Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Native source result: {"score": 0.6628, "jev": null, "metric": "accuracy", "requests": 5000, "answered": 5000, "unsupported": 0, "errors": 0, "median_ms": 120.7}. Benchmark contract: {"id": 23, "dataset": "cfcolor", "short": "cfcolor", "metric": "accuracy", "explainer": "Given a person's earlier ratings of color palettes, predicts which of two new palettes they rated higher.", "baseline": {"value": 0.5, "label": "Uniform random choice"}, "lower": false, "range": null, "cases": 5000, "group": "arts", "in_suite": true, "interactive": false, "references": [{"kind": "dataset", "url": "https://www.dgp.toronto.edu/~donovan/cfcolor/"}]} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 5000 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · cfcolor · median_ms | 120.70 ms | Setup & sourceHF text 0.4 · cfcolor · median_ms Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published measured timing; excludes null and zero batch placeholders. Median and p95 over the timed rows that returned an answer; per-benchmark medians are shown only where the sample holds at least 5 rows of that benchmark. A bootstrap on the full single-process runs of ten entrants put the sample median within 5% and the p95 within 10% of a full run at 95% confidence. Earlier board figures came from the scoring runs, some timed with 6 to 12 processes sharing a card or with queue waits removed; they are no longer shown. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · cfcolor · Raw index component | 67.62 | Setup & sourceHF text 0.4 · cfcolor · Raw index component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.6762, "skill": 0.3524, "coverage": 1, "random": 0.5, "tracks": []} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 5000 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · cfcolor · Chance-corrected public skill | 35.24 | Setup & sourceHF text 0.4 · cfcolor · Chance-corrected public skill Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.6762, "skill": 0.3524, "coverage": 1, "random": 0.5, "tracks": []} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 5000 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · MMLU · accuracy | 88.41% | Setup & sourceHF text 0.4 · MMLU · accuracy Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Native source result: {"score": 0.8841, "jev": null, "metric": "accuracy", "requests": 14033, "answered": 14033, "unsupported": 0, "errors": 0, "median_ms": 59.3}. Benchmark contract: {"id": 24, "dataset": "MMLU", "short": "MMLU", "metric": "accuracy", "explainer": "Four-option questions across 57 school and professional subjects, from law to algebra.", "baseline": {"value": 0.25, "label": "Uniform random choice"}, "lower": false, "range": null, "cases": 14042, "group": "knowledge", "in_suite": true, "interactive": false, "references": [{"kind": "dataset", "url": "https://huggingface.co/datasets/cais/mmlu"}]} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 14033 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · MMLU · median_ms | 59.30 ms | Setup & sourceHF text 0.4 · MMLU · median_ms Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published measured timing; excludes null and zero batch placeholders. Median and p95 over the timed rows that returned an answer; per-benchmark medians are shown only where the sample holds at least 5 rows of that benchmark. A bootstrap on the full single-process runs of ten entrants put the sample median within 5% and the p95 within 10% of a full run at 95% confidence. Earlier board figures came from the scoring runs, some timed with 6 to 12 processes sharing a card or with queue waits removed; they are no longer shown. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · MMLU · Raw index component | 88.41 | Setup & sourceHF text 0.4 · MMLU · Raw index component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.8841, "skill": 0.8455, "coverage": 1, "random": 0.25, "tracks": []} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 14033 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · MMLU · Chance-corrected public skill | 84.55 | Setup & sourceHF text 0.4 · MMLU · Chance-corrected public skill Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.8841, "skill": 0.8455, "coverage": 1, "random": 0.25, "tracks": []} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 14033 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · GPQA Diamond · accuracy | 58.16% | Setup & sourceHF text 0.4 · GPQA Diamond · accuracy Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Native source result: {"score": 0.5816, "jev": null, "metric": "accuracy", "requests": 196, "answered": 196, "unsupported": 0, "errors": 0, "median_ms": 68.1}. Benchmark contract: {"id": 25, "dataset": "GPQA Diamond", "short": "GPQA Diamond", "metric": "accuracy", "explainer": "198 hard four-option science questions written by PhD experts in physics, chemistry and biology.", "baseline": {"value": 0.25, "label": "Uniform random choice"}, "lower": false, "range": null, "cases": 198, "group": "knowledge", "in_suite": true, "interactive": false, "references": [{"kind": "dataset", "url": "https://github.com/idavidrein/gpqa"}], "gold": 1.2, "private": true} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 196 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · GPQA Diamond · median_ms | 68.10 ms | Setup & sourceHF text 0.4 · GPQA Diamond · median_ms Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published measured timing; excludes null and zero batch placeholders. Median and p95 over the timed rows that returned an answer; per-benchmark medians are shown only where the sample holds at least 5 rows of that benchmark. A bootstrap on the full single-process runs of ten entrants put the sample median within 5% and the p95 within 10% of a full run at 95% confidence. Earlier board figures came from the scoring runs, some timed with 6 to 12 processes sharing a card or with queue waits removed; they are no longer shown. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · GPQA Diamond · Raw index component | 58.16 | Setup & sourceHF text 0.4 · GPQA Diamond · Raw index component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.5816, "skill": 0.4422, "coverage": 1, "random": 0.25, "tracks": [], "private_eq": 0.709, "combined": 0.6085} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 196 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · GPQA Diamond · Chance-corrected public skill | 44.22 | Setup & sourceHF text 0.4 · GPQA Diamond · Chance-corrected public skill Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.5816, "skill": 0.4422, "coverage": 1, "random": 0.25, "tracks": [], "private_eq": 0.709, "combined": 0.6085} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 196 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · GPQA Diamond · Combined public/private component | 60.85 | Setup & sourceHF text 0.4 · GPQA Diamond · Combined public/private component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.5816, "skill": 0.4422, "coverage": 1, "random": 0.25, "tracks": [], "private_eq": 0.709, "combined": 0.6085} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · GPQA Diamond · Equated private same-skill component | 70.90 | Setup & sourceHF text 0.4 · GPQA Diamond · Equated private same-skill component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.5816, "skill": 0.4422, "coverage": 1, "random": 0.25, "tracks": [], "private_eq": 0.709, "combined": 0.6085} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · ARC-Easy · accuracy | 99.03% | Setup & sourceHF text 0.4 · ARC-Easy · accuracy Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Native source result: {"score": 0.9903, "jev": null, "metric": "accuracy", "requests": 2376, "answered": 2376, "unsupported": 0, "errors": 0, "median_ms": 56.6}. Benchmark contract: {"id": 26, "dataset": "ARC-Easy", "short": "ARC-Easy", "metric": "accuracy", "explainer": "Grade-school science multiple choice, the easier set.", "baseline": {"value": 0.2502, "label": "Uniform random choice"}, "lower": false, "range": null, "cases": 2376, "group": "knowledge", "in_suite": true, "interactive": false, "references": [{"kind": "dataset", "url": "https://huggingface.co/datasets/allenai/ai2_arc"}]} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 2376 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · ARC-Easy · median_ms | 56.60 ms | Setup & sourceHF text 0.4 · ARC-Easy · median_ms Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published measured timing; excludes null and zero batch placeholders. Median and p95 over the timed rows that returned an answer; per-benchmark medians are shown only where the sample holds at least 5 rows of that benchmark. A bootstrap on the full single-process runs of ten entrants put the sample median within 5% and the p95 within 10% of a full run at 95% confidence. Earlier board figures came from the scoring runs, some timed with 6 to 12 processes sharing a card or with queue waits removed; they are no longer shown. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · ARC-Easy · Raw index component | 99.03 | Setup & sourceHF text 0.4 · ARC-Easy · Raw index component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.9903, "skill": 0.9871, "coverage": 1, "random": 0.2502, "tracks": []} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 2376 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · ARC-Easy · Chance-corrected public skill | 98.71 | Setup & sourceHF text 0.4 · ARC-Easy · Chance-corrected public skill Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.9903, "skill": 0.9871, "coverage": 1, "random": 0.2502, "tracks": []} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 2376 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · ARC-Challenge · accuracy | 97.18% | Setup & sourceHF text 0.4 · ARC-Challenge · accuracy Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Native source result: {"score": 0.9718, "jev": null, "metric": "accuracy", "requests": 1172, "answered": 1172, "unsupported": 0, "errors": 0, "median_ms": 58.1}. Benchmark contract: {"id": 27, "dataset": "ARC-Challenge", "short": "ARC-Challenge", "metric": "accuracy", "explainer": "Grade-school science multiple choice, the harder set that simple retrieval gets wrong.", "baseline": {"value": 0.2502, "label": "Uniform random choice"}, "lower": false, "range": null, "cases": 1172, "group": "knowledge", "in_suite": true, "interactive": false, "references": [{"kind": "dataset", "url": "https://huggingface.co/datasets/allenai/ai2_arc"}]} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 1172 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · ARC-Challenge · median_ms | 58.10 ms | Setup & sourceHF text 0.4 · ARC-Challenge · median_ms Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published measured timing; excludes null and zero batch placeholders. Median and p95 over the timed rows that returned an answer; per-benchmark medians are shown only where the sample holds at least 5 rows of that benchmark. A bootstrap on the full single-process runs of ten entrants put the sample median within 5% and the p95 within 10% of a full run at 95% confidence. Earlier board figures came from the scoring runs, some timed with 6 to 12 processes sharing a card or with queue waits removed; they are no longer shown. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · ARC-Challenge · Raw index component | 97.18 | Setup & sourceHF text 0.4 · ARC-Challenge · Raw index component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.9718, "skill": 0.9624, "coverage": 1, "random": 0.2502, "tracks": []} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 1172 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · ARC-Challenge · Chance-corrected public skill | 96.24 | Setup & sourceHF text 0.4 · ARC-Challenge · Chance-corrected public skill Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.9718, "skill": 0.9624, "coverage": 1, "random": 0.2502, "tracks": []} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 1172 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · WinoGrande · accuracy | 94.63% | Setup & sourceHF text 0.4 · WinoGrande · accuracy Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Native source result: {"score": 0.9463, "jev": null, "metric": "accuracy", "requests": 1267, "answered": 1267, "unsupported": 0, "errors": 0, "median_ms": 54.7}. Benchmark contract: {"id": 28, "dataset": "WinoGrande", "short": "WinoGrande", "metric": "accuracy", "explainer": "Fills a blank with one of two options using common sense, e.g. who \"got the easier cases\".", "baseline": {"value": 0.5, "label": "Uniform random choice"}, "lower": false, "range": null, "cases": 1267, "group": "knowledge", "in_suite": true, "interactive": false, "references": [{"kind": "dataset", "url": "https://huggingface.co/datasets/allenai/winogrande"}], "gold": 1.2, "private": true} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 1267 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · WinoGrande · median_ms | 54.70 ms | Setup & sourceHF text 0.4 · WinoGrande · median_ms Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published measured timing; excludes null and zero batch placeholders. Median and p95 over the timed rows that returned an answer; per-benchmark medians are shown only where the sample holds at least 5 rows of that benchmark. A bootstrap on the full single-process runs of ten entrants put the sample median within 5% and the p95 within 10% of a full run at 95% confidence. Earlier board figures came from the scoring runs, some timed with 6 to 12 processes sharing a card or with queue waits removed; they are no longer shown. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · WinoGrande · Raw index component | 94.63 | Setup & sourceHF text 0.4 · WinoGrande · Raw index component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.9463, "skill": 0.8926, "coverage": 1, "random": 0.5, "tracks": [], "combined": 0.6581, "private_eq": 0.8305} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 1267 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · WinoGrande · Chance-corrected public skill | 89.26 | Setup & sourceHF text 0.4 · WinoGrande · Chance-corrected public skill Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.9463, "skill": 0.8926, "coverage": 1, "random": 0.5, "tracks": [], "combined": 0.6581, "private_eq": 0.8305} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 1267 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · WinoGrande · Combined public/private component | 65.81 | Setup & sourceHF text 0.4 · WinoGrande · Combined public/private component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.9463, "skill": 0.8926, "coverage": 1, "random": 0.5, "tracks": [], "combined": 0.6581, "private_eq": 0.8305} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · WinoGrande · Equated private same-skill component | 83.05 | Setup & sourceHF text 0.4 · WinoGrande · Equated private same-skill component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.9463, "skill": 0.8926, "coverage": 1, "random": 0.5, "tracks": [], "combined": 0.6581, "private_eq": 0.8305} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · HellaSwag · accuracy | 97.71% | Setup & sourceHF text 0.4 · HellaSwag · accuracy Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Native source result: {"score": 0.9771, "jev": null, "metric": "accuracy", "requests": 10042, "answered": 10042, "unsupported": 0, "errors": 0, "median_ms": 81.9}. Benchmark contract: {"id": 29, "dataset": "HellaSwag", "short": "HellaSwag", "metric": "accuracy", "explainer": "Picks the most sensible of four continuations of an everyday scene.", "baseline": {"value": 0.25, "label": "Uniform random choice"}, "lower": false, "range": null, "cases": 10042, "group": "language", "in_suite": true, "interactive": false, "references": [{"kind": "dataset", "url": "https://huggingface.co/datasets/Rowan/hellaswag"}], "gold": 1.2, "private": true} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 10042 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · HellaSwag · median_ms | 81.90 ms | Setup & sourceHF text 0.4 · HellaSwag · median_ms Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published measured timing; excludes null and zero batch placeholders. Median and p95 over the timed rows that returned an answer; per-benchmark medians are shown only where the sample holds at least 5 rows of that benchmark. A bootstrap on the full single-process runs of ten entrants put the sample median within 5% and the p95 within 10% of a full run at 95% confidence. Earlier board figures came from the scoring runs, some timed with 6 to 12 processes sharing a card or with queue waits removed; they are no longer shown. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · HellaSwag · Raw index component | 97.71 | Setup & sourceHF text 0.4 · HellaSwag · Raw index component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.9771, "skill": 0.9695, "coverage": 1, "random": 0.25, "tracks": [], "combined": 1.001, "private_eq": 1} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 10042 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · HellaSwag · Chance-corrected public skill | 96.95 | Setup & sourceHF text 0.4 · HellaSwag · Chance-corrected public skill Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.9771, "skill": 0.9695, "coverage": 1, "random": 0.25, "tracks": [], "combined": 1.001, "private_eq": 1} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 10042 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · HellaSwag · Combined public/private component | 100.10 | Setup & sourceHF text 0.4 · HellaSwag · Combined public/private component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.9771, "skill": 0.9695, "coverage": 1, "random": 0.25, "tracks": [], "combined": 1.001, "private_eq": 1} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · HellaSwag · Equated private same-skill component | 100.00 | Setup & sourceHF text 0.4 · HellaSwag · Equated private same-skill component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.9771, "skill": 0.9695, "coverage": 1, "random": 0.25, "tracks": [], "combined": 1.001, "private_eq": 1} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · GSM8K · accuracy (4- and 10-choice) | 85.29% | Setup & sourceHF text 0.4 · GSM8K · accuracy (4- and 10-choice) Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Native source result: {"score": 0.8529, "jev": 0.7301, "metric": "accuracy (4- and 10-choice)", "requests": 2638, "answered": 2638, "unsupported": 0, "errors": 0, "median_ms": null}. Benchmark contract: {"id": 30, "dataset": "GSM8K", "short": "GSM8K", "metric": "accuracy", "explainer": "Picks a math word problem's answer from 4, and separately 10, numbers, with no working. Rebuilt for v0.3.", "baseline": {"value": 0.175, "label": "Uniform random choice"}, "lower": false, "range": null, "cases": 2638, "group": "knowledge", "in_suite": true, "interactive": false, "references": [{"kind": "dataset", "url": "https://huggingface.co/datasets/openai/gsm8k"}], "private": true} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 2638 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · GSM8K · Raw index component | 85.29 | Setup & sourceHF text 0.4 · GSM8K · Raw index component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.8529, "skill": 0.8245, "coverage": 1, "random": 0.175, "tracks": [{"track": "4-choice", "raw": 0.8916, "random": 0.25}, {"track": "10-choice", "raw": 0.8143, "random": 0.1}], "combined": 0.7661, "private_eq": 0.8084} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 2638 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · GSM8K · Chance-corrected public skill | 82.45 | Setup & sourceHF text 0.4 · GSM8K · Chance-corrected public skill Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.8529, "skill": 0.8245, "coverage": 1, "random": 0.175, "tracks": [{"track": "4-choice", "raw": 0.8916, "random": 0.25}, {"track": "10-choice", "raw": 0.8143, "random": 0.1}], "combined": 0.7661, "private_eq": 0.8084} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 2638 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · GSM8K · Combined public/private component | 76.61 | Setup & sourceHF text 0.4 · GSM8K · Combined public/private component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.8529, "skill": 0.8245, "coverage": 1, "random": 0.175, "tracks": [{"track": "4-choice", "raw": 0.8916, "random": 0.25}, {"track": "10-choice", "raw": 0.8143, "random": 0.1}], "combined": 0.7661, "private_eq": 0.8084} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · GSM8K · Equated private same-skill component | 80.84 | Setup & sourceHF text 0.4 · GSM8K · Equated private same-skill component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.8529, "skill": 0.8245, "coverage": 1, "random": 0.175, "tracks": [{"track": "4-choice", "raw": 0.8916, "random": 0.25}, {"track": "10-choice", "raw": 0.8143, "random": 0.1}], "combined": 0.7661, "private_eq": 0.8084} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · GSM8K · 4-choice | 89.16% | Setup & sourceHF text 0.4 · GSM8K · 4-choice Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published separate track; sample count unspecified. {"track": "4-choice", "raw": 0.8916, "random": 0.25} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · GSM8K · 10-choice | 81.43% | Setup & sourceHF text 0.4 · GSM8K · 10-choice Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published separate track; sample count unspecified. {"track": "10-choice", "raw": 0.8143, "random": 0.1} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · ChessBench · accuracy | 25.12% | Setup & sourceHF text 0.4 · ChessBench · accuracy Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Native source result: {"score": 0.2512, "jev": null, "metric": "accuracy", "requests": 5000, "answered": 5000, "unsupported": 0, "errors": 0, "median_ms": 187}. Benchmark contract: {"id": 31, "dataset": "ChessBench", "short": "ChessBench", "metric": "accuracy", "explainer": "Given a chess position and every legal move, picks the strongest one; tied best moves count.", "baseline": {"value": 0.0819, "label": "Uniform random choice"}, "lower": false, "range": null, "cases": 5000, "group": "knowledge", "in_suite": true, "interactive": false, "references": [{"kind": "paper", "url": "https://arxiv.org/abs/2402.04494"}, {"kind": "code", "url": "https://github.com/google-deepmind/searchless_chess"}], "private": true} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 5000 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · ChessBench · median_ms | 187.00 ms | Setup & sourceHF text 0.4 · ChessBench · median_ms Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published measured timing; excludes null and zero batch placeholders. Median and p95 over the timed rows that returned an answer; per-benchmark medians are shown only where the sample holds at least 5 rows of that benchmark. A bootstrap on the full single-process runs of ten entrants put the sample median within 5% and the p95 within 10% of a full run at 95% confidence. Earlier board figures came from the scoring runs, some timed with 6 to 12 processes sharing a card or with queue waits removed; they are no longer shown. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · ChessBench · Raw index component | 25.12 | Setup & sourceHF text 0.4 · ChessBench · Raw index component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.2512, "skill": 0.1844, "coverage": 1, "random": 0.0819, "tracks": [], "combined": 0.0702, "private_eq": 0.1552} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 5000 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · ChessBench · Chance-corrected public skill | 18.44 | Setup & sourceHF text 0.4 · ChessBench · Chance-corrected public skill Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.2512, "skill": 0.1844, "coverage": 1, "random": 0.0819, "tracks": [], "combined": 0.0702, "private_eq": 0.1552} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 5000 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · ChessBench · Combined public/private component | 7.02 | Setup & sourceHF text 0.4 · ChessBench · Combined public/private component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.2512, "skill": 0.1844, "coverage": 1, "random": 0.0819, "tracks": [], "combined": 0.0702, "private_eq": 0.1552} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · ChessBench · Equated private same-skill component | 15.52 | Setup & sourceHF text 0.4 · ChessBench · Equated private same-skill component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.2512, "skill": 0.1844, "coverage": 1, "random": 0.0819, "tracks": [], "combined": 0.0702, "private_eq": 0.1552} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · MuSR · accuracy | 76.20% | Setup & sourceHF text 0.4 · MuSR · accuracy Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Native source result: {"score": 0.762, "jev": null, "metric": "accuracy", "requests": 752, "answered": 752, "unsupported": 0, "errors": 0, "median_ms": 191.6}. Benchmark contract: {"id": 32, "dataset": "MuSR", "short": "MuSR", "metric": "accuracy", "explainer": "Reads a long story and answers one question needing clues from across it, e.g. who the murderer is.", "baseline": {"value": 0.371, "label": "Uniform random choice"}, "lower": false, "range": null, "cases": 752, "group": "knowledge", "in_suite": true, "interactive": false, "references": [{"kind": "paper", "url": "https://arxiv.org/abs/2310.16049"}, {"kind": "dataset", "url": "https://github.com/Zayne-sprague/MuSR"}], "private": true} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 752 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · MuSR · median_ms | 191.60 ms | Setup & sourceHF text 0.4 · MuSR · median_ms Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published measured timing; excludes null and zero batch placeholders. Median and p95 over the timed rows that returned an answer; per-benchmark medians are shown only where the sample holds at least 5 rows of that benchmark. A bootstrap on the full single-process runs of ten entrants put the sample median within 5% and the p95 within 10% of a full run at 95% confidence. Earlier board figures came from the scoring runs, some timed with 6 to 12 processes sharing a card or with queue waits removed; they are no longer shown. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · MuSR · Raw index component | 76.20 | Setup & sourceHF text 0.4 · MuSR · Raw index component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.762, "skill": 0.6216, "coverage": 1, "random": 0.371, "tracks": [], "combined": 0.4054, "private_eq": 0.6296} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 752 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · MuSR · Chance-corrected public skill | 62.16 | Setup & sourceHF text 0.4 · MuSR · Chance-corrected public skill Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.762, "skill": 0.6216, "coverage": 1, "random": 0.371, "tracks": [], "combined": 0.4054, "private_eq": 0.6296} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 752 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · MuSR · Combined public/private component | 40.54 | Setup & sourceHF text 0.4 · MuSR · Combined public/private component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.762, "skill": 0.6216, "coverage": 1, "random": 0.371, "tracks": [], "combined": 0.4054, "private_eq": 0.6296} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · MuSR · Equated private same-skill component | 62.96 | Setup & sourceHF text 0.4 · MuSR · Equated private same-skill component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.762, "skill": 0.6216, "coverage": 1, "random": 0.371, "tracks": [], "combined": 0.4054, "private_eq": 0.6296} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · SATA-Bench · case exact accuracy | 44.91% | Setup & sourceHF text 0.4 · SATA-Bench · case exact accuracy Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Native source result: {"score": 0.4491, "jev": null, "metric": "case exact accuracy", "requests": 1650, "answered": 1650, "unsupported": 0, "errors": 0, "median_ms": 681}. Benchmark contract: {"id": 33, "dataset": "SATA-Bench", "short": "SATA-Bench", "metric": "case exact accuracy", "explainer": "Given a passage, a question and candidate answers, says yes or no to each; all must be right.", "baseline": {"value": 0.0131, "label": "Random whole-case guesses"}, "lower": false, "range": null, "cases": 1650, "group": "knowledge", "in_suite": true, "interactive": false, "references": [{"kind": "dataset", "url": "https://github.com/sata-bench/sata-bench"}], "private": true} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 1650 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · SATA-Bench · median_ms | 681.00 ms | Setup & sourceHF text 0.4 · SATA-Bench · median_ms Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published measured timing; excludes null and zero batch placeholders. Median and p95 over the timed rows that returned an answer; per-benchmark medians are shown only where the sample holds at least 5 rows of that benchmark. A bootstrap on the full single-process runs of ten entrants put the sample median within 5% and the p95 within 10% of a full run at 95% confidence. Earlier board figures came from the scoring runs, some timed with 6 to 12 processes sharing a card or with queue waits removed; they are no longer shown. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · SATA-Bench · Raw index component | 44.91 | Setup & sourceHF text 0.4 · SATA-Bench · Raw index component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native case exact accuracy. Source normalization: {"raw": 0.4491, "skill": 0.4418, "coverage": 1, "random": 0.0131, "tracks": [], "combined": 0.4154, "private_eq": 0.4286} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 1650 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · SATA-Bench · Chance-corrected public skill | 44.18 | Setup & sourceHF text 0.4 · SATA-Bench · Chance-corrected public skill Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native case exact accuracy. Source normalization: {"raw": 0.4491, "skill": 0.4418, "coverage": 1, "random": 0.0131, "tracks": [], "combined": 0.4154, "private_eq": 0.4286} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 1650 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · SATA-Bench · Combined public/private component | 41.54 | Setup & sourceHF text 0.4 · SATA-Bench · Combined public/private component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native case exact accuracy. Source normalization: {"raw": 0.4491, "skill": 0.4418, "coverage": 1, "random": 0.0131, "tracks": [], "combined": 0.4154, "private_eq": 0.4286} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · SATA-Bench · Equated private same-skill component | 42.86 | Setup & sourceHF text 0.4 · SATA-Bench · Equated private same-skill component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native case exact accuracy. Source normalization: {"raw": 0.4491, "skill": 0.4418, "coverage": 1, "random": 0.0131, "tracks": [], "combined": 0.4154, "private_eq": 0.4286} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · BRIGHT · nDCG@10 | 48.56% | Setup & sourceHF text 0.4 · BRIGHT · nDCG@10 Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Native source result: {"score": 0.4856, "jev": null, "metric": "nDCG@10", "requests": 220, "answered": 220, "unsupported": 0, "errors": 0, "median_ms": 4497}. Benchmark contract: {"id": 36, "dataset": "BRIGHT", "short": "BRIGHT", "metric": "nDCG@10", "explainer": "Rates how helpful each of 32 search-hit documents is for a hard question; ranked by nDCG@10, on questions where at least one of the 32 is relevant.", "baseline": {"value": 0.116, "label": "Random ranking, answerable queries", "previous": 0.0448}, "lower": false, "range": null, "cases": 220, "group": "retrieval", "in_suite": true, "interactive": false, "references": [{"kind": "paper", "url": "https://arxiv.org/abs/2407.12883"}, {"kind": "dataset", "url": "https://huggingface.co/datasets/xlangai/BRIGHT"}], "gold": 1.2, "private": true} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 220 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · BRIGHT · median_ms | 4497.00 ms | Setup & sourceHF text 0.4 · BRIGHT · median_ms Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published measured timing; excludes null and zero batch placeholders. Median and p95 over the timed rows that returned an answer; per-benchmark medians are shown only where the sample holds at least 5 rows of that benchmark. A bootstrap on the full single-process runs of ten entrants put the sample median within 5% and the p95 within 10% of a full run at 95% confidence. Earlier board figures came from the scoring runs, some timed with 6 to 12 processes sharing a card or with queue waits removed; they are no longer shown. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · BRIGHT · Raw index component | 48.56 | Setup & sourceHF text 0.4 · BRIGHT · Raw index component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native nDCG@10. Source normalization: {"raw": 0.4856, "skill": 0.4181, "coverage": 1, "random": 0.116, "tracks": [], "combined": 0.4226, "private_eq": 0.4945} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 220 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · BRIGHT · Chance-corrected public skill | 41.81 | Setup & sourceHF text 0.4 · BRIGHT · Chance-corrected public skill Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native nDCG@10. Source normalization: {"raw": 0.4856, "skill": 0.4181, "coverage": 1, "random": 0.116, "tracks": [], "combined": 0.4226, "private_eq": 0.4945} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 220 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · BRIGHT · Combined public/private component | 42.26 | Setup & sourceHF text 0.4 · BRIGHT · Combined public/private component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native nDCG@10. Source normalization: {"raw": 0.4856, "skill": 0.4181, "coverage": 1, "random": 0.116, "tracks": [], "combined": 0.4226, "private_eq": 0.4945} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · BRIGHT · Equated private same-skill component | 49.45 | Setup & sourceHF text 0.4 · BRIGHT · Equated private same-skill component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native nDCG@10. Source normalization: {"raw": 0.4856, "skill": 0.4181, "coverage": 1, "random": 0.116, "tracks": [], "combined": 0.4226, "private_eq": 0.4945} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · Amazon ESCI · macro-F1 | 61.45% | Setup & sourceHF text 0.4 · Amazon ESCI · macro-F1 Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Native source result: {"score": 0.6145, "jev": null, "metric": "macro-F1", "requests": 5000, "answered": 5000, "unsupported": 0, "errors": 0, "median_ms": 85.5}. Benchmark contract: {"id": 37, "dataset": "Amazon ESCI", "short": "Amazon ESCI", "metric": "macro-F1", "explainer": "Labels a product as an exact match, substitute, complement or irrelevant to a shopping query.", "baseline": {"value": 0.2027, "label": "Random choices · F1"}, "lower": false, "range": null, "cases": 5000, "group": "retrieval", "in_suite": true, "interactive": false, "references": [{"kind": "dataset", "url": "https://github.com/amazon-science/esci-data"}], "private": true} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 5000 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · Amazon ESCI · median_ms | 85.50 ms | Setup & sourceHF text 0.4 · Amazon ESCI · median_ms Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published measured timing; excludes null and zero batch placeholders. Median and p95 over the timed rows that returned an answer; per-benchmark medians are shown only where the sample holds at least 5 rows of that benchmark. A bootstrap on the full single-process runs of ten entrants put the sample median within 5% and the p95 within 10% of a full run at 95% confidence. Earlier board figures came from the scoring runs, some timed with 6 to 12 processes sharing a card or with queue waits removed; they are no longer shown. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · Amazon ESCI · Raw index component | 61.45 | Setup & sourceHF text 0.4 · Amazon ESCI · Raw index component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native macro-F1. Source normalization: {"raw": 0.6145, "skill": 0.5164, "coverage": 1, "random": 0.2027, "tracks": [], "combined": 0.6477, "private_eq": 0.7215} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 5000 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · Amazon ESCI · Chance-corrected public skill | 51.64 | Setup & sourceHF text 0.4 · Amazon ESCI · Chance-corrected public skill Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native macro-F1. Source normalization: {"raw": 0.6145, "skill": 0.5164, "coverage": 1, "random": 0.2027, "tracks": [], "combined": 0.6477, "private_eq": 0.7215} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 5000 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · Amazon ESCI · Combined public/private component | 64.77 | Setup & sourceHF text 0.4 · Amazon ESCI · Combined public/private component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native macro-F1. Source normalization: {"raw": 0.6145, "skill": 0.5164, "coverage": 1, "random": 0.2027, "tracks": [], "combined": 0.6477, "private_eq": 0.7215} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · Amazon ESCI · Equated private same-skill component | 72.15 | Setup & sourceHF text 0.4 · Amazon ESCI · Equated private same-skill component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native macro-F1. Source normalization: {"raw": 0.6145, "skill": 0.5164, "coverage": 1, "random": 0.2027, "tracks": [], "combined": 0.6477, "private_eq": 0.7215} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · ACOS · per-review F1 | 62.82% | Setup & sourceHF text 0.4 · ACOS · per-review F1 Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Native source result: {"score": 0.6282, "jev": null, "metric": "per-review F1", "requests": 1565, "answered": 1565, "unsupported": 0, "errors": 0, "median_ms": 1974.4}. Benchmark contract: {"id": 38, "dataset": "ACOS", "short": "ACOS", "metric": "per-review F1", "explainer": "Reads a restaurant or laptop review and says yes/no for each aspect-and-sentiment pair; scored by F1 per review, averaged over reviews.", "baseline": {"value": 0.031, "label": "Always yes · per-review F1", "previous": 0}, "lower": false, "range": null, "cases": 400, "group": "language", "in_suite": true, "interactive": false, "references": [{"kind": "paper", "url": "https://aclanthology.org/2021.acl-long.29"}, {"kind": "dataset", "url": "https://github.com/NUSTM/ACOS"}], "private": true} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 1565 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · ACOS · median_ms | 1974.40 ms | Setup & sourceHF text 0.4 · ACOS · median_ms Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published measured timing; excludes null and zero batch placeholders. Median and p95 over the timed rows that returned an answer; per-benchmark medians are shown only where the sample holds at least 5 rows of that benchmark. A bootstrap on the full single-process runs of ten entrants put the sample median within 5% and the p95 within 10% of a full run at 95% confidence. Earlier board figures came from the scoring runs, some timed with 6 to 12 processes sharing a card or with queue waits removed; they are no longer shown. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · ACOS · Raw index component | 62.82 | Setup & sourceHF text 0.4 · ACOS · Raw index component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native per-review F1. Source normalization: {"raw": 0.6282, "skill": 0.6163, "coverage": 1, "random": 0.031, "tracks": [], "combined": 0.7548, "private_eq": 0.7641} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 1565 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · ACOS · Chance-corrected public skill | 61.63 | Setup & sourceHF text 0.4 · ACOS · Chance-corrected public skill Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native per-review F1. Source normalization: {"raw": 0.6282, "skill": 0.6163, "coverage": 1, "random": 0.031, "tracks": [], "combined": 0.7548, "private_eq": 0.7641} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 1565 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · ACOS · Combined public/private component | 75.48 | Setup & sourceHF text 0.4 · ACOS · Combined public/private component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native per-review F1. Source normalization: {"raw": 0.6282, "skill": 0.6163, "coverage": 1, "random": 0.031, "tracks": [], "combined": 0.7548, "private_eq": 0.7641} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · ACOS · Equated private same-skill component | 76.41 | Setup & sourceHF text 0.4 · ACOS · Equated private same-skill component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native per-review F1. Source normalization: {"raw": 0.6282, "skill": 0.6163, "coverage": 1, "random": 0.031, "tracks": [], "combined": 0.7548, "private_eq": 0.7641} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · FinEntity · macro-F1 | 94.26% | Setup & sourceHF text 0.4 · FinEntity · macro-F1 Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Native source result: {"score": 0.9426, "jev": null, "metric": "macro-F1", "requests": 979, "answered": 979, "unsupported": 0, "errors": 0, "median_ms": 83.4}. Benchmark contract: {"id": 39, "dataset": "FinEntity", "short": "FinEntity", "metric": "macro-F1", "explainer": "Says whether a financial news snippet is positive, negative or neutral about a named firm.", "baseline": {"value": 0.3201, "label": "Random choices · F1"}, "lower": false, "range": null, "cases": 979, "group": "language", "in_suite": true, "interactive": false, "references": [{"kind": "paper", "url": "https://aclanthology.org/2023.emnlp-main.956"}, {"kind": "dataset", "url": "https://github.com/yixuantt/FinEntity"}], "private": true} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 979 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · FinEntity · median_ms | 83.40 ms | Setup & sourceHF text 0.4 · FinEntity · median_ms Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published measured timing; excludes null and zero batch placeholders. Median and p95 over the timed rows that returned an answer; per-benchmark medians are shown only where the sample holds at least 5 rows of that benchmark. A bootstrap on the full single-process runs of ten entrants put the sample median within 5% and the p95 within 10% of a full run at 95% confidence. Earlier board figures came from the scoring runs, some timed with 6 to 12 processes sharing a card or with queue waits removed; they are no longer shown. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · FinEntity · Raw index component | 94.26 | Setup & sourceHF text 0.4 · FinEntity · Raw index component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native macro-F1. Source normalization: {"raw": 0.9426, "skill": 0.9156, "coverage": 1, "random": 0.3201, "tracks": [], "combined": 0.5803, "private_eq": 0.7172} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 979 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · FinEntity · Chance-corrected public skill | 91.56 | Setup & sourceHF text 0.4 · FinEntity · Chance-corrected public skill Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native macro-F1. Source normalization: {"raw": 0.9426, "skill": 0.9156, "coverage": 1, "random": 0.3201, "tracks": [], "combined": 0.5803, "private_eq": 0.7172} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 979 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · FinEntity · Combined public/private component | 58.03 | Setup & sourceHF text 0.4 · FinEntity · Combined public/private component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native macro-F1. Source normalization: {"raw": 0.9426, "skill": 0.9156, "coverage": 1, "random": 0.3201, "tracks": [], "combined": 0.5803, "private_eq": 0.7172} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · FinEntity · Equated private same-skill component | 71.72 | Setup & sourceHF text 0.4 · FinEntity · Equated private same-skill component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native macro-F1. Source normalization: {"raw": 0.9426, "skill": 0.9156, "coverage": 1, "random": 0.3201, "tracks": [], "combined": 0.5803, "private_eq": 0.7172} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · iSarcasmEval · Sarcasm F1 · track A, English | 69.43% | Setup & sourceHF text 0.4 · iSarcasmEval · Sarcasm F1 · track A, English Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Native source result: {"score": 0.6943, "jev": null, "metric": "Sarcasm F1 \u00b7 track A, English", "requests": 4600, "answered": 4600, "unsupported": 0, "errors": 0, "median_ms": 54.9}. Benchmark contract: {"id": 40, "dataset": "iSarcasmEval", "short": "iSarcasmEval", "metric": "Sarcasm F1 · track A, English", "explainer": "Says yes or no: is this tweet sarcastic? Scored with F1 on sarcastic English tweets (track A); other tracks listed under each result.", "baseline": {"value": 0.2227, "label": "Random choices · F1"}, "lower": false, "range": null, "cases": 4600, "group": "language", "in_suite": true, "interactive": false, "references": [{"kind": "paper", "url": "https://aclanthology.org/2022.semeval-1.111"}, {"kind": "dataset", "url": "https://github.com/iabufarha/iSarcasmEval"}], "private": true} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 4600 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · iSarcasmEval · median_ms | 54.90 ms | Setup & sourceHF text 0.4 · iSarcasmEval · median_ms Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published measured timing; excludes null and zero batch placeholders. Median and p95 over the timed rows that returned an answer; per-benchmark medians are shown only where the sample holds at least 5 rows of that benchmark. A bootstrap on the full single-process runs of ten entrants put the sample median within 5% and the p95 within 10% of a full run at 95% confidence. Earlier board figures came from the scoring runs, some timed with 6 to 12 processes sharing a card or with queue waits removed; they are no longer shown. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · iSarcasmEval · Raw index component | 69.43 | Setup & sourceHF text 0.4 · iSarcasmEval · Raw index component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native Sarcasm F1 · track A, English. Source normalization: {"raw": 0.6943, "skill": 0.6067, "coverage": 1, "random": 0.2227, "tracks": [{"track": "A · Arabic", "score": 0.4857, "headline": false}, {"track": "A · English", "score": 0.6943, "headline": true}, {"track": "C · Arabic pairs", "score": 0.95, "headline": false}, {"track": "C · English pairs", "score": 0.98, "headline": false}], "combined": 0.5795, "private_eq": 0.6761} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 4600 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · iSarcasmEval · Chance-corrected public skill | 60.67 | Setup & sourceHF text 0.4 · iSarcasmEval · Chance-corrected public skill Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native Sarcasm F1 · track A, English. Source normalization: {"raw": 0.6943, "skill": 0.6067, "coverage": 1, "random": 0.2227, "tracks": [{"track": "A · Arabic", "score": 0.4857, "headline": false}, {"track": "A · English", "score": 0.6943, "headline": true}, {"track": "C · Arabic pairs", "score": 0.95, "headline": false}, {"track": "C · English pairs", "score": 0.98, "headline": false}], "combined": 0.5795, "private_eq": 0.6761} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 4600 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · iSarcasmEval · Combined public/private component | 57.95 | Setup & sourceHF text 0.4 · iSarcasmEval · Combined public/private component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native Sarcasm F1 · track A, English. Source normalization: {"raw": 0.6943, "skill": 0.6067, "coverage": 1, "random": 0.2227, "tracks": [{"track": "A · Arabic", "score": 0.4857, "headline": false}, {"track": "A · English", "score": 0.6943, "headline": true}, {"track": "C · Arabic pairs", "score": 0.95, "headline": false}, {"track": "C · English pairs", "score": 0.98, "headline": false}], "combined": 0.5795, "private_eq": 0.6761} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · iSarcasmEval · Equated private same-skill component | 67.61 | Setup & sourceHF text 0.4 · iSarcasmEval · Equated private same-skill component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native Sarcasm F1 · track A, English. Source normalization: {"raw": 0.6943, "skill": 0.6067, "coverage": 1, "random": 0.2227, "tracks": [{"track": "A · Arabic", "score": 0.4857, "headline": false}, {"track": "A · English", "score": 0.6943, "headline": true}, {"track": "C · Arabic pairs", "score": 0.95, "headline": false}, {"track": "C · English pairs", "score": 0.98, "headline": false}], "combined": 0.5795, "private_eq": 0.6761} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · iSarcasmEval · A · Arabic | 48.57% | Setup & sourceHF text 0.4 · iSarcasmEval · A · Arabic Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published separate track; sample count unspecified. {"track": "A · Arabic", "score": 0.4857, "headline": false} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · iSarcasmEval · C · Arabic pairs | 95.00% | Setup & sourceHF text 0.4 · iSarcasmEval · C · Arabic pairs Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published separate track; sample count unspecified. {"track": "C · Arabic pairs", "score": 0.95, "headline": false} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · iSarcasmEval · C · English pairs | 98.00% | Setup & sourceHF text 0.4 · iSarcasmEval · C · English pairs Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published separate track; sample count unspecified. {"track": "C · English pairs", "score": 0.98, "headline": false} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · VAST · macro-F1 | 80.76% | Setup & sourceHF text 0.4 · VAST · macro-F1 Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Native source result: {"score": 0.8076, "jev": null, "metric": "macro-F1", "requests": 3006, "answered": 3006, "unsupported": 0, "errors": 0, "median_ms": 65.4}. Benchmark contract: {"id": 41, "dataset": "VAST", "short": "VAST", "metric": "macro-F1", "explainer": "Says whether a comment is for, against, or neutral on a given topic.", "baseline": {"value": 0.3333, "label": "Random choices · F1"}, "lower": false, "range": null, "cases": 3006, "group": "language", "in_suite": true, "interactive": false, "references": [{"kind": "dataset", "url": "https://github.com/emilyallaway/zero-shot-stance"}], "private": true} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 3006 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · VAST · median_ms | 65.40 ms | Setup & sourceHF text 0.4 · VAST · median_ms Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published measured timing; excludes null and zero batch placeholders. Median and p95 over the timed rows that returned an answer; per-benchmark medians are shown only where the sample holds at least 5 rows of that benchmark. A bootstrap on the full single-process runs of ten entrants put the sample median within 5% and the p95 within 10% of a full run at 95% confidence. Earlier board figures came from the scoring runs, some timed with 6 to 12 processes sharing a card or with queue waits removed; they are no longer shown. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · VAST · Raw index component | 80.76 | Setup & sourceHF text 0.4 · VAST · Raw index component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native macro-F1. Source normalization: {"raw": 0.8076, "skill": 0.7115, "coverage": 1, "random": 0.3333, "tracks": [], "combined": 0.4952, "private_eq": 0.6666} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 3006 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · VAST · Chance-corrected public skill | 71.15 | Setup & sourceHF text 0.4 · VAST · Chance-corrected public skill Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native macro-F1. Source normalization: {"raw": 0.8076, "skill": 0.7115, "coverage": 1, "random": 0.3333, "tracks": [], "combined": 0.4952, "private_eq": 0.6666} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 3006 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · VAST · Combined public/private component | 49.52 | Setup & sourceHF text 0.4 · VAST · Combined public/private component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native macro-F1. Source normalization: {"raw": 0.8076, "skill": 0.7115, "coverage": 1, "random": 0.3333, "tracks": [], "combined": 0.4952, "private_eq": 0.6666} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · VAST · Equated private same-skill component | 66.66 | Setup & sourceHF text 0.4 · VAST · Equated private same-skill component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native macro-F1. Source normalization: {"raw": 0.8076, "skill": 0.7115, "coverage": 1, "random": 0.3333, "tracks": [], "combined": 0.4952, "private_eq": 0.6666} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · NLI4CT · macro-F1 | 87.20% | Setup & sourceHF text 0.4 · NLI4CT · macro-F1 Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Native source result: {"score": 0.872, "jev": null, "metric": "macro-F1", "requests": 5500, "answered": 5500, "unsupported": 0, "errors": 0, "median_ms": 119.9}. Benchmark contract: {"id": 42, "dataset": "NLI4CT", "short": "NLI4CT", "metric": "macro-F1", "explainer": "Says whether clinical-trial report sections support or contradict a statement, some deliberately altered.", "baseline": {"value": 0.486, "label": "Random choices · F1"}, "lower": false, "range": null, "cases": 5500, "group": "language", "in_suite": true, "interactive": false, "references": [{"kind": "dataset", "url": "https://github.com/ai-systems/Task-2-SemEval-2024"}], "private": true} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 5500 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · NLI4CT · median_ms | 119.90 ms | Setup & sourceHF text 0.4 · NLI4CT · median_ms Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published measured timing; excludes null and zero batch placeholders. Median and p95 over the timed rows that returned an answer; per-benchmark medians are shown only where the sample holds at least 5 rows of that benchmark. A bootstrap on the full single-process runs of ten entrants put the sample median within 5% and the p95 within 10% of a full run at 95% confidence. Earlier board figures came from the scoring runs, some timed with 6 to 12 processes sharing a card or with queue waits removed; they are no longer shown. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · NLI4CT · Raw index component | 87.20 | Setup & sourceHF text 0.4 · NLI4CT · Raw index component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native macro-F1. Source normalization: {"raw": 0.872, "skill": 0.751, "coverage": 1, "random": 0.486, "tracks": [], "combined": 0.9955, "private_eq": 0.9972} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 5500 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · NLI4CT · Chance-corrected public skill | 75.10 | Setup & sourceHF text 0.4 · NLI4CT · Chance-corrected public skill Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native macro-F1. Source normalization: {"raw": 0.872, "skill": 0.751, "coverage": 1, "random": 0.486, "tracks": [], "combined": 0.9955, "private_eq": 0.9972} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 5500 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · NLI4CT · Combined public/private component | 99.55 | Setup & sourceHF text 0.4 · NLI4CT · Combined public/private component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native macro-F1. Source normalization: {"raw": 0.872, "skill": 0.751, "coverage": 1, "random": 0.486, "tracks": [], "combined": 0.9955, "private_eq": 0.9972} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · NLI4CT · Equated private same-skill component | 99.72 | Setup & sourceHF text 0.4 · NLI4CT · Equated private same-skill component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native macro-F1. Source normalization: {"raw": 0.872, "skill": 0.751, "coverage": 1, "random": 0.486, "tracks": [], "combined": 0.9955, "private_eq": 0.9972} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · CRUXEval · accuracy | 83.16% | Setup & sourceHF text 0.4 · CRUXEval · accuracy Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Native source result: {"score": 0.8316, "jev": null, "metric": "accuracy", "requests": 570, "answered": 570, "unsupported": 0, "errors": 0, "median_ms": 64.8}. Benchmark contract: {"id": 43, "dataset": "CRUXEval", "short": "CRUXEval", "metric": "accuracy", "explainer": "Reads a short Python function and an input and picks its output from 2 to 10 candidates, without running it.", "baseline": {"value": 0.3697, "label": "Uniform random choice"}, "lower": false, "range": null, "cases": 570, "group": "knowledge", "in_suite": true, "interactive": false, "references": [{"kind": "paper", "url": "https://arxiv.org/abs/2401.03065"}, {"kind": "dataset", "url": "https://github.com/facebookresearch/cruxeval"}], "private": true} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 570 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · CRUXEval · median_ms | 64.80 ms | Setup & sourceHF text 0.4 · CRUXEval · median_ms Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published measured timing; excludes null and zero batch placeholders. Median and p95 over the timed rows that returned an answer; per-benchmark medians are shown only where the sample holds at least 5 rows of that benchmark. A bootstrap on the full single-process runs of ten entrants put the sample median within 5% and the p95 within 10% of a full run at 95% confidence. Earlier board figures came from the scoring runs, some timed with 6 to 12 processes sharing a card or with queue waits removed; they are no longer shown. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · CRUXEval · Raw index component | 83.16 | Setup & sourceHF text 0.4 · CRUXEval · Raw index component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.8316, "skill": 0.7328, "coverage": 1, "random": 0.3697, "tracks": [], "combined": 0.8169, "private_eq": 0.8853} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 570 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · CRUXEval · Chance-corrected public skill | 73.28 | Setup & sourceHF text 0.4 · CRUXEval · Chance-corrected public skill Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.8316, "skill": 0.7328, "coverage": 1, "random": 0.3697, "tracks": [], "combined": 0.8169, "private_eq": 0.8853} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 570 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · CRUXEval · Combined public/private component | 81.69 | Setup & sourceHF text 0.4 · CRUXEval · Combined public/private component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.8316, "skill": 0.7328, "coverage": 1, "random": 0.3697, "tracks": [], "combined": 0.8169, "private_eq": 0.8853} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · CRUXEval · Equated private same-skill component | 88.53 | Setup & sourceHF text 0.4 · CRUXEval · Equated private same-skill component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.8316, "skill": 0.7328, "coverage": 1, "random": 0.3697, "tracks": [], "combined": 0.8169, "private_eq": 0.8853} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · CLadder · accuracy | 92.86% | Setup & sourceHF text 0.4 · CLadder · accuracy Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Native source result: {"score": 0.9286, "jev": null, "metric": "accuracy", "requests": 5000, "answered": 5000, "unsupported": 0, "errors": 0, "median_ms": 64.1}. Benchmark contract: {"id": 44, "dataset": "CLadder", "short": "CLadder", "metric": "accuracy", "explainer": "Answers a yes/no question about cause and effect in a small made-up world with stated probabilities.", "baseline": {"value": 0.5, "label": "Uniform random choice"}, "lower": false, "range": null, "cases": 5000, "group": "knowledge", "in_suite": true, "interactive": false, "references": [{"kind": "paper", "url": "https://arxiv.org/abs/2312.04350"}, {"kind": "dataset", "url": "https://github.com/causalNLP/cladder"}], "private": true} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 5000 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · CLadder · median_ms | 64.10 ms | Setup & sourceHF text 0.4 · CLadder · median_ms Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published measured timing; excludes null and zero batch placeholders. Median and p95 over the timed rows that returned an answer; per-benchmark medians are shown only where the sample holds at least 5 rows of that benchmark. A bootstrap on the full single-process runs of ten entrants put the sample median within 5% and the p95 within 10% of a full run at 95% confidence. Earlier board figures came from the scoring runs, some timed with 6 to 12 processes sharing a card or with queue waits removed; they are no longer shown. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · CLadder · Raw index component | 92.86 | Setup & sourceHF text 0.4 · CLadder · Raw index component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.9286, "skill": 0.8572, "coverage": 1, "random": 0.5, "tracks": [], "combined": 0.7708, "private_eq": 0.8862} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 5000 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · CLadder · Chance-corrected public skill | 85.72 | Setup & sourceHF text 0.4 · CLadder · Chance-corrected public skill Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.9286, "skill": 0.8572, "coverage": 1, "random": 0.5, "tracks": [], "combined": 0.7708, "private_eq": 0.8862} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 5000 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · CLadder · Combined public/private component | 77.08 | Setup & sourceHF text 0.4 · CLadder · Combined public/private component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.9286, "skill": 0.8572, "coverage": 1, "random": 0.5, "tracks": [], "combined": 0.7708, "private_eq": 0.8862} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · CLadder · Equated private same-skill component | 88.62 | Setup & sourceHF text 0.4 · CLadder · Equated private same-skill component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.9286, "skill": 0.8572, "coverage": 1, "random": 0.5, "tracks": [], "combined": 0.7708, "private_eq": 0.8862} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · HLE · accuracy | 18.16% | Setup & sourceHF text 0.4 · HLE · accuracy Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Native source result: {"score": 0.1816, "jev": null, "metric": "accuracy", "requests": 501, "answered": 501, "unsupported": 0, "errors": 0, "median_ms": 81}. Benchmark contract: {"id": 45, "dataset": "HLE", "short": "HLE", "metric": "accuracy", "explainer": "Expert-level multiple choice from Humanity's Last Exam, text-only questions, 5 to 26 options.", "baseline": {"value": 0.1641, "label": "Uniform random choice"}, "lower": false, "range": null, "cases": 501, "group": "knowledge", "in_suite": true, "interactive": false, "references": [{"kind": "dataset", "url": "https://huggingface.co/datasets/cais/hle"}], "gold": 1.2} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 501 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · HLE · median_ms | 81.00 ms | Setup & sourceHF text 0.4 · HLE · median_ms Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published measured timing; excludes null and zero batch placeholders. Median and p95 over the timed rows that returned an answer; per-benchmark medians are shown only where the sample holds at least 5 rows of that benchmark. A bootstrap on the full single-process runs of ten entrants put the sample median within 5% and the p95 within 10% of a full run at 95% confidence. Earlier board figures came from the scoring runs, some timed with 6 to 12 processes sharing a card or with queue waits removed; they are no longer shown. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · HLE · Raw index component | 18.16 | Setup & sourceHF text 0.4 · HLE · Raw index component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.1816, "skill": 0.0209, "coverage": 1, "random": 0.1641, "tracks": []} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 501 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · HLE · Chance-corrected public skill | 2.09 | Setup & sourceHF text 0.4 · HLE · Chance-corrected public skill Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.1816, "skill": 0.0209, "coverage": 1, "random": 0.1641, "tracks": []} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 501 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · Habermas Machine · accuracy | 64.44% | Setup & sourceHF text 0.4 · Habermas Machine · accuracy Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Native source result: {"score": 0.6444, "jev": null, "metric": "accuracy", "requests": 1676, "answered": 1676, "unsupported": 0, "errors": 0, "median_ms": 167.4}. Benchmark contract: {"id": 50, "dataset": "Habermas Machine", "short": "Habermas", "metric": "accuracy", "explainer": "Given a group's opinions on a policy question, predicts which candidate statement the group ranked highest.", "baseline": {"value": 0.311, "label": "Uniform random choice"}, "lower": false, "range": null, "cases": 1676, "group": "arts", "in_suite": true, "interactive": false, "references": [{"kind": "dataset", "url": "https://github.com/google-deepmind/habermas_machine"}], "private": true} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 1676 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · Habermas Machine · median_ms | 167.40 ms | Setup & sourceHF text 0.4 · Habermas Machine · median_ms Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published measured timing; excludes null and zero batch placeholders. Median and p95 over the timed rows that returned an answer; per-benchmark medians are shown only where the sample holds at least 5 rows of that benchmark. A bootstrap on the full single-process runs of ten entrants put the sample median within 5% and the p95 within 10% of a full run at 95% confidence. Earlier board figures came from the scoring runs, some timed with 6 to 12 processes sharing a card or with queue waits removed; they are no longer shown. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · Habermas Machine · Raw index component | 64.44 | Setup & sourceHF text 0.4 · Habermas Machine · Raw index component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.6444, "skill": 0.4839, "coverage": 1, "random": 0.311, "tracks": [], "combined": 0.3338, "private_eq": 0.5455} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 1676 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · Habermas Machine · Chance-corrected public skill | 48.39 | Setup & sourceHF text 0.4 · Habermas Machine · Chance-corrected public skill Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.6444, "skill": 0.4839, "coverage": 1, "random": 0.311, "tracks": [], "combined": 0.3338, "private_eq": 0.5455} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 1676 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · Habermas Machine · Combined public/private component | 33.38 | Setup & sourceHF text 0.4 · Habermas Machine · Combined public/private component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.6444, "skill": 0.4839, "coverage": 1, "random": 0.311, "tracks": [], "combined": 0.3338, "private_eq": 0.5455} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · Habermas Machine · Equated private same-skill component | 54.55 | Setup & sourceHF text 0.4 · Habermas Machine · Equated private same-skill component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.6444, "skill": 0.4839, "coverage": 1, "random": 0.311, "tracks": [], "combined": 0.3338, "private_eq": 0.5455} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · PhishNChips phishing decisions · accuracy | 85.85% | Setup & sourceHF text 0.4 · PhishNChips phishing decisions · accuracy Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Native source result: {"score": 0.8585, "jev": null, "metric": "accuracy", "requests": 2000, "answered": 2000, "unsupported": 0, "errors": 0, "median_ms": 459.7}. Benchmark contract: {"id": 56, "dataset": "PhishNChips phishing decisions", "short": "PhishNChips", "metric": "accuracy", "explainer": "Says whether an email and its link are phishing or legitimate.", "baseline": {"value": 0.5, "label": "uniform random choice, mean of 1/options"}, "lower": false, "range": null, "cases": 2000, "group": "retrieval", "in_suite": true, "interactive": false, "edition_added": "v0.2", "references": [{"kind": "dataset", "url": "https://huggingface.co/datasets/AreLit/PhishNChips"}, {"kind": "code", "url": "https://github.com/anisselbd/jev-phishing-bench"}], "private": true} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 2000 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · PhishNChips phishing decisions · median_ms | 459.70 ms | Setup & sourceHF text 0.4 · PhishNChips phishing decisions · median_ms Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published measured timing; excludes null and zero batch placeholders. Median and p95 over the timed rows that returned an answer; per-benchmark medians are shown only where the sample holds at least 5 rows of that benchmark. A bootstrap on the full single-process runs of ten entrants put the sample median within 5% and the p95 within 10% of a full run at 95% confidence. Earlier board figures came from the scoring runs, some timed with 6 to 12 processes sharing a card or with queue waits removed; they are no longer shown. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · PhishNChips phishing decisions · Raw index component | 85.85 | Setup & sourceHF text 0.4 · PhishNChips phishing decisions · Raw index component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.8585, "skill": 0.717, "coverage": 1, "random": 0.5, "tracks": [], "combined": 0.8626, "private_eq": 0.9316} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 2000 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · PhishNChips phishing decisions · Chance-corrected public skill | 71.70 | Setup & sourceHF text 0.4 · PhishNChips phishing decisions · Chance-corrected public skill Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.8585, "skill": 0.717, "coverage": 1, "random": 0.5, "tracks": [], "combined": 0.8626, "private_eq": 0.9316} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 2000 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · PhishNChips phishing decisions · Combined public/private component | 86.26 | Setup & sourceHF text 0.4 · PhishNChips phishing decisions · Combined public/private component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.8585, "skill": 0.717, "coverage": 1, "random": 0.5, "tracks": [], "combined": 0.8626, "private_eq": 0.9316} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · PhishNChips phishing decisions · Equated private same-skill component | 93.16 | Setup & sourceHF text 0.4 · PhishNChips phishing decisions · Equated private same-skill component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.8585, "skill": 0.717, "coverage": 1, "random": 0.5, "tracks": [], "combined": 0.8626, "private_eq": 0.9316} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · MMLU-Pro · accuracy | 78.04% | Setup & sourceHF text 0.4 · MMLU-Pro · accuracy Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Native source result: {"score": 0.7804, "jev": null, "metric": "accuracy", "requests": 12032, "answered": 12032, "unsupported": 0, "errors": 0, "median_ms": 67.8}. Benchmark contract: {"id": 57, "dataset": "MMLU-Pro", "short": "MMLU-Pro", "metric": "accuracy", "explainer": "Harder MMLU successor: questions across 14 subjects with up to ten options.", "baseline": {"value": 0.1109, "label": "uniform random choice, mean of 1/options"}, "lower": false, "range": null, "cases": 12032, "group": "knowledge", "in_suite": true, "interactive": false, "edition_added": "v0.2", "references": [{"kind": "paper", "url": "https://arxiv.org/abs/2406.01574"}, {"kind": "dataset", "url": "https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro"}], "gold": 1.2, "private": true} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 12032 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · MMLU-Pro · median_ms | 67.80 ms | Setup & sourceHF text 0.4 · MMLU-Pro · median_ms Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published measured timing; excludes null and zero batch placeholders. Median and p95 over the timed rows that returned an answer; per-benchmark medians are shown only where the sample holds at least 5 rows of that benchmark. A bootstrap on the full single-process runs of ten entrants put the sample median within 5% and the p95 within 10% of a full run at 95% confidence. Earlier board figures came from the scoring runs, some timed with 6 to 12 processes sharing a card or with queue waits removed; they are no longer shown. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · MMLU-Pro · Raw index component | 78.04 | Setup & sourceHF text 0.4 · MMLU-Pro · Raw index component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.7804, "skill": 0.753, "coverage": 1, "random": 0.1109, "tracks": [], "private_eq": 0.8995, "combined": 0.8867} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 12032 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · MMLU-Pro · Chance-corrected public skill | 75.30 | Setup & sourceHF text 0.4 · MMLU-Pro · Chance-corrected public skill Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.7804, "skill": 0.753, "coverage": 1, "random": 0.1109, "tracks": [], "private_eq": 0.8995, "combined": 0.8867} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 12032 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · MMLU-Pro · Combined public/private component | 88.67 | Setup & sourceHF text 0.4 · MMLU-Pro · Combined public/private component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.7804, "skill": 0.753, "coverage": 1, "random": 0.1109, "tracks": [], "private_eq": 0.8995, "combined": 0.8867} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · MMLU-Pro · Equated private same-skill component | 89.95 | Setup & sourceHF text 0.4 · MMLU-Pro · Equated private same-skill component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.7804, "skill": 0.753, "coverage": 1, "random": 0.1109, "tracks": [], "private_eq": 0.8995, "combined": 0.8867} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · BBH · accuracy | 92.99% | Setup & sourceHF text 0.4 · BBH · accuracy Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Native source result: {"score": 0.9299, "jev": null, "metric": "accuracy", "requests": 5507, "answered": 5507, "unsupported": 0, "errors": 0, "median_ms": 65.2}. Benchmark contract: {"id": 58, "dataset": "BBH", "short": "BBH", "metric": "accuracy", "explainer": "23 tricky reasoning tasks from BIG-Bench (logic, dates, tracking objects, fallacies), answered with no working.", "baseline": {"value": 0.3101, "label": "uniform random choice, mean of 1/options"}, "lower": false, "range": null, "cases": 5507, "group": "knowledge", "in_suite": true, "interactive": false, "edition_added": "v0.2", "references": [{"kind": "paper", "url": "https://arxiv.org/abs/2210.09261"}, {"kind": "dataset", "url": "https://github.com/suzgunmirac/BIG-Bench-Hard"}], "gold": 1.2, "private": true} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 5507 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · BBH · median_ms | 65.20 ms | Setup & sourceHF text 0.4 · BBH · median_ms Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published measured timing; excludes null and zero batch placeholders. Median and p95 over the timed rows that returned an answer; per-benchmark medians are shown only where the sample holds at least 5 rows of that benchmark. A bootstrap on the full single-process runs of ten entrants put the sample median within 5% and the p95 within 10% of a full run at 95% confidence. Earlier board figures came from the scoring runs, some timed with 6 to 12 processes sharing a card or with queue waits removed; they are no longer shown. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · BBH · Raw index component | 92.99 | Setup & sourceHF text 0.4 · BBH · Raw index component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.9299, "skill": 0.8984, "coverage": 1, "random": 0.3101, "tracks": [], "private_eq": 0.5199, "combined": 0.2971} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 5507 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · BBH · Chance-corrected public skill | 89.84 | Setup & sourceHF text 0.4 · BBH · Chance-corrected public skill Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.9299, "skill": 0.8984, "coverage": 1, "random": 0.3101, "tracks": [], "private_eq": 0.5199, "combined": 0.2971} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 5507 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · BBH · Combined public/private component | 29.71 | Setup & sourceHF text 0.4 · BBH · Combined public/private component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.9299, "skill": 0.8984, "coverage": 1, "random": 0.3101, "tracks": [], "private_eq": 0.5199, "combined": 0.2971} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · BBH · Equated private same-skill component | 51.99 | Setup & sourceHF text 0.4 · BBH · Equated private same-skill component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.9299, "skill": 0.8984, "coverage": 1, "random": 0.3101, "tracks": [], "private_eq": 0.5199, "combined": 0.2971} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · RAGTruth · F1 on hallucinated class | 85.62% | Setup & sourceHF text 0.4 · RAGTruth · F1 on hallucinated class Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Native source result: {"score": 0.8562, "jev": null, "metric": "F1 on hallucinated class", "requests": 2700, "answered": 2700, "unsupported": 0, "errors": 0, "median_ms": 162.7}. Benchmark contract: {"id": 59, "dataset": "RAGTruth", "short": "RAGTruth", "metric": "F1 on hallucinated class", "explainer": "Says yes or no: does an AI-written answer contain anything its source text doesn't support? Scored with F1.", "baseline": {"value": 0.5177, "label": "Always \"hallucinated\" · F1"}, "lower": false, "range": null, "cases": 2700, "group": "language", "in_suite": true, "interactive": false, "edition_added": "v0.2", "references": [{"kind": "dataset", "url": "https://github.com/ParticleMedia/RAGTruth"}], "private": true} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 2700 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · RAGTruth · median_ms | 162.70 ms | Setup & sourceHF text 0.4 · RAGTruth · median_ms Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published measured timing; excludes null and zero batch placeholders. Median and p95 over the timed rows that returned an answer; per-benchmark medians are shown only where the sample holds at least 5 rows of that benchmark. A bootstrap on the full single-process runs of ten entrants put the sample median within 5% and the p95 within 10% of a full run at 95% confidence. Earlier board figures came from the scoring runs, some timed with 6 to 12 processes sharing a card or with queue waits removed; they are no longer shown. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · RAGTruth · Raw index component | 85.62 | Setup & sourceHF text 0.4 · RAGTruth · Raw index component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native F1 on hallucinated class. Source normalization: {"raw": 0.8562, "skill": 0.7018, "coverage": 1, "random": 0.5177, "tracks": [], "combined": 0.2716, "private_eq": 0.6522} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 2700 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · RAGTruth · Chance-corrected public skill | 70.18 | Setup & sourceHF text 0.4 · RAGTruth · Chance-corrected public skill Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native F1 on hallucinated class. Source normalization: {"raw": 0.8562, "skill": 0.7018, "coverage": 1, "random": 0.5177, "tracks": [], "combined": 0.2716, "private_eq": 0.6522} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 2700 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · RAGTruth · Combined public/private component | 27.16 | Setup & sourceHF text 0.4 · RAGTruth · Combined public/private component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native F1 on hallucinated class. Source normalization: {"raw": 0.8562, "skill": 0.7018, "coverage": 1, "random": 0.5177, "tracks": [], "combined": 0.2716, "private_eq": 0.6522} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · RAGTruth · Equated private same-skill component | 65.22 | Setup & sourceHF text 0.4 · RAGTruth · Equated private same-skill component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native F1 on hallucinated class. Source normalization: {"raw": 0.8562, "skill": 0.7018, "coverage": 1, "random": 0.5177, "tracks": [], "combined": 0.2716, "private_eq": 0.6522} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · HoVer · accuracy | 88.98% | Setup & sourceHF text 0.4 · HoVer · accuracy Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Native source result: {"score": 0.8898, "jev": null, "metric": "accuracy", "requests": 4000, "answered": 4000, "unsupported": 0, "errors": 0, "median_ms": 101.3}. Benchmark contract: {"id": 61, "dataset": "HoVer", "short": "HoVer", "metric": "accuracy", "explainer": "Decides whether a claim linking two to four Wikipedia articles is supported by their introductions.", "baseline": {"value": 0.5, "label": "uniform random choice, mean of 1/options"}, "lower": false, "range": null, "cases": 4000, "group": "retrieval", "in_suite": true, "interactive": false, "edition_added": "v0.2", "references": [{"kind": "paper", "url": "https://arxiv.org/abs/2011.03088"}, {"kind": "dataset", "url": "https://github.com/hover-nlp/hover"}], "private": true} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 4000 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · HoVer · median_ms | 101.30 ms | Setup & sourceHF text 0.4 · HoVer · median_ms Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published measured timing; excludes null and zero batch placeholders. Median and p95 over the timed rows that returned an answer; per-benchmark medians are shown only where the sample holds at least 5 rows of that benchmark. A bootstrap on the full single-process runs of ten entrants put the sample median within 5% and the p95 within 10% of a full run at 95% confidence. Earlier board figures came from the scoring runs, some timed with 6 to 12 processes sharing a card or with queue waits removed; they are no longer shown. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · HoVer · Raw index component | 88.98 | Setup & sourceHF text 0.4 · HoVer · Raw index component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.8898, "skill": 0.7796, "coverage": 1, "random": 0.5, "tracks": [], "combined": 0.6834, "private_eq": 0.843} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 4000 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · HoVer · Chance-corrected public skill | 77.96 | Setup & sourceHF text 0.4 · HoVer · Chance-corrected public skill Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.8898, "skill": 0.7796, "coverage": 1, "random": 0.5, "tracks": [], "combined": 0.6834, "private_eq": 0.843} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 4000 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · HoVer · Combined public/private component | 68.34 | Setup & sourceHF text 0.4 · HoVer · Combined public/private component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.8898, "skill": 0.7796, "coverage": 1, "random": 0.5, "tracks": [], "combined": 0.6834, "private_eq": 0.843} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · HoVer · Equated private same-skill component | 84.30 | Setup & sourceHF text 0.4 · HoVer · Equated private same-skill component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.8898, "skill": 0.7796, "coverage": 1, "random": 0.5, "tracks": [], "combined": 0.6834, "private_eq": 0.843} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · When2Call · accuracy | 91.62% | Setup & sourceHF text 0.4 · When2Call · accuracy Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Native source result: {"score": 0.9162, "jev": null, "metric": "accuracy", "requests": 3652, "answered": 3652, "unsupported": 0, "errors": 0, "median_ms": 161}. Benchmark contract: {"id": 62, "dataset": "When2Call", "short": "When2Call", "metric": "accuracy", "explainer": "Given a question and an assistant's tools, picks the right move: answer, call a tool, ask for details, or decline.", "baseline": {"value": 0.25, "label": "uniform random choice, mean of 1/options"}, "lower": false, "range": null, "cases": 3652, "group": "tools", "in_suite": true, "interactive": false, "edition_added": "v0.2", "references": [{"kind": "paper", "url": "https://aclanthology.org/2025.naacl-long.174"}, {"kind": "dataset", "url": "https://huggingface.co/datasets/nvidia/When2Call"}], "private": true} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 3652 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · When2Call · median_ms | 161.00 ms | Setup & sourceHF text 0.4 · When2Call · median_ms Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published measured timing; excludes null and zero batch placeholders. Median and p95 over the timed rows that returned an answer; per-benchmark medians are shown only where the sample holds at least 5 rows of that benchmark. A bootstrap on the full single-process runs of ten entrants put the sample median within 5% and the p95 within 10% of a full run at 95% confidence. Earlier board figures came from the scoring runs, some timed with 6 to 12 processes sharing a card or with queue waits removed; they are no longer shown. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · When2Call · Raw index component | 91.62 | Setup & sourceHF text 0.4 · When2Call · Raw index component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.9162, "skill": 0.8883, "coverage": 1, "random": 0.25, "tracks": [], "combined": 0.693, "private_eq": 0.7716} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 3652 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · When2Call · Chance-corrected public skill | 88.83 | Setup & sourceHF text 0.4 · When2Call · Chance-corrected public skill Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.9162, "skill": 0.8883, "coverage": 1, "random": 0.25, "tracks": [], "combined": 0.693, "private_eq": 0.7716} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 3652 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · When2Call · Combined public/private component | 69.30 | Setup & sourceHF text 0.4 · When2Call · Combined public/private component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.9162, "skill": 0.8883, "coverage": 1, "random": 0.25, "tracks": [], "combined": 0.693, "private_eq": 0.7716} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · When2Call · Equated private same-skill component | 77.16 | Setup & sourceHF text 0.4 · When2Call · Equated private same-skill component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.9162, "skill": 0.8883, "coverage": 1, "random": 0.25, "tracks": [], "combined": 0.693, "private_eq": 0.7716} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · New Yorker · accuracy | 82.95% | Setup & sourceHF text 0.4 · New Yorker · accuracy Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Native source result: {"score": 0.8295, "jev": null, "metric": "accuracy", "requests": 528, "answered": 528, "unsupported": 0, "errors": 0, "median_ms": 66.8}. Benchmark contract: {"id": 64, "dataset": "New Yorker", "short": "New Yorker", "metric": "accuracy", "explainer": "Given a text description of a New Yorker cartoon, picks the caption written for it from five.", "baseline": {"value": 0.2, "label": "uniform random choice, mean of 1/options"}, "lower": false, "range": null, "cases": 528, "group": "arts", "in_suite": true, "interactive": false, "edition_added": "v0.2", "references": [{"kind": "paper", "url": "https://arxiv.org/abs/2209.06293"}, {"kind": "dataset", "url": "https://huggingface.co/datasets/jmhessel/newyorker_caption_contest"}], "private": true} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 528 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · New Yorker · median_ms | 66.80 ms | Setup & sourceHF text 0.4 · New Yorker · median_ms Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Published measured timing; excludes null and zero batch placeholders. Median and p95 over the timed rows that returned an answer; per-benchmark medians are shown only where the sample holds at least 5 rows of that benchmark. A bootstrap on the full single-process runs of ten entrants put the sample median within 5% and the p95 within 10% of a full run at 95% confidence. Earlier board figures came from the scoring runs, some timed with 6 to 12 processes sharing a card or with queue waits removed; they are no longer shown. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · New Yorker · Raw index component | 82.95 | Setup & sourceHF text 0.4 · New Yorker · Raw index component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.8295, "skill": 0.7869, "coverage": 1, "random": 0.2, "tracks": [], "combined": 0.778, "private_eq": 0.8236} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 528 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · New Yorker · Chance-corrected public skill | 78.69 | Setup & sourceHF text 0.4 · New Yorker · Chance-corrected public skill Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.8295, "skill": 0.7869, "coverage": 1, "random": 0.2, "tracks": [], "combined": 0.778, "private_eq": 0.8236} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 528 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · New Yorker · Combined public/private component | 77.80 | Setup & sourceHF text 0.4 · New Yorker · Combined public/private component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.8295, "skill": 0.7869, "coverage": 1, "random": 0.2, "tracks": [], "combined": 0.778, "private_eq": 0.8236} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF text 0.4 · New Yorker · Equated private same-skill component | 82.36 | Setup & sourceHF text 0.4 · New Yorker · Equated private same-skill component Exact source engine glide-v1.2; {"kind": "full fine-tune", "technique": "autoregressive", "technique_name": "autoregressive", "served_params": 27800000000, "params_estimated": false, "params_from_name": false, "trained_bytes": null, "model_url": "https://huggingface.co/fastino/GLiDE", "code_url": "https://huggingface.co/fastino/GLiDE/tree/main/glide", "base_model": "Qwen/Qwen3.8-27B", "base_url": "https://huggingface.co/Qwen/Qwen3.8-27B", "weights_repo": "fastino/GLiDE", "served_checkpoint": "a7e45896be7c96ba3354891da790c5ec99c30b6c", "weights_note": null, "org": {"id": "fastino", "name": "Fastino", "logo": "data/orgs/fastino.png"}, "pr": 255, "replaces": "decision-27b-ckpt-nothink", "new": true}. New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Decision Index 0.4.1 (release-v4), source generated 2026-10-29T14:04:16Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Source notes: New in the 2026-10-21 PR batch (PR #255). Replaces the earlier board entry decision-27b-ckpt-nothink (newer version of the same model). Submitted public 0.3 run adopted (kit rescore 71.99). Private tests run by the lab on one RTX PRO 6000 with the author's serving; decision agreement with the submitted rows 99.90% on 895 rows (bar 98.5%). Weights are public on the Hugging Face Hub (fastino-community license); the lab scored revision a7e4589. Author public-run adoption/execution status and private lab setup are disclosed in configuration; evaluator-published does not mean every public run was independently executed. Normalized/index component, not native accuracy. Source normalization: {"raw": 0.8295, "skill": 0.7869, "coverage": 1, "random": 0.2, "tracks": [], "combined": 0.778, "private_eq": 0.8236} The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF vision 0.4 · Public | 75.37 | Setup & sourceHF vision 0.4 · Public Exact source engine glide-v1.2; community vision 0.4. Board cap 1638400 pixels; effective 1.6 MP. Public vision benchmarks run by the lab; there is no submitted vision run. Community Decision Index vision 0.4; 50% public + 50% private, separate from text Full (60/40 private-only). Source generated 2026-10-29T14:04:19Z. Public/private benchmark values are source-normalized/chance-corrected index points and may be negative. No clamping or inferred raw accuracy. Public vision benchmarks run by the lab; there is no submitted vision run. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF vision 0.4 · Private | 67.54 | Setup & sourceHF vision 0.4 · Private Exact source engine glide-v1.2; community vision 0.4. Board cap 1638400 pixels; effective 1.6 MP. Public vision benchmarks run by the lab; there is no submitted vision run. Community Decision Index vision 0.4; 50% public + 50% private, separate from text Full (60/40 private-only). Source generated 2026-10-29T14:04:19Z. Public/private benchmark values are source-normalized/chance-corrected index points and may be negative. No clamping or inferred raw accuracy. Public vision benchmarks run by the lab; there is no submitted vision run. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF vision 0.4 · Full | 71.46 | Setup & sourceHF vision 0.4 · Full Exact source engine glide-v1.2; community vision 0.4. Board cap 1638400 pixels; effective 1.6 MP. Public vision benchmarks run by the lab; there is no submitted vision run. Community Decision Index vision 0.4; 50% public + 50% private, separate from text Full (60/40 private-only). Source generated 2026-10-29T14:04:19Z. Public/private benchmark values are source-normalized/chance-corrected index points and may be negative. No clamping or inferred raw accuracy. Public vision benchmarks run by the lab; there is no submitted vision run. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF vision 0.4 · CV-Bench · pub | 76.53 | Setup & sourceHF vision 0.4 · CV-Bench · pub Exact source engine glide-v1.2; community vision 0.4. Board cap 1638400 pixels; effective 1.6 MP. Public vision benchmarks run by the lab; there is no submitted vision run. Community Decision Index vision 0.4; 50% public + 50% private, separate from text Full (60/40 private-only). Source generated 2026-10-29T14:04:19Z. Public/private benchmark values are source-normalized/chance-corrected index points and may be negative. No clamping or inferred raw accuracy. Public vision benchmarks run by the lab; there is no submitted vision run. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF vision 0.4 · CV-Bench · private | 44.05 | Setup & sourceHF vision 0.4 · CV-Bench · private Exact source engine glide-v1.2; community vision 0.4. Board cap 1638400 pixels; effective 1.6 MP. Public vision benchmarks run by the lab; there is no submitted vision run. Community Decision Index vision 0.4; 50% public + 50% private, separate from text Full (60/40 private-only). Source generated 2026-10-29T14:04:19Z. Public/private benchmark values are source-normalized/chance-corrected index points and may be negative. No clamping or inferred raw accuracy. Public vision benchmarks run by the lab; there is no submitted vision run. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF vision 0.4 · BLINK · pub | 59.57 | Setup & sourceHF vision 0.4 · BLINK · pub Exact source engine glide-v1.2; community vision 0.4. Board cap 1638400 pixels; effective 1.6 MP. Public vision benchmarks run by the lab; there is no submitted vision run. Community Decision Index vision 0.4; 50% public + 50% private, separate from text Full (60/40 private-only). Source generated 2026-10-29T14:04:19Z. Public/private benchmark values are source-normalized/chance-corrected index points and may be negative. No clamping or inferred raw accuracy. Public vision benchmarks run by the lab; there is no submitted vision run. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF vision 0.4 · BLINK · private | 66.00 | Setup & sourceHF vision 0.4 · BLINK · private Exact source engine glide-v1.2; community vision 0.4. Board cap 1638400 pixels; effective 1.6 MP. Public vision benchmarks run by the lab; there is no submitted vision run. Community Decision Index vision 0.4; 50% public + 50% private, separate from text Full (60/40 private-only). Source generated 2026-10-29T14:04:19Z. Public/private benchmark values are source-normalized/chance-corrected index points and may be negative. No clamping or inferred raw accuracy. Public vision benchmarks run by the lab; there is no submitted vision run. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF vision 0.4 · RealWorldQA · pub | 71.98 | Setup & sourceHF vision 0.4 · RealWorldQA · pub Exact source engine glide-v1.2; community vision 0.4. Board cap 1638400 pixels; effective 1.6 MP. Public vision benchmarks run by the lab; there is no submitted vision run. Community Decision Index vision 0.4; 50% public + 50% private, separate from text Full (60/40 private-only). Source generated 2026-10-29T14:04:19Z. Public/private benchmark values are source-normalized/chance-corrected index points and may be negative. No clamping or inferred raw accuracy. Public vision benchmarks run by the lab; there is no submitted vision run. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF vision 0.4 · RealWorldQA · private | 45.33 | Setup & sourceHF vision 0.4 · RealWorldQA · private Exact source engine glide-v1.2; community vision 0.4. Board cap 1638400 pixels; effective 1.6 MP. Public vision benchmarks run by the lab; there is no submitted vision run. Community Decision Index vision 0.4; 50% public + 50% private, separate from text Full (60/40 private-only). Source generated 2026-10-29T14:04:19Z. Public/private benchmark values are source-normalized/chance-corrected index points and may be negative. No clamping or inferred raw accuracy. Public vision benchmarks run by the lab; there is no submitted vision run. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF vision 0.4 · CharXiv · pub | 83.21 | Setup & sourceHF vision 0.4 · CharXiv · pub Exact source engine glide-v1.2; community vision 0.4. Board cap 1638400 pixels; effective 1.6 MP. Public vision benchmarks run by the lab; there is no submitted vision run. Community Decision Index vision 0.4; 50% public + 50% private, separate from text Full (60/40 private-only). Source generated 2026-10-29T14:04:19Z. Public/private benchmark values are source-normalized/chance-corrected index points and may be negative. No clamping or inferred raw accuracy. Public vision benchmarks run by the lab; there is no submitted vision run. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF vision 0.4 · CharXiv · private | 71.72 | Setup & sourceHF vision 0.4 · CharXiv · private Exact source engine glide-v1.2; community vision 0.4. Board cap 1638400 pixels; effective 1.6 MP. Public vision benchmarks run by the lab; there is no submitted vision run. Community Decision Index vision 0.4; 50% public + 50% private, separate from text Full (60/40 private-only). Source generated 2026-10-29T14:04:19Z. Public/private benchmark values are source-normalized/chance-corrected index points and may be negative. No clamping or inferred raw accuracy. Public vision benchmarks run by the lab; there is no submitted vision run. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF vision 0.4 · InfographicVQA · pub | 97.81 | Setup & sourceHF vision 0.4 · InfographicVQA · pub Exact source engine glide-v1.2; community vision 0.4. Board cap 1638400 pixels; effective 1.6 MP. Public vision benchmarks run by the lab; there is no submitted vision run. Community Decision Index vision 0.4; 50% public + 50% private, separate from text Full (60/40 private-only). Source generated 2026-10-29T14:04:19Z. Public/private benchmark values are source-normalized/chance-corrected index points and may be negative. No clamping or inferred raw accuracy. Public vision benchmarks run by the lab; there is no submitted vision run. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF vision 0.4 · InfographicVQA · private | 98.00 | Setup & sourceHF vision 0.4 · InfographicVQA · private Exact source engine glide-v1.2; community vision 0.4. Board cap 1638400 pixels; effective 1.6 MP. Public vision benchmarks run by the lab; there is no submitted vision run. Community Decision Index vision 0.4; 50% public + 50% private, separate from text Full (60/40 private-only). Source generated 2026-10-29T14:04:19Z. Public/private benchmark values are source-normalized/chance-corrected index points and may be negative. No clamping or inferred raw accuracy. Public vision benchmarks run by the lab; there is no submitted vision run. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF vision 0.4 · Mind2Web · pub | 82.73 | Setup & sourceHF vision 0.4 · Mind2Web · pub Exact source engine glide-v1.2; community vision 0.4. Board cap 1638400 pixels; effective 1.6 MP. Public vision benchmarks run by the lab; there is no submitted vision run. Community Decision Index vision 0.4; 50% public + 50% private, separate from text Full (60/40 private-only). Source generated 2026-10-29T14:04:19Z. Public/private benchmark values are source-normalized/chance-corrected index points and may be negative. No clamping or inferred raw accuracy. Public vision benchmarks run by the lab; there is no submitted vision run. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF vision 0.4 · Mind2Web · private | 69.33 | Setup & sourceHF vision 0.4 · Mind2Web · private Exact source engine glide-v1.2; community vision 0.4. Board cap 1638400 pixels; effective 1.6 MP. Public vision benchmarks run by the lab; there is no submitted vision run. Community Decision Index vision 0.4; 50% public + 50% private, separate from text Full (60/40 private-only). Source generated 2026-10-29T14:04:19Z. Public/private benchmark values are source-normalized/chance-corrected index points and may be negative. No clamping or inferred raw accuracy. Public vision benchmarks run by the lab; there is no submitted vision run. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF vision 0.4 · Winoground · pub | 87.25 | Setup & sourceHF vision 0.4 · Winoground · pub Exact source engine glide-v1.2; community vision 0.4. Board cap 1638400 pixels; effective 1.6 MP. Public vision benchmarks run by the lab; there is no submitted vision run. Community Decision Index vision 0.4; 50% public + 50% private, separate from text Full (60/40 private-only). Source generated 2026-10-29T14:04:19Z. Public/private benchmark values are source-normalized/chance-corrected index points and may be negative. No clamping or inferred raw accuracy. Public vision benchmarks run by the lab; there is no submitted vision run. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF vision 0.4 · Winoground · private | 92.00 | Setup & sourceHF vision 0.4 · Winoground · private Exact source engine glide-v1.2; community vision 0.4. Board cap 1638400 pixels; effective 1.6 MP. Public vision benchmarks run by the lab; there is no submitted vision run. Community Decision Index vision 0.4; 50% public + 50% private, separate from text Full (60/40 private-only). Source generated 2026-10-29T14:04:19Z. Public/private benchmark values are source-normalized/chance-corrected index points and may be negative. No clamping or inferred raw accuracy. Public vision benchmarks run by the lab; there is no submitted vision run. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF vision 0.4 · KIE (CORD+FUNSD) · pub | 92.65 | Setup & sourceHF vision 0.4 · KIE (CORD+FUNSD) · pub Exact source engine glide-v1.2; community vision 0.4. Board cap 1638400 pixels; effective 1.6 MP. Public vision benchmarks run by the lab; there is no submitted vision run. Community Decision Index vision 0.4; 50% public + 50% private, separate from text Full (60/40 private-only). Source generated 2026-10-29T14:04:19Z. Public/private benchmark values are source-normalized/chance-corrected index points and may be negative. No clamping or inferred raw accuracy. Public vision benchmarks run by the lab; there is no submitted vision run. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF vision 0.4 · KIE (CORD+FUNSD) · private | 87.41 | Setup & sourceHF vision 0.4 · KIE (CORD+FUNSD) · private Exact source engine glide-v1.2; community vision 0.4. Board cap 1638400 pixels; effective 1.6 MP. Public vision benchmarks run by the lab; there is no submitted vision run. Community Decision Index vision 0.4; 50% public + 50% private, separate from text Full (60/40 private-only). Source generated 2026-10-29T14:04:19Z. Public/private benchmark values are source-normalized/chance-corrected index points and may be negative. No clamping or inferred raw accuracy. Public vision benchmarks run by the lab; there is no submitted vision run. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF vision 0.4 · Moderation (Hateful Memes) · pub | 42.95 | Setup & sourceHF vision 0.4 · Moderation (Hateful Memes) · pub Exact source engine glide-v1.2; community vision 0.4. Board cap 1638400 pixels; effective 1.6 MP. Public vision benchmarks run by the lab; there is no submitted vision run. Community Decision Index vision 0.4; 50% public + 50% private, separate from text Full (60/40 private-only). Source generated 2026-10-29T14:04:19Z. Public/private benchmark values are source-normalized/chance-corrected index points and may be negative. No clamping or inferred raw accuracy. Public vision benchmarks run by the lab; there is no submitted vision run. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF vision 0.4 · Moderation (Hateful Memes) · private | 34.00 | Setup & sourceHF vision 0.4 · Moderation (Hateful Memes) · private Exact source engine glide-v1.2; community vision 0.4. Board cap 1638400 pixels; effective 1.6 MP. Public vision benchmarks run by the lab; there is no submitted vision run. Community Decision Index vision 0.4; 50% public + 50% private, separate from text Full (60/40 private-only). Source generated 2026-10-29T14:04:19Z. Public/private benchmark values are source-normalized/chance-corrected index points and may be negative. No clamping or inferred raw accuracy. Public vision benchmarks run by the lab; there is no submitted vision run. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF vision 0.4 · R-Bench-M · pub | 56.14 | Setup & sourceHF vision 0.4 · R-Bench-M · pub Exact source engine glide-v1.2; community vision 0.4. Board cap 1638400 pixels; effective 1.6 MP. Public vision benchmarks run by the lab; there is no submitted vision run. Community Decision Index vision 0.4; 50% public + 50% private, separate from text Full (60/40 private-only). Source generated 2026-10-29T14:04:19Z. Public/private benchmark values are source-normalized/chance-corrected index points and may be negative. No clamping or inferred raw accuracy. Public vision benchmarks run by the lab; there is no submitted vision run. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF vision 0.4 · MMMU-Pro vision · pub | 48.55 | Setup & sourceHF vision 0.4 · MMMU-Pro vision · pub Exact source engine glide-v1.2; community vision 0.4. Board cap 1638400 pixels; effective 1.6 MP. Public vision benchmarks run by the lab; there is no submitted vision run. Community Decision Index vision 0.4; 50% public + 50% private, separate from text Full (60/40 private-only). Source generated 2026-10-29T14:04:19Z. Public/private benchmark values are source-normalized/chance-corrected index points and may be negative. No clamping or inferred raw accuracy. Public vision benchmarks run by the lab; there is no submitted vision run. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF vision calibration 0.4 · acc | 81.14% | Setup & sourceHF vision calibration 0.4 · acc Exact source engine glide-v1.2; community vision 0.4. Board cap 1638400 pixels; effective 1.6 MP. Public vision benchmarks run by the lab; there is no submitted vision run. Community Decision Index vision 0.4; 50% public + 50% private, separate from text Full (60/40 private-only). Source generated 2026-10-29T14:04:19Z. Public/private benchmark values are source-normalized/chance-corrected index points and may be negative. No clamping or inferred raw accuracy. Public vision benchmarks run by the lab; there is no submitted vision run. Source calibration sample; no new binning assumptions. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 13695 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF vision calibration 0.4 · conf | 82.40% | Setup & sourceHF vision calibration 0.4 · conf Exact source engine glide-v1.2; community vision 0.4. Board cap 1638400 pixels; effective 1.6 MP. Public vision benchmarks run by the lab; there is no submitted vision run. Community Decision Index vision 0.4; 50% public + 50% private, separate from text Full (60/40 private-only). Source generated 2026-10-29T14:04:19Z. Public/private benchmark values are source-normalized/chance-corrected index points and may be negative. No clamping or inferred raw accuracy. Public vision benchmarks run by the lab; there is no submitted vision run. Source calibration sample; no new binning assumptions. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 13695 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF vision calibration 0.4 · ece | 1.80 pp | Setup & sourceHF vision calibration 0.4 · ece Exact source engine glide-v1.2; community vision 0.4. Board cap 1638400 pixels; effective 1.6 MP. Public vision benchmarks run by the lab; there is no submitted vision run. Community Decision Index vision 0.4; 50% public + 50% private, separate from text Full (60/40 private-only). Source generated 2026-10-29T14:04:19Z. Public/private benchmark values are source-normalized/chance-corrected index points and may be negative. No clamping or inferred raw accuracy. Public vision benchmarks run by the lab; there is no submitted vision run. Source calibration sample; no new binning assumptions. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 13695 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF vision calibration 0.4 · over95 | 1.00% | Setup & sourceHF vision calibration 0.4 · over95 Exact source engine glide-v1.2; community vision 0.4. Board cap 1638400 pixels; effective 1.6 MP. Public vision benchmarks run by the lab; there is no submitted vision run. Community Decision Index vision 0.4; 50% public + 50% private, separate from text Full (60/40 private-only). Source generated 2026-10-29T14:04:19Z. Public/private benchmark values are source-normalized/chance-corrected index points and may be negative. No clamping or inferred raw accuracy. Public vision benchmarks run by the lab; there is no submitted vision run. Source calibration sample; no new binning assumptions. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: 13695 Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF vision 0.4 · Row latency | 346.60 ms | Setup & sourceHF vision 0.4 · Row latency Exact source engine glide-v1.2; community vision 0.4. Board cap 1638400 pixels; effective 1.6 MP. Public vision benchmarks run by the lab; there is no submitted vision run. Community Decision Index vision 0.4; 50% public + 50% private, separate from text Full (60/40 private-only). Source generated 2026-10-29T14:04:19Z. Public/private benchmark values are source-normalized/chance-corrected index points and may be negative. No clamping or inferred raw accuracy. Public vision benchmarks run by the lab; there is no submitted vision run. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF vision 0.4 · Native image budget · pub | 75.37 | Setup & sourceHF vision 0.4 · Native image budget · pub Exact source engine glide-v1.2; community vision 0.4. Board cap 1638400 pixels; effective 1.6 MP. Public vision benchmarks run by the lab; there is no submitted vision run. Community Decision Index vision 0.4; 50% public + 50% private, separate from text Full (60/40 private-only). Source generated 2026-10-29T14:04:19Z. Public/private benchmark values are source-normalized/chance-corrected index points and may be negative. No clamping or inferred raw accuracy. Public vision benchmarks run by the lab; there is no submitted vision run. Heterogeneous native budget 1.6 MP; separate from fixed 1.6MP comparison. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF vision 0.4 · Native image budget · priv | 67.54 | Setup & sourceHF vision 0.4 · Native image budget · priv Exact source engine glide-v1.2; community vision 0.4. Board cap 1638400 pixels; effective 1.6 MP. Public vision benchmarks run by the lab; there is no submitted vision run. Community Decision Index vision 0.4; 50% public + 50% private, separate from text Full (60/40 private-only). Source generated 2026-10-29T14:04:19Z. Public/private benchmark values are source-normalized/chance-corrected index points and may be negative. No clamping or inferred raw accuracy. Public vision benchmarks run by the lab; there is no submitted vision run. Heterogeneous native budget 1.6 MP; separate from fixed 1.6MP comparison. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
| HF vision 0.4 · Native image budget · full | 71.46 | Setup & sourceHF vision 0.4 · Native image budget · full Exact source engine glide-v1.2; community vision 0.4. Board cap 1638400 pixels; effective 1.6 MP. Public vision benchmarks run by the lab; there is no submitted vision run. Community Decision Index vision 0.4; 50% public + 50% private, separate from text Full (60/40 private-only). Source generated 2026-10-29T14:04:19Z. Public/private benchmark values are source-normalized/chance-corrected index points and may be negative. No clamping or inferred raw accuracy. Public vision benchmarks run by the lab; there is no submitted vision run. Heterogeneous native budget 1.6 MP; separate from fixed 1.6MP comparison. The board served a7e45896be; the registry pins the newest repository revision, and the commit titles after it concern the card. Decision Index 0.4 (release-v4), source generated 2026-10-20T14:13:56Z. Full = 60% equated private same-skill + 40% equated private new-domain tasks; public contributes zero. Both private components are mapped onto the public scale using untuned stock models. Public weighting/panel changed (GSM8K rebuilt, ForecastBench retired, WinoGrande area reassigned); these are new benchmark definitions, not proof of a model upgrade. Public 37-benchmark index and 42 published native benchmarks remain separate. Preserve source rounding, coverage, exclusions and unknown execution dates; no new uncertainty inferred. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-10-20T14:13:56Z · Revision: 133313cf8963f2b6bed960abb0152fd14cbb6731; c130faf65f82e81d3bdefb01e758c712dc5c5199 for the 2 November 2026 additions · Published observations; result reuse terms not specified Result source · Benchmark source |
Evaluator-published · Benchmark Heaven
| Evaluation | Result | Evidence |
|---|---|---|
| Benchmark Heaven JevBench v1.8 · Capability Score | 84.923 | Setup & sourceCapability Score on the rendered board. Fastino GLiDE 1.2 (open weights, self-hosted) · Open weights · LLM decoder. Board key fastino-glide-1.2-open; method tag v1.7. Measured on the Second regular draw (v1.7.0), 2026-10-23; put on the v1.6.1 scale by the draw's anchor offset (see How it works). Source link https://huggingface.co/fastino/GLiDE. Rendered board row. Benchmark Heaven's rendered board, read 2 November 2026: 283 ranked systems · 1,500 decisions each (600 for 19 equated API re-runs) · 131 newer ranked rows tagged with their draw · 14 older rows dated separately. Newer rows are measured on dated draws and put on the v1.6.1 scale by the draw's anchor offset, so a row's draw is part of its identity. Distinct from Leanmcp JevBench, the community Decision Index and the stored Benchmark Heaven v1.6.1 feed. Cost is the source's model on a GPU-time basis for self-hosted rows, not a provider tariff. Self-hosted latency is timed on the GPU over loopback and API latency end to end with the network; the source says they are not directly comparable, so they stay in separate datasets. No Examenos recomputation. Checked / reported: 2026-11-02 · Evaluated: 2026-10-23 · Samples: Not published Snapshot: 2026-10-31 · Revision: Board v1.7.48, method v1.8, updated 2026-10-31; page sha256 df9093384c9cdf5854e065f71dd3abd83a127793f22f4ca70268e9981e0a0b17 · Published summary observations; upstream task/result terms retained Result source · Benchmark source |
| Benchmark Heaven JevBench v1.8 · Intelligence | 76.4 | Setup & sourceIntelligence on the rendered board. Fastino GLiDE 1.2 (open weights, self-hosted) · Open weights · LLM decoder. Board key fastino-glide-1.2-open; method tag v1.7. Measured on the Second regular draw (v1.7.0), 2026-10-23; put on the v1.6.1 scale by the draw's anchor offset (see How it works). Source link https://huggingface.co/fastino/GLiDE. Rendered board row. Benchmark Heaven's rendered board, read 2 November 2026: 283 ranked systems · 1,500 decisions each (600 for 19 equated API re-runs) · 131 newer ranked rows tagged with their draw · 14 older rows dated separately. Newer rows are measured on dated draws and put on the v1.6.1 scale by the draw's anchor offset, so a row's draw is part of its identity. Distinct from Leanmcp JevBench, the community Decision Index and the stored Benchmark Heaven v1.6.1 feed. Cost is the source's model on a GPU-time basis for self-hosted rows, not a provider tariff. Self-hosted latency is timed on the GPU over loopback and API latency end to end with the network; the source says they are not directly comparable, so they stay in separate datasets. No Examenos recomputation. Checked / reported: 2026-11-02 · Evaluated: 2026-10-23 · Samples: Not published Snapshot: 2026-10-31 · Revision: Board v1.7.48, method v1.8, updated 2026-10-31; page sha256 df9093384c9cdf5854e065f71dd3abd83a127793f22f4ca70268e9981e0a0b17 · Published summary observations; upstream task/result terms retained Result source · Benchmark source |
| Benchmark Heaven JevBench v1.8 · Calibration | 93.5 | Setup & sourceCalibration on the rendered board. Fastino GLiDE 1.2 (open weights, self-hosted) · Open weights · LLM decoder. Board key fastino-glide-1.2-open; method tag v1.7. Measured on the Second regular draw (v1.7.0), 2026-10-23; put on the v1.6.1 scale by the draw's anchor offset (see How it works). Source link https://huggingface.co/fastino/GLiDE. Rendered board row. Benchmark Heaven's rendered board, read 2 November 2026: 283 ranked systems · 1,500 decisions each (600 for 19 equated API re-runs) · 131 newer ranked rows tagged with their draw · 14 older rows dated separately. Newer rows are measured on dated draws and put on the v1.6.1 scale by the draw's anchor offset, so a row's draw is part of its identity. Distinct from Leanmcp JevBench, the community Decision Index and the stored Benchmark Heaven v1.6.1 feed. Cost is the source's model on a GPU-time basis for self-hosted rows, not a provider tariff. Self-hosted latency is timed on the GPU over loopback and API latency end to end with the network; the source says they are not directly comparable, so they stay in separate datasets. No Examenos recomputation. Checked / reported: 2026-11-02 · Evaluated: 2026-10-23 · Samples: Not published Snapshot: 2026-10-31 · Revision: Board v1.7.48, method v1.8, updated 2026-10-31; page sha256 df9093384c9cdf5854e065f71dd3abd83a127793f22f4ca70268e9981e0a0b17 · Published summary observations; upstream task/result terms retained Result source · Benchmark source |
| Benchmark Heaven JevBench v1.8 · Cost Score | 58.1 | Setup & sourceCost Score on the rendered board. Fastino GLiDE 1.2 (open weights, self-hosted) · Open weights · LLM decoder. Board key fastino-glide-1.2-open; method tag v1.7. Measured on the Second regular draw (v1.7.0), 2026-10-23; put on the v1.6.1 scale by the draw's anchor offset (see How it works). Source link https://huggingface.co/fastino/GLiDE. Rendered board row. Benchmark Heaven's rendered board, read 2 November 2026: 283 ranked systems · 1,500 decisions each (600 for 19 equated API re-runs) · 131 newer ranked rows tagged with their draw · 14 older rows dated separately. Newer rows are measured on dated draws and put on the v1.6.1 scale by the draw's anchor offset, so a row's draw is part of its identity. Distinct from Leanmcp JevBench, the community Decision Index and the stored Benchmark Heaven v1.6.1 feed. Cost is the source's model on a GPU-time basis for self-hosted rows, not a provider tariff. Self-hosted latency is timed on the GPU over loopback and API latency end to end with the network; the source says they are not directly comparable, so they stay in separate datasets. No Examenos recomputation. Checked / reported: 2026-11-02 · Evaluated: 2026-10-23 · Samples: Not published Snapshot: 2026-10-31 · Revision: Board v1.7.48, method v1.8, updated 2026-10-31; page sha256 df9093384c9cdf5854e065f71dd3abd83a127793f22f4ca70268e9981e0a0b17 · Published summary observations; upstream task/result terms retained Result source · Benchmark source |
| Benchmark Heaven JevBench v1.8 · Modelled cost per 1,000 decisions | 0.02492 USD/1k decisions | Setup & sourceModelled cost per 1,000 decisions on the rendered board. Fastino GLiDE 1.2 (open weights, self-hosted) · Open weights · LLM decoder. Board key fastino-glide-1.2-open; method tag v1.7. Measured on the Second regular draw (v1.7.0), 2026-10-23; put on the v1.6.1 scale by the draw's anchor offset (see How it works). Source link https://huggingface.co/fastino/GLiDE. Rendered board row. Benchmark Heaven's rendered board, read 2 November 2026: 283 ranked systems · 1,500 decisions each (600 for 19 equated API re-runs) · 131 newer ranked rows tagged with their draw · 14 older rows dated separately. Newer rows are measured on dated draws and put on the v1.6.1 scale by the draw's anchor offset, so a row's draw is part of its identity. Distinct from Leanmcp JevBench, the community Decision Index and the stored Benchmark Heaven v1.6.1 feed. Cost is the source's model on a GPU-time basis for self-hosted rows, not a provider tariff. Self-hosted latency is timed on the GPU over loopback and API latency end to end with the network; the source says they are not directly comparable, so they stay in separate datasets. No Examenos recomputation. Checked / reported: 2026-11-02 · Evaluated: 2026-10-23 · Samples: Not published Snapshot: 2026-10-31 · Revision: Board v1.7.48, method v1.8, updated 2026-10-31; page sha256 df9093384c9cdf5854e065f71dd3abd83a127793f22f4ca70268e9981e0a0b17 · Published summary observations; upstream task/result terms retained Result source · Benchmark source |
| Benchmark Heaven JevBench v1.8 · Self-hosted p50 on the GPU, loopback | 0.140 s | Setup & sourceSelf-hosted p50 on the GPU, loopback on the rendered board. Fastino GLiDE 1.2 (open weights, self-hosted) · Open weights · LLM decoder. Board key fastino-glide-1.2-open; method tag v1.7. Measured on the Second regular draw (v1.7.0), 2026-10-23; put on the v1.6.1 scale by the draw's anchor offset (see How it works). Source link https://huggingface.co/fastino/GLiDE. Rendered board row. Benchmark Heaven's rendered board, read 2 November 2026: 283 ranked systems · 1,500 decisions each (600 for 19 equated API re-runs) · 131 newer ranked rows tagged with their draw · 14 older rows dated separately. Newer rows are measured on dated draws and put on the v1.6.1 scale by the draw's anchor offset, so a row's draw is part of its identity. Distinct from Leanmcp JevBench, the community Decision Index and the stored Benchmark Heaven v1.6.1 feed. Cost is the source's model on a GPU-time basis for self-hosted rows, not a provider tariff. Self-hosted latency is timed on the GPU over loopback and API latency end to end with the network; the source says they are not directly comparable, so they stay in separate datasets. No Examenos recomputation. Checked / reported: 2026-11-02 · Evaluated: 2026-10-23 · Samples: Not published Snapshot: 2026-10-31 · Revision: Board v1.7.48, method v1.8, updated 2026-10-31; page sha256 df9093384c9cdf5854e065f71dd3abd83a127793f22f4ca70268e9981e0a0b17 · Published summary observations; upstream task/result terms retained Result source · Benchmark source |
| Benchmark Heaven JevBench v1.8 · Self-hosted estimate including network (2x + 150 ms) | 0.43 s | Setup & sourceSelf-hosted estimate including network (2x + 150 ms) on the rendered board. Fastino GLiDE 1.2 (open weights, self-hosted) · Open weights · LLM decoder. Board key fastino-glide-1.2-open; method tag v1.7. Measured on the Second regular draw (v1.7.0), 2026-10-23; put on the v1.6.1 scale by the draw's anchor offset (see How it works). Source link https://huggingface.co/fastino/GLiDE. Rendered board row. Benchmark Heaven's rendered board, read 2 November 2026: 283 ranked systems · 1,500 decisions each (600 for 19 equated API re-runs) · 131 newer ranked rows tagged with their draw · 14 older rows dated separately. Newer rows are measured on dated draws and put on the v1.6.1 scale by the draw's anchor offset, so a row's draw is part of its identity. Distinct from Leanmcp JevBench, the community Decision Index and the stored Benchmark Heaven v1.6.1 feed. Cost is the source's model on a GPU-time basis for self-hosted rows, not a provider tariff. Self-hosted latency is timed on the GPU over loopback and API latency end to end with the network; the source says they are not directly comparable, so they stay in separate datasets. No Examenos recomputation. Checked / reported: 2026-11-02 · Evaluated: 2026-10-23 · Samples: Not published Snapshot: 2026-10-31 · Revision: Board v1.7.48, method v1.8, updated 2026-10-31; page sha256 df9093384c9cdf5854e065f71dd3abd83a127793f22f4ca70268e9981e0a0b17 · Published summary observations; upstream task/result terms retained Result source · Benchmark source |