Examenos

Decision Index 0.3.1 public suite, scored with the maintainer’s kit on its stratified 12,000-request sample (Figure 4, Text).

kettei chub. Figure 4 Text point, scored with the maintainer’s kit.

Published in the vendor’s launch post.

Sqwish Labs’ own results in the kettei launch post of 14 October 2026. Figure values are the labelled data points the page draws (name, score, latency), read from the site bundle /static/js/main.10f99d62.js, read 8 November 2026; prose values are quoted from the same post. Values were published before the core and dot weights (18 October) and name no revision.

Checked / reported: 2026-11-08 · Samples: 12000

Snapshot: 2026-10-14 · Revision: site bundle /static/js/main.10f99d62.js, read 8 November 2026 · Published observations; result reuse terms not specified

Median latency per request on the same run (Figure 4, Text).

kettei chub. Figure 4 Text point; hardware not stated.

Published in the vendor’s launch post.

Sqwish Labs’ own results in the kettei launch post of 14 October 2026. Figure values are the labelled data points the page draws (name, score, latency), read from the site bundle /static/js/main.10f99d62.js, read 8 November 2026; prose values are quoted from the same post. Values were published before the core and dot weights (18 October) and name no revision.

Checked / reported: 2026-11-08 · Samples: 12000

Snapshot: 2026-10-14 · Revision: site bundle /static/js/main.10f99d62.js, read 8 November 2026 · Published observations; result reuse terms not specified

Public half of the Decision Index vision board, scored with the board’s formula and anchored to its published scale (Figure 4, Images).

kettei chub. Figure 4 Images point.

Published in the vendor’s launch post.

Sqwish Labs’ own results in the kettei launch post of 14 October 2026. Figure values are the labelled data points the page draws (name, score, latency), read from the site bundle /static/js/main.10f99d62.js, read 8 November 2026; prose values are quoted from the same post. Values were published before the core and dot weights (18 October) and name no revision.

Checked / reported: 2026-11-08 · Samples: Not published

Snapshot: 2026-10-14 · Revision: site bundle /static/js/main.10f99d62.js, read 8 November 2026 · Published observations; result reuse terms not specified

Time per request on the same run (Figure 4, Images).

kettei chub. Figure 4 Images point; hardware not stated.

Published in the vendor’s launch post.

Sqwish Labs’ own results in the kettei launch post of 14 October 2026. Figure values are the labelled data points the page draws (name, score, latency), read from the site bundle /static/js/main.10f99d62.js, read 8 November 2026; prose values are quoted from the same post. Values were published before the core and dot weights (18 October) and name no revision.

Checked / reported: 2026-11-08 · Samples: Not published

Snapshot: 2026-10-14 · Revision: site bundle /static/js/main.10f99d62.js, read 8 November 2026 · Published observations; result reuse terms not specified

The 231 public JevBench items (Figure 4, JevBench).

kettei chub. Figure 4 JevBench point.

Published in the vendor’s launch post.

Sqwish Labs’ own results in the kettei launch post of 14 October 2026. Figure values are the labelled data points the page draws (name, score, latency), read from the site bundle /static/js/main.10f99d62.js, read 8 November 2026; prose values are quoted from the same post. Values were published before the core and dot weights (18 October) and name no revision.

Checked / reported: 2026-11-08 · Samples: 231

Snapshot: 2026-10-14 · Revision: site bundle /static/js/main.10f99d62.js, read 8 November 2026 · Published observations; result reuse terms not specified

Median end-to-end latency per request from a UK client through the provider’s public API (Figure 4, JevBench).

kettei chub. Figure 4 JevBench point, timed end to end from the UK.

Published in the vendor’s launch post.

Sqwish Labs’ own results in the kettei launch post of 14 October 2026. Figure values are the labelled data points the page draws (name, score, latency), read from the site bundle /static/js/main.10f99d62.js, read 8 November 2026; prose values are quoted from the same post. Values were published before the core and dot weights (18 October) and name no revision.

Checked / reported: 2026-11-08 · Samples: 231

Snapshot: 2026-10-14 · Revision: site bundle /static/js/main.10f99d62.js, read 8 November 2026 · Published observations; result reuse terms not specified

Sqwish’s own held-out image set: 5,000 questions, 542 of them multi-image.

kettei chub. Held-out image set.

Published in the vendor’s launch post.

Sqwish Labs’ own results in the kettei launch post of 14 October 2026. Figure values are the labelled data points the page draws (name, score, latency), read from the site bundle /static/js/main.10f99d62.js, read 8 November 2026; prose values are quoted from the same post. Values were published before the core and dot weights (18 October) and name no revision.

Checked / reported: 2026-11-08 · Samples: 5000

Snapshot: 2026-10-14 · Revision: site bundle /static/js/main.10f99d62.js, read 8 November 2026 · Published observations; result reuse terms not specified

SIB-200 topic classification on a 35-language sample.

kettei chub. 35-language sample; the post rounds to whole percent.

Published in the vendor’s launch post.

Sqwish Labs’ own results in the kettei launch post of 14 October 2026. Figure values are the labelled data points the page draws (name, score, latency), read from the site bundle /static/js/main.10f99d62.js, read 8 November 2026; prose values are quoted from the same post. Values were published before the core and dot weights (18 October) and name no revision.

Checked / reported: 2026-11-08 · Samples: Not published

Snapshot: 2026-10-14 · Revision: site bundle /static/js/main.10f99d62.js, read 8 November 2026 · Published observations; result reuse terms not specified

Doom “defend the centre” played from pixels (Figure 6).

kettei chub. Figure 6 doom panel.

Published in the vendor’s launch post.

Sqwish Labs’ own results in the kettei launch post of 14 October 2026. Figure values are the labelled data points the page draws (name, score, latency), read from the site bundle /static/js/main.10f99d62.js, read 8 November 2026; prose values are quoted from the same post. Values were published before the core and dot weights (18 October) and name no revision.

Checked / reported: 2026-11-08 · Samples: Not published

Snapshot: 2026-10-14 · Revision: site bundle /static/js/main.10f99d62.js, read 8 November 2026 · Published observations; result reuse terms not specified

Super Mario World 1-1 played from frames (Figure 6).

kettei chub. Figure 6 mario panel.

Published in the vendor’s launch post.

Sqwish Labs’ own results in the kettei launch post of 14 October 2026. Figure values are the labelled data points the page draws (name, score, latency), read from the site bundle /static/js/main.10f99d62.js, read 8 November 2026; prose values are quoted from the same post. Values were published before the core and dot weights (18 October) and name no revision.

Checked / reported: 2026-11-08 · Samples: Not published

Snapshot: 2026-10-14 · Revision: site bundle /static/js/main.10f99d62.js, read 8 November 2026 · Published observations; result reuse terms not specified

Tetris from a picture of the board, choosing among lettered landing spots; 48 games for kettei fat (Figure 6).

kettei chub. Figure 6 tetris panel.

Published in the vendor’s launch post.

Sqwish Labs’ own results in the kettei launch post of 14 October 2026. Figure values are the labelled data points the page draws (name, score, latency), read from the site bundle /static/js/main.10f99d62.js, read 8 November 2026; prose values are quoted from the same post. Values were published before the core and dot weights (18 October) and name no revision.

Checked / reported: 2026-11-08 · Samples: Not published

Snapshot: 2026-10-14 · Revision: site bundle /static/js/main.10f99d62.js, read 8 November 2026 · Published observations; result reuse terms not specified

Capability Score on the rendered board.

kettei-chub (Sqwish) · Closed API (weights not public). Board key kettei-chub; method tag v1.7. Measured on the Second regular draw (v1.6.43), 2026-10-16; put on the v1.6.1 scale by the draw's anchor offset (see How it works). Source link https://docs.sqwish.ai.

Rendered board row. Hosted kettei-chub through docs.sqwish.ai; the API ID has no dated version.

Benchmark Heaven's rendered board, read 2 November 2026: 283 ranked systems · 1,500 decisions each (600 for 19 equated API re-runs) · 131 newer ranked rows tagged with their draw · 14 older rows dated separately. Newer rows are measured on dated draws and put on the v1.6.1 scale by the draw's anchor offset, so a row's draw is part of its identity. Distinct from Leanmcp JevBench, the community Decision Index and the stored Benchmark Heaven v1.6.1 feed. Cost is the source's model on a GPU-time basis for self-hosted rows, not a provider tariff. Self-hosted latency is timed on the GPU over loopback and API latency end to end with the network; the source says they are not directly comparable, so they stay in separate datasets. No Examenos recomputation.

Checked / reported: 2026-11-08 · Evaluated: 2026-10-16 · Samples: Not published

Snapshot: 2026-10-31 · Revision: Board v1.7.48, method v1.8, updated 2026-10-31; page sha256 df9093384c9cdf5854e065f71dd3abd83a127793f22f4ca70268e9981e0a0b17 · Published summary observations; upstream task/result terms retained

Intelligence on the rendered board.

kettei-chub (Sqwish) · Closed API (weights not public). Board key kettei-chub; method tag v1.7. Measured on the Second regular draw (v1.6.43), 2026-10-16; put on the v1.6.1 scale by the draw's anchor offset (see How it works). Source link https://docs.sqwish.ai.

Rendered board row. Hosted kettei-chub through docs.sqwish.ai; the API ID has no dated version.

Benchmark Heaven's rendered board, read 2 November 2026: 283 ranked systems · 1,500 decisions each (600 for 19 equated API re-runs) · 131 newer ranked rows tagged with their draw · 14 older rows dated separately. Newer rows are measured on dated draws and put on the v1.6.1 scale by the draw's anchor offset, so a row's draw is part of its identity. Distinct from Leanmcp JevBench, the community Decision Index and the stored Benchmark Heaven v1.6.1 feed. Cost is the source's model on a GPU-time basis for self-hosted rows, not a provider tariff. Self-hosted latency is timed on the GPU over loopback and API latency end to end with the network; the source says they are not directly comparable, so they stay in separate datasets. No Examenos recomputation.

Checked / reported: 2026-11-08 · Evaluated: 2026-10-16 · Samples: Not published

Snapshot: 2026-10-31 · Revision: Board v1.7.48, method v1.8, updated 2026-10-31; page sha256 df9093384c9cdf5854e065f71dd3abd83a127793f22f4ca70268e9981e0a0b17 · Published summary observations; upstream task/result terms retained

Calibration on the rendered board.

kettei-chub (Sqwish) · Closed API (weights not public). Board key kettei-chub; method tag v1.7. Measured on the Second regular draw (v1.6.43), 2026-10-16; put on the v1.6.1 scale by the draw's anchor offset (see How it works). Source link https://docs.sqwish.ai.

Rendered board row. Hosted kettei-chub through docs.sqwish.ai; the API ID has no dated version.

Benchmark Heaven's rendered board, read 2 November 2026: 283 ranked systems · 1,500 decisions each (600 for 19 equated API re-runs) · 131 newer ranked rows tagged with their draw · 14 older rows dated separately. Newer rows are measured on dated draws and put on the v1.6.1 scale by the draw's anchor offset, so a row's draw is part of its identity. Distinct from Leanmcp JevBench, the community Decision Index and the stored Benchmark Heaven v1.6.1 feed. Cost is the source's model on a GPU-time basis for self-hosted rows, not a provider tariff. Self-hosted latency is timed on the GPU over loopback and API latency end to end with the network; the source says they are not directly comparable, so they stay in separate datasets. No Examenos recomputation.

Checked / reported: 2026-11-08 · Evaluated: 2026-10-16 · Samples: Not published

Snapshot: 2026-10-31 · Revision: Board v1.7.48, method v1.8, updated 2026-10-31; page sha256 df9093384c9cdf5854e065f71dd3abd83a127793f22f4ca70268e9981e0a0b17 · Published summary observations; upstream task/result terms retained

Cost Score on the rendered board.

kettei-chub (Sqwish) · Closed API (weights not public). Board key kettei-chub; method tag v1.7. Measured on the Second regular draw (v1.6.43), 2026-10-16; put on the v1.6.1 scale by the draw's anchor offset (see How it works). Source link https://docs.sqwish.ai.

Rendered board row. Hosted kettei-chub through docs.sqwish.ai; the API ID has no dated version.

Benchmark Heaven's rendered board, read 2 November 2026: 283 ranked systems · 1,500 decisions each (600 for 19 equated API re-runs) · 131 newer ranked rows tagged with their draw · 14 older rows dated separately. Newer rows are measured on dated draws and put on the v1.6.1 scale by the draw's anchor offset, so a row's draw is part of its identity. Distinct from Leanmcp JevBench, the community Decision Index and the stored Benchmark Heaven v1.6.1 feed. Cost is the source's model on a GPU-time basis for self-hosted rows, not a provider tariff. Self-hosted latency is timed on the GPU over loopback and API latency end to end with the network; the source says they are not directly comparable, so they stay in separate datasets. No Examenos recomputation.

Checked / reported: 2026-11-08 · Evaluated: 2026-10-16 · Samples: Not published

Snapshot: 2026-10-31 · Revision: Board v1.7.48, method v1.8, updated 2026-10-31; page sha256 df9093384c9cdf5854e065f71dd3abd83a127793f22f4ca70268e9981e0a0b17 · Published summary observations; upstream task/result terms retained

Modelled cost per 1,000 decisions on the rendered board.

kettei-chub (Sqwish) · Closed API (weights not public). Board key kettei-chub; method tag v1.7. Measured on the Second regular draw (v1.6.43), 2026-10-16; put on the v1.6.1 scale by the draw's anchor offset (see How it works). Source link https://docs.sqwish.ai.

Rendered board row. Hosted kettei-chub through docs.sqwish.ai; the API ID has no dated version.

Benchmark Heaven's rendered board, read 2 November 2026: 283 ranked systems · 1,500 decisions each (600 for 19 equated API re-runs) · 131 newer ranked rows tagged with their draw · 14 older rows dated separately. Newer rows are measured on dated draws and put on the v1.6.1 scale by the draw's anchor offset, so a row's draw is part of its identity. Distinct from Leanmcp JevBench, the community Decision Index and the stored Benchmark Heaven v1.6.1 feed. Cost is the source's model on a GPU-time basis for self-hosted rows, not a provider tariff. Self-hosted latency is timed on the GPU over loopback and API latency end to end with the network; the source says they are not directly comparable, so they stay in separate datasets. No Examenos recomputation.

Checked / reported: 2026-11-08 · Evaluated: 2026-10-16 · Samples: Not published

Snapshot: 2026-10-31 · Revision: Board v1.7.48, method v1.8, updated 2026-10-31; page sha256 df9093384c9cdf5854e065f71dd3abd83a127793f22f4ca70268e9981e0a0b17 · Published summary observations; upstream task/result terms retained

API latency, end to end on the rendered board.

kettei-chub (Sqwish) · Closed API (weights not public). Board key kettei-chub; method tag v1.7. Measured on the Second regular draw (v1.6.43), 2026-10-16; put on the v1.6.1 scale by the draw's anchor offset (see How it works). Source link https://docs.sqwish.ai.

Rendered board row. Hosted kettei-chub through docs.sqwish.ai; the API ID has no dated version.

Benchmark Heaven's rendered board, read 2 November 2026: 283 ranked systems · 1,500 decisions each (600 for 19 equated API re-runs) · 131 newer ranked rows tagged with their draw · 14 older rows dated separately. Newer rows are measured on dated draws and put on the v1.6.1 scale by the draw's anchor offset, so a row's draw is part of its identity. Distinct from Leanmcp JevBench, the community Decision Index and the stored Benchmark Heaven v1.6.1 feed. Cost is the source's model on a GPU-time basis for self-hosted rows, not a provider tariff. Self-hosted latency is timed on the GPU over loopback and API latency end to end with the network; the source says they are not directly comparable, so they stay in separate datasets. No Examenos recomputation.

Checked / reported: 2026-11-08 · Evaluated: 2026-10-16 · Samples: Not published

Snapshot: 2026-10-31 · Revision: Board v1.7.48, method v1.8, updated 2026-10-31; page sha256 df9093384c9cdf5854e065f71dd3abd83a127793f22f4ca70268e9981e0a0b17 · Published summary observations; upstream task/result terms retained

Capability on the core image track.

kettei-chub (Sqwish); board key kettei_chub; last measured 2026-10-16T17:44:49.888791+00:00.

Exact published core-track row.

Benchmark Heaven's image decision benchmark, core track of v0.3.0, built 2026-10-28T18:06:26.533607+00:00. Published core track only; dated carry and computer-use track are separate. Cite source_sha256 for the exact result bytes. Separate from JevBench text rows and the community vision index. H2O image rows are not stored here, because serving settings changed between releases and no row names the registered release. No Examenos recomputation.

Checked / reported: 2026-11-08 · Evaluated: 2026-10-16 · Samples: Not published

Snapshot: 2026-10-28 · Revision: v0.3.0; source_sha256=90ec4137edf485c5f6927c14d22188a6cea26e3355f0fd0e93d68da251c5e5d8 · Published summary observations; upstream task/result terms retained

Composite on the core image track.

kettei-chub (Sqwish); board key kettei_chub; last measured 2026-10-16T17:44:49.888791+00:00.

Exact published core-track row.

Benchmark Heaven's image decision benchmark, core track of v0.3.0, built 2026-10-28T18:06:26.533607+00:00. Published core track only; dated carry and computer-use track are separate. Cite source_sha256 for the exact result bytes. Separate from JevBench text rows and the community vision index. H2O image rows are not stored here, because serving settings changed between releases and no row names the registered release. No Examenos recomputation.

Checked / reported: 2026-11-08 · Evaluated: 2026-10-16 · Samples: Not published

Snapshot: 2026-10-28 · Revision: v0.3.0; source_sha256=90ec4137edf485c5f6927c14d22188a6cea26e3355f0fd0e93d68da251c5e5d8 · Published summary observations; upstream task/result terms retained

Intelligence on the core image track.

kettei-chub (Sqwish); board key kettei_chub; last measured 2026-10-16T17:44:49.888791+00:00.

Exact published core-track row.

Benchmark Heaven's image decision benchmark, core track of v0.3.0, built 2026-10-28T18:06:26.533607+00:00. Published core track only; dated carry and computer-use track are separate. Cite source_sha256 for the exact result bytes. Separate from JevBench text rows and the community vision index. H2O image rows are not stored here, because serving settings changed between releases and no row names the registered release. No Examenos recomputation.

Checked / reported: 2026-11-08 · Evaluated: 2026-10-16 · Samples: Not published

Snapshot: 2026-10-28 · Revision: v0.3.0; source_sha256=90ec4137edf485c5f6927c14d22188a6cea26e3355f0fd0e93d68da251c5e5d8 · Published summary observations; upstream task/result terms retained

Calibration on the core image track.

kettei-chub (Sqwish); board key kettei_chub; last measured 2026-10-16T17:44:49.888791+00:00.

Exact published core-track row.

Benchmark Heaven's image decision benchmark, core track of v0.3.0, built 2026-10-28T18:06:26.533607+00:00. Published core track only; dated carry and computer-use track are separate. Cite source_sha256 for the exact result bytes. Separate from JevBench text rows and the community vision index. H2O image rows are not stored here, because serving settings changed between releases and no row names the registered release. No Examenos recomputation.

Checked / reported: 2026-11-08 · Evaluated: 2026-10-16 · Samples: Not published

Snapshot: 2026-10-28 · Revision: v0.3.0; source_sha256=90ec4137edf485c5f6927c14d22188a6cea26e3355f0fd0e93d68da251c5e5d8 · Published summary observations; upstream task/result terms retained

Speed axis on the core image track.

kettei-chub (Sqwish); board key kettei_chub; last measured 2026-10-16T17:44:49.888791+00:00.

Exact published core-track row.

Benchmark Heaven's image decision benchmark, core track of v0.3.0, built 2026-10-28T18:06:26.533607+00:00. Published core track only; dated carry and computer-use track are separate. Cite source_sha256 for the exact result bytes. Separate from JevBench text rows and the community vision index. H2O image rows are not stored here, because serving settings changed between releases and no row names the registered release. No Examenos recomputation.

Checked / reported: 2026-11-08 · Evaluated: 2026-10-16 · Samples: Not published

Snapshot: 2026-10-28 · Revision: v0.3.0; source_sha256=90ec4137edf485c5f6927c14d22188a6cea26e3355f0fd0e93d68da251c5e5d8 · Published summary observations; upstream task/result terms retained

Cost axis on the core image track.

kettei-chub (Sqwish); board key kettei_chub; last measured 2026-10-16T17:44:49.888791+00:00.

Exact published core-track row.

Benchmark Heaven's image decision benchmark, core track of v0.3.0, built 2026-10-28T18:06:26.533607+00:00. Published core track only; dated carry and computer-use track are separate. Cite source_sha256 for the exact result bytes. Separate from JevBench text rows and the community vision index. H2O image rows are not stored here, because serving settings changed between releases and no row names the registered release. No Examenos recomputation.

Checked / reported: 2026-11-08 · Evaluated: 2026-10-16 · Samples: Not published

Snapshot: 2026-10-28 · Revision: v0.3.0; source_sha256=90ec4137edf485c5f6927c14d22188a6cea26e3355f0fd0e93d68da251c5e5d8 · Published summary observations; upstream task/result terms retained