H2O-Lightning-Bolt-74B Decision Model Results

H2O-Lightning-Bolt-74B

Explore H2O-Lightning-Bolt-74B: exact decision configuration, published specifications, source-linked benchmarks and API tariffs when available.

Published specifications

Provider: H2O.ai
Version: v1.0.1 (checkpoint step 30000)
System type: Trained checkpoint
Access: Open weights
License: H2O Model Non-Commercial Licence v1.1 (gated: accept the licence on the model page)
Inputs: text, image
Decision types: Choice, Yes / no, Score, Box
Published size: 74B
Active parameters: 9B
Context / input limit: 131,072 tokens
Announced: 2026-11-01

Model card & announcement · Website

Model notes

Decision model from H2O.ai: one forward pass and one output token per decision, with a probability for every option. A fine-tune by its developer, not a third-party quantization. Announced date is the Hugging Face repository creation date; no separate announcement was found. Built on NVIDIA-Nemotron-3.5-Bolt-74B-A9B-24GB; 2-bit routed experts and bf16 dense modules, so Hugging Face counts 25.79B stored values while the card states 74B parameters and 9B active. Card speed on one RTX PRO 6000: 5.62 prompts per second at 64 in flight, median 314.2 ms one at a time. First published 1 November 2026.

Checkpoint revision: 10dde1982ed7795fbcbe5215af79c4af993a809a

← All decision models · Compare this decision system →

4 recorded observations. Published results retain their source and setup; no Examenos evaluation was run. Missing results are not zero. How to read these comparisons →

Official / vendor · H2O.ai model cards (vendor measured)

H2O-Lightning-Bolt-74B · Official / vendor · H2O.ai model cards (vendor measured)
Evaluation	Result	Evidence
H2O Lightning cards · JevBench 231 public items	94.4%	Setup & source Correct answers on the 231 public JevBench items, read through JevBench's own CLI in the setup each card names for JevBench. Release v1.0.1, default two-way serving, one NVIDIA RTX PRO 6000; JevBench mode. 218 of 231 correct on the card. H2O.ai's own runs, not a leaderboard result: its Decision Index rows use the public 0.3 kit and its own scorer, and the JevBench rows use JevBench's own CLI on the 231 public items. Hardware and serving profile differ by release, as each result states. Never compare with Leanmcp JevBench's board rows, Benchmark Heaven or community Decision Index 0.4 rows. Not ranked here. Checked / reported: 2026-11-02 · Samples: 231 Snapshot: 2026-11-02 · Revision: Cards read 2026-11-02; each result names its release and card revision · Published observations; result reuse terms not specified Result source · Benchmark source
H2O Lightning cards · Decision Index 0.3 public text index	65.51	Setup & source The kit's chance-corrected index on the public text suite (140,178 scored rows), in the setup each card names for the Decision Index. Release v1.0.1, default two-way serving, one NVIDIA RTX PRO 6000; Decision Index mode (PROFILE=di); each text question read twice. Printed on the model card. H2O.ai's own runs, not a leaderboard result: its Decision Index rows use the public 0.3 kit and its own scorer, and the JevBench rows use JevBench's own CLI on the 231 public items. Hardware and serving profile differ by release, as each result states. Never compare with Leanmcp JevBench's board rows, Benchmark Heaven or community Decision Index 0.4 rows. Not ranked here. Checked / reported: 2026-11-02 · Samples: 140178 Snapshot: 2026-11-02 · Revision: Cards read 2026-11-02; each result names its release and card revision · Published observations; result reuse terms not specified Result source · Benchmark source
H2O Lightning cards · Decision Index 0.3 public vision index	68.96	Setup & source The kit's index on the public vision suite (12,210 rows), in the setup each card names for the Decision Index. Release v1.0.1, default two-way serving, one NVIDIA RTX PRO 6000; Decision Index mode (PROFILE=di); images read once. Printed on the model card. H2O.ai's own runs, not a leaderboard result: its Decision Index rows use the public 0.3 kit and its own scorer, and the JevBench rows use JevBench's own CLI on the 231 public items. Hardware and serving profile differ by release, as each result states. Never compare with Leanmcp JevBench's board rows, Benchmark Heaven or community Decision Index 0.4 rows. Not ranked here. Checked / reported: 2026-11-02 · Samples: 12210 Snapshot: 2026-11-02 · Revision: Cards read 2026-11-02; each result names its release and card revision · Published observations; result reuse terms not specified Result source · Benchmark source
H2O Lightning cards · Calibration error, text rows	4.16 pp	Setup & source Calibration error on Decision Index text rows, published on a 0–1 scale; lower is better. Each result quotes its card's wording. Release v1.0.1, default two-way serving, one NVIDIA RTX PRO 6000; card label: calibration error of the top option, text rows, 10 equal-width bins. Published as 0.0416 on a 0–1 scale. H2O.ai's own runs, not a leaderboard result: its Decision Index rows use the public 0.3 kit and its own scorer, and the JevBench rows use JevBench's own CLI on the 231 public items. Hardware and serving profile differ by release, as each result states. Never compare with Leanmcp JevBench's board rows, Benchmark Heaven or community Decision Index 0.4 rows. Not ranked here. Checked / reported: 2026-11-02 · Samples: Not published Snapshot: 2026-11-02 · Revision: Cards read 2026-11-02; each result names its release and card revision · Published observations; result reuse terms not specified Result source · Benchmark source