Amos 1 Small
Explore Amos 1 Small: exact decision configuration, published specifications, source-linked benchmarks and API tariffs when available.
← All decision models · Compare this decision system →
17 recorded observations. Published results retain their source and setup; no Examenos evaluation was run. Missing results are not zero. How to read these comparisons →
Official / vendor · Scira (vendor run / card)
| Evaluation | Result | Evidence |
|---|---|---|
| Scira · Amos 1 cards · Typed decisions · accuracy | 69.5% | Setup & sourceTyped decisions test split, 2,000 decisions from four workflows, zero-shot. Amos 1 small, card 88713c7. Typed decisions test split, zero-shot. Printed in the vendor’s own card table. Scira’s own results on the four Amos 1 Hugging Face cards, each read at the pinned card revision. “As served” rows use Scira’s hosted or packaged server; the cards name no hardware for the score tables. Each value cites its own card. Checked / reported: 2026-11-08 · Samples: 2000 Snapshot: 2026-10-13 · Revision: amos-1-large card d67e051c763dc88a1e3662a5003c1e1ea5ffaa74; amos-1-medium card c7f72b601b276f635fb5a9c1901bd96a10a60fe8; amos-1-small card 88713c7be8e5f8122272d276ec3c44ff0528d7e2; amos-1-mini card a59a936bf608dc8fc3ae47ad7715af2153150f3b · Published observations; result reuse terms not specified Result source · Benchmark source |
| Scira · Amos 1 cards · Typed decisions · KL | 0.181 KL | Setup & sourceTyped decisions test split, 2,000 decisions from four workflows, zero-shot. Amos 1 small, card 88713c7. Typed decisions test split, zero-shot. Printed in the vendor’s own card table. Scira’s own results on the four Amos 1 Hugging Face cards, each read at the pinned card revision. “As served” rows use Scira’s hosted or packaged server; the cards name no hardware for the score tables. Each value cites its own card. Checked / reported: 2026-11-08 · Samples: 2000 Snapshot: 2026-10-13 · Revision: amos-1-large card d67e051c763dc88a1e3662a5003c1e1ea5ffaa74; amos-1-medium card c7f72b601b276f635fb5a9c1901bd96a10a60fe8; amos-1-small card 88713c7be8e5f8122272d276ec3c44ff0528d7e2; amos-1-mini card a59a936bf608dc8fc3ae47ad7715af2153150f3b · Published observations; result reuse terms not specified Result source · Benchmark source |
| Scira · Amos 1 cards · Typed decisions · Brier | 0.098 Brier | Setup & sourceTyped decisions test split, 2,000 decisions from four workflows, zero-shot. Amos 1 small, card 88713c7. Typed decisions test split, zero-shot. Printed in the vendor’s own card table. Scira’s own results on the four Amos 1 Hugging Face cards, each read at the pinned card revision. “As served” rows use Scira’s hosted or packaged server; the cards name no hardware for the score tables. Each value cites its own card. Checked / reported: 2026-11-08 · Samples: 2000 Snapshot: 2026-10-13 · Revision: amos-1-large card d67e051c763dc88a1e3662a5003c1e1ea5ffaa74; amos-1-medium card c7f72b601b276f635fb5a9c1901bd96a10a60fe8; amos-1-small card 88713c7be8e5f8122272d276ec3c44ff0528d7e2; amos-1-mini card a59a936bf608dc8fc3ae47ad7715af2153150f3b · Published observations; result reuse terms not specified Result source · Benchmark source |
| Scira · Amos 1 cards · Typed decisions · accuracy with priors fitted on train | 74.40% | Setup & sourcePer-question priors fitted on the benchmark’s train split and applied at answer time; the weights do not change. Not zero-shot. Amos 1 small, card 88713c7. Priors fitted on the train split; not zero-shot. Printed in the vendor’s own card table. Scira’s own results on the four Amos 1 Hugging Face cards, each read at the pinned card revision. “As served” rows use Scira’s hosted or packaged server; the cards name no hardware for the score tables. Each value cites its own card. Checked / reported: 2026-11-08 · Samples: 2000 Snapshot: 2026-10-13 · Revision: amos-1-large card d67e051c763dc88a1e3662a5003c1e1ea5ffaa74; amos-1-medium card c7f72b601b276f635fb5a9c1901bd96a10a60fe8; amos-1-small card 88713c7be8e5f8122272d276ec3c44ff0528d7e2; amos-1-mini card a59a936bf608dc8fc3ae47ad7715af2153150f3b · Published observations; result reuse terms not specified Result source · Benchmark source |
| Scira · Amos 1 cards · Decision Index 0.3 · public part | 31.92 | Setup & sourceDecision Index 0.3 public part, scored with the board’s own kit; the board’s ranking adds private tests. Amos 1 small, card 88713c7. Public part with the board’s kit. Printed in the vendor’s own card table. Scira’s own results on the four Amos 1 Hugging Face cards, each read at the pinned card revision. “As served” rows use Scira’s hosted or packaged server; the cards name no hardware for the score tables. Each value cites its own card. Checked / reported: 2026-11-08 · Samples: Not published Snapshot: 2026-10-13 · Revision: amos-1-large card d67e051c763dc88a1e3662a5003c1e1ea5ffaa74; amos-1-medium card c7f72b601b276f635fb5a9c1901bd96a10a60fe8; amos-1-small card 88713c7be8e5f8122272d276ec3c44ff0528d7e2; amos-1-mini card a59a936bf608dc8fc3ae47ad7715af2153150f3b · Published observations; result reuse terms not specified Result source · Benchmark source |
| Scira · Amos 1 cards · JevBench public · easy | 100.0% | Setup & sourceJevBench public easy items, as served. Amos 1 small, card 88713c7. As served. Printed in the vendor’s own card table. Scira’s own results on the four Amos 1 Hugging Face cards, each read at the pinned card revision. “As served” rows use Scira’s hosted or packaged server; the cards name no hardware for the score tables. Each value cites its own card. Checked / reported: 2026-11-08 · Samples: Not published Snapshot: 2026-10-13 · Revision: amos-1-large card d67e051c763dc88a1e3662a5003c1e1ea5ffaa74; amos-1-medium card c7f72b601b276f635fb5a9c1901bd96a10a60fe8; amos-1-small card 88713c7be8e5f8122272d276ec3c44ff0528d7e2; amos-1-mini card a59a936bf608dc8fc3ae47ad7715af2153150f3b · Published observations; result reuse terms not specified Result source · Benchmark source |
| Scira · Amos 1 cards · JevBench public · standard | 93.1% | Setup & sourceJevBench public standard items, as served. Amos 1 small, card 88713c7. As served. Printed in the vendor’s own card table. Scira’s own results on the four Amos 1 Hugging Face cards, each read at the pinned card revision. “As served” rows use Scira’s hosted or packaged server; the cards name no hardware for the score tables. Each value cites its own card. Checked / reported: 2026-11-08 · Samples: Not published Snapshot: 2026-10-13 · Revision: amos-1-large card d67e051c763dc88a1e3662a5003c1e1ea5ffaa74; amos-1-medium card c7f72b601b276f635fb5a9c1901bd96a10a60fe8; amos-1-small card 88713c7be8e5f8122272d276ec3c44ff0528d7e2; amos-1-mini card a59a936bf608dc8fc3ae47ad7715af2153150f3b · Published observations; result reuse terms not specified Result source · Benchmark source |
| Scira · Amos 1 cards · JevBench public · hard | 53.2% | Setup & sourceJevBench public hard items, as served. Amos 1 small, card 88713c7. As served. Printed in the vendor’s own card table. Scira’s own results on the four Amos 1 Hugging Face cards, each read at the pinned card revision. “As served” rows use Scira’s hosted or packaged server; the cards name no hardware for the score tables. Each value cites its own card. Checked / reported: 2026-11-08 · Samples: Not published Snapshot: 2026-10-13 · Revision: amos-1-large card d67e051c763dc88a1e3662a5003c1e1ea5ffaa74; amos-1-medium card c7f72b601b276f635fb5a9c1901bd96a10a60fe8; amos-1-small card 88713c7be8e5f8122272d276ec3c44ff0528d7e2; amos-1-mini card a59a936bf608dc8fc3ae47ad7715af2153150f3b · Published observations; result reuse terms not specified Result source · Benchmark source |
| Scira · Amos 1 cards · Ten public benchmarks | 72.1% | Setup & sourceMean over RAGTruth, JudgeBench, Belebele, WinoGrande, ContractNLI, TruthfulQA, Circa, Financial PhraseBank, TabFact and BBH, as served. Amos 1 small, card 88713c7. As served. Printed in the vendor’s own card table. Scira’s own results on the four Amos 1 Hugging Face cards, each read at the pinned card revision. “As served” rows use Scira’s hosted or packaged server; the cards name no hardware for the score tables. Each value cites its own card. Checked / reported: 2026-11-08 · Samples: Not published Snapshot: 2026-10-13 · Revision: amos-1-large card d67e051c763dc88a1e3662a5003c1e1ea5ffaa74; amos-1-medium card c7f72b601b276f635fb5a9c1901bd96a10a60fe8; amos-1-small card 88713c7be8e5f8122272d276ec3c44ff0528d7e2; amos-1-mini card a59a936bf608dc8fc3ae47ad7715af2153150f3b · Published observations; result reuse terms not specified Result source · Benchmark source |
| Scira · Amos 1 cards · AG News | 86.5% | Setup & sourceAG News, as served. Amos 1 small, card 88713c7. As served. Printed in the vendor’s own card table. Scira’s own results on the four Amos 1 Hugging Face cards, each read at the pinned card revision. “As served” rows use Scira’s hosted or packaged server; the cards name no hardware for the score tables. Each value cites its own card. Checked / reported: 2026-11-08 · Samples: Not published Snapshot: 2026-10-13 · Revision: amos-1-large card d67e051c763dc88a1e3662a5003c1e1ea5ffaa74; amos-1-medium card c7f72b601b276f635fb5a9c1901bd96a10a60fe8; amos-1-small card 88713c7be8e5f8122272d276ec3c44ff0528d7e2; amos-1-mini card a59a936bf608dc8fc3ae47ad7715af2153150f3b · Published observations; result reuse terms not specified Result source · Benchmark source |
| Scira · Amos 1 cards · DAIR Emotion | 58.5% | Setup & sourceDAIR Emotion, as served. Amos 1 small, card 88713c7. As served. Printed in the vendor’s own card table. Scira’s own results on the four Amos 1 Hugging Face cards, each read at the pinned card revision. “As served” rows use Scira’s hosted or packaged server; the cards name no hardware for the score tables. Each value cites its own card. Checked / reported: 2026-11-08 · Samples: Not published Snapshot: 2026-10-13 · Revision: amos-1-large card d67e051c763dc88a1e3662a5003c1e1ea5ffaa74; amos-1-medium card c7f72b601b276f635fb5a9c1901bd96a10a60fe8; amos-1-small card 88713c7be8e5f8122272d276ec3c44ff0528d7e2; amos-1-mini card a59a936bf608dc8fc3ae47ad7715af2153150f3b · Published observations; result reuse terms not specified Result source · Benchmark source |
| Scira · Amos 1 cards · Banking77 | 76.0% | Setup & sourceBanking77, as served. Amos 1 small, card 88713c7. As served. 77 labels. Printed in the vendor’s own card table. Scira’s own results on the four Amos 1 Hugging Face cards, each read at the pinned card revision. “As served” rows use Scira’s hosted or packaged server; the cards name no hardware for the score tables. Each value cites its own card. Checked / reported: 2026-11-08 · Samples: Not published Snapshot: 2026-10-13 · Revision: amos-1-large card d67e051c763dc88a1e3662a5003c1e1ea5ffaa74; amos-1-medium card c7f72b601b276f635fb5a9c1901bd96a10a60fe8; amos-1-small card 88713c7be8e5f8122272d276ec3c44ff0528d7e2; amos-1-mini card a59a936bf608dc8fc3ae47ad7715af2153150f3b · Published observations; result reuse terms not specified Result source · Benchmark source |
| Scira · Amos 1 cards · Invoice totals quoted exactly | 9 of 10 | Setup & sourceInvoice totals quoted exactly, out of 10, as served. Amos 1 small, card 88713c7. As served. Printed in the vendor’s own card table. Scira’s own results on the four Amos 1 Hugging Face cards, each read at the pinned card revision. “As served” rows use Scira’s hosted or packaged server; the cards name no hardware for the score tables. Each value cites its own card. Checked / reported: 2026-11-08 · Samples: 10 Snapshot: 2026-10-13 · Revision: amos-1-large card d67e051c763dc88a1e3662a5003c1e1ea5ffaa74; amos-1-medium card c7f72b601b276f635fb5a9c1901bd96a10a60fe8; amos-1-small card 88713c7be8e5f8122272d276ec3c44ff0528d7e2; amos-1-mini card a59a936bf608dc8fc3ae47ad7715af2153150f3b · Published observations; result reuse terms not specified Result source · Benchmark source |
| Scira · Amos 1 cards · RefCOCO · box centred on the named object | 94.2% | Setup & sourceShare of RefCOCO boxes centred on the named object, as served. Amos 1 small, card 88713c7. As served. Printed in the vendor’s own card table. Scira’s own results on the four Amos 1 Hugging Face cards, each read at the pinned card revision. “As served” rows use Scira’s hosted or packaged server; the cards name no hardware for the score tables. Each value cites its own card. Checked / reported: 2026-11-08 · Samples: Not published Snapshot: 2026-10-13 · Revision: amos-1-large card d67e051c763dc88a1e3662a5003c1e1ea5ffaa74; amos-1-medium card c7f72b601b276f635fb5a9c1901bd96a10a60fe8; amos-1-small card 88713c7be8e5f8122272d276ec3c44ff0528d7e2; amos-1-mini card a59a936bf608dc8fc3ae47ad7715af2153150f3b · Published observations; result reuse terms not specified Result source · Benchmark source |
| Scira · Amos 1 cards · RefCOCO · box covering at least half the object | 77.2% | Setup & sourceShare of RefCOCO boxes covering at least half the named object, as served. Amos 1 small, card 88713c7. As served. Printed in the vendor’s own card table. Scira’s own results on the four Amos 1 Hugging Face cards, each read at the pinned card revision. “As served” rows use Scira’s hosted or packaged server; the cards name no hardware for the score tables. Each value cites its own card. Checked / reported: 2026-11-08 · Samples: Not published Snapshot: 2026-10-13 · Revision: amos-1-large card d67e051c763dc88a1e3662a5003c1e1ea5ffaa74; amos-1-medium card c7f72b601b276f635fb5a9c1901bd96a10a60fe8; amos-1-small card 88713c7be8e5f8122272d276ec3c44ff0528d7e2; amos-1-mini card a59a936bf608dc8fc3ae47ad7715af2153150f3b · Published observations; result reuse terms not specified Result source · Benchmark source |
| Scira · Amos 1 cards · COCO · box centred on the named object | 97.5% | Setup & sourceShare of COCO boxes centred on the named object, as served. Amos 1 small, card 88713c7. As served. Printed in the vendor’s own card table. Scira’s own results on the four Amos 1 Hugging Face cards, each read at the pinned card revision. “As served” rows use Scira’s hosted or packaged server; the cards name no hardware for the score tables. Each value cites its own card. Checked / reported: 2026-11-08 · Samples: Not published Snapshot: 2026-10-13 · Revision: amos-1-large card d67e051c763dc88a1e3662a5003c1e1ea5ffaa74; amos-1-medium card c7f72b601b276f635fb5a9c1901bd96a10a60fe8; amos-1-small card 88713c7be8e5f8122272d276ec3c44ff0528d7e2; amos-1-mini card a59a936bf608dc8fc3ae47ad7715af2153150f3b · Published observations; result reuse terms not specified Result source · Benchmark source |
| Scira · Amos 1 cards · Server time, median, three-question request | 48 ms | Setup & sourceMedian server time for a three-question request; hardware not stated. Amos 1 small, card 88713c7. Median, three-question request; hardware not stated. Printed in the vendor’s own card table. Scira’s own results on the four Amos 1 Hugging Face cards, each read at the pinned card revision. “As served” rows use Scira’s hosted or packaged server; the cards name no hardware for the score tables. Each value cites its own card. Checked / reported: 2026-11-08 · Samples: Not published Snapshot: 2026-10-13 · Revision: amos-1-large card d67e051c763dc88a1e3662a5003c1e1ea5ffaa74; amos-1-medium card c7f72b601b276f635fb5a9c1901bd96a10a60fe8; amos-1-small card 88713c7be8e5f8122272d276ec3c44ff0528d7e2; amos-1-mini card a59a936bf608dc8fc3ae47ad7715af2153150f3b · Published observations; result reuse terms not specified Result source · Benchmark source |