The benchmark library
Choose what to compare.
Browse by category, then open a benchmark to see every model’s results.
Data coverage
Choose a model to see which benchmarks have recorded results and which are missing.
Explore coverage → Explore changes by dateResults over time
Choose a benchmark, then drag its timeline to see the scores we had recorded at each date.
Open benchmark timelines →Loading benchmark library…
AA Intelligence Index (vendor-cited)
Artificial Analysis Intelligence Index as cited by vendor blog
16 current versions with results · 55 current models · older versions hidden
Higher is better · index. Missing results are not zero. Expand Evidence for source dates, efforts and harness notes.
| Provider | Published / checked | Evidence | ||
|---|---|---|---|---|
| Claude Fable 5.1Anthropic | Anthropic | 66 | — | All 2 recorded results & sources66 · raw 66 index Headline · unknown effort · Peer vendor Source/record date: Not recorded from chart/figure as reported on Ling-3.0-flash-VL HF card AA Index v4.1.1 chart (peer spillover); Claude Fable 5.1 (max with fallback) https://huggingface.co/inclusionAI/Ling-3.0-flash-VL53 · raw 53 index Alternative · max effort · Peer vendor Source/record date: 2026-10-12 Harness: As reported by Meta for this peer model; Rounded vendor citation of AA Intelligence Index v4.3; exact independent index values kept separately. Source checked 12 October 2026; evaluation date unpublished. Transcribed from model-card page 3 image; max effort except Full SWE-Marathon xhigh. https://research.meta.ai/static/muse-wonder-model-card |
| Muse Spark 1.3Meta | Meta | 62 | — | All 2 recorded results & sources62 · raw 62 index Headline · unknown effort · Peer vendor Source/record date: Not recorded from chart/figure as reported on Ling-3.0-flash-VL HF card AA Index v4.1.1 chart (peer spillover); Muse Spark 1.3 (max) https://huggingface.co/inclusionAI/Ling-3.0-flash-VL48 · raw 48 index Alternative · unknown effort · Peer vendor Source/record date: 2026-10-12 Harness: As reported by Meta for this peer model; Meta-cited AA Intelligence Index snapshot, 12 October 2026; chart effort unspecified. Source checked 12 October 2026; evaluation date unpublished. Figure/table transcribed visually; do not infer unpublished configuration details. https://research.meta.ai/articles/introducing-muse-wonder/images/aa-intelligence-index-light-v5.webp |
| GPT-6 AstraOpenAI | OpenAI | 61 | — | All 2 recorded results & sources61 · raw 61 index Headline · unknown effort · Peer vendor Source/record date: Not recorded from chart/figure as reported on Ling-3.0-flash-VL HF card AA Index v4.1.1 chart (peer spillover); GPT-6 Astra (max) https://huggingface.co/inclusionAI/Ling-3.0-flash-VL53 · raw 53 index Alternative · max effort · Peer vendor Source/record date: 2026-10-12 Harness: As reported by Meta for this peer model; Rounded vendor citation of AA Intelligence Index v4.3; exact independent index values kept separately. Source checked 12 October 2026; evaluation date unpublished. Transcribed from model-card page 3 image; max effort except Full SWE-Marathon xhigh. https://research.meta.ai/static/muse-wonder-model-card |
| GLM-5.3Z.ai | Z.ai | 60 | — | All 2 recorded results & sources60 · raw 60 index Headline · unknown effort · Peer vendor Source/record date: Not recorded from chart/figure as reported on Ling-3.0-flash-VL HF card AA Index v4.1.1 chart (peer spillover); GLM-5.3 (max) https://huggingface.co/inclusionAI/Ling-3.0-flash-VL45 · raw 45 index Alternative · max effort · Peer vendor Source/record date: 2026-10-15 Harness: AA Intelligence Index v4.3, cited by Meta as sourced 7 October 2026; direct AA model result unavailable at check time. Source date is not an execution date. As reported by Meta in Muse Spark Open release, not direct evaluator verification. Source checked 15 October 2026; exact execution date unpublished. https://huggingface.co/meta-models/Muse-Spark-Open-816B-A42B |
| Gemini 3.8 FlashGoogle | 59 | — | All 2 recorded results & sources59 · raw 59 index Headline · unknown effort · Peer vendor Source/record date: Not recorded from chart/figure as reported on Ling-3.0-flash-VL HF card AA Index v4.1.1 chart (peer spillover); Gemini 3.8 Flash (high) https://huggingface.co/inclusionAI/Ling-3.0-flash-VL41 · raw 41 index Alternative · unknown effort · Peer vendor Source/record date: 2026-10-12 Harness: As reported by Meta for this peer model; Meta-cited AA Intelligence Index snapshot, 12 October 2026; chart effort unspecified. Source checked 12 October 2026; evaluation date unpublished. Figure/table transcribed visually; do not infer unpublished configuration details. https://research.meta.ai/articles/introducing-muse-wonder/images/aa-intelligence-index-light-v5.webp | |
| Claude Opus 5.5Anthropic | Anthropic | 58 | 2026-10-12 | All 1 recorded result & sources58 · raw 58 index Headline · max effort · Peer vendor Source/record date: 2026-10-12 Harness: As reported by Meta for this peer model; Rounded vendor citation of AA Intelligence Index v4.3; exact independent index values kept separately. Source checked 12 October 2026; evaluation date unpublished. Transcribed from model-card page 3 image; max effort except Full SWE-Marathon xhigh. https://research.meta.ai/static/muse-wonder-model-card |
| GLM-5.3-FlashZ.ai | Z.ai | 57 | 2026-08-26 | All 1 recorded result & sources57 · raw 57 index Headline · unknown effort · Own vendor Source/record date: 2026-08-26 AA Intelligence Index v4.1.1 as cited by z.ai ($0.045/task discounted) https://z.ai/blog/glm-5.3-flash |
| Muse Wonder FullMeta | Meta | 56 | 2026-10-12 | All 1 recorded result & sources56 · raw 56 index Headline · max effort · Own vendor Source/record date: 2026-10-12 Harness: Meta launch evaluation; Rounded vendor citation of AA Intelligence Index v4.3; exact independent index values kept separately. Source checked 12 October 2026; evaluation date unpublished. Transcribed from model-card page 3 image; max effort except Full SWE-Marathon xhigh. https://research.meta.ai/static/muse-wonder-model-card |
| GPT-5.6 TerraOpenAI | OpenAI | 55 | 2026-07-09 | All 1 recorded result & sources55 · raw 55 index Headline · unknown effort · Own vendor Source/record date: 2026-07-09 Vendor-cited AA number in OpenAI table (still official announcement provenance) · Vendor-cited AA Intelligence Index v4.1 https://openai.com/index/gpt-5-6 |
| Gemini 4 ArgonGoogle | 53 | 2026-10-12 | All 1 recorded result & sources53 · raw 53 index Headline · unknown effort · Peer vendor Source/record date: 2026-10-12 Harness: As reported by Meta for this peer model; Meta-cited AA Intelligence Index snapshot, 12 October 2026; chart effort unspecified. Source checked 12 October 2026; evaluation date unpublished. Figure/table transcribed visually; do not infer unpublished configuration details. https://research.meta.ai/articles/introducing-muse-wonder/images/aa-intelligence-index-light-v5.webp | |
| GPT-6.1 SolOpenAI | OpenAI | 52 | 2026-10-12 | All 1 recorded result & sources52 · raw 52 index Headline · unknown effort · Peer vendor Source/record date: 2026-10-12 Harness: As reported by Meta for this peer model; Meta-cited AA Intelligence Index snapshot, 12 October 2026; chart effort unspecified. Source checked 12 October 2026; evaluation date unpublished. Figure/table transcribed visually; do not infer unpublished configuration details. https://research.meta.ai/articles/introducing-muse-wonder/images/aa-intelligence-index-light-v5.webp |
| Muse WonderMeta | Meta | 52 | 2026-10-12 | All 1 recorded result & sources52 · raw 52 index Headline · max effort · Own vendor Source/record date: 2026-10-12 Harness: Meta launch evaluation; Rounded vendor citation of AA Intelligence Index v4.3; exact independent index values kept separately. Source checked 12 October 2026; evaluation date unpublished. Transcribed from model-card page 3 image; max effort except Full SWE-Marathon xhigh. https://research.meta.ai/static/muse-wonder-model-card |
| Kimi K3Moonshot AI | Moonshot AI | 44 | 2026-10-15 | All 1 recorded result & sources44 · raw 44 index Headline · max effort · Peer vendor Source/record date: 2026-10-15 Harness: AA Intelligence Index v4.3, cited by Meta as sourced 7 October 2026; direct AA model result unavailable at check time. Source date is not an execution date. As reported by Meta in Muse Spark Open release, not direct evaluator verification. Source checked 15 October 2026; exact execution date unpublished. https://huggingface.co/meta-models/Muse-Spark-Open-816B-A42B |
| Ling 3.0 Flash VLinclusionAI | inclusionAI | 42 | 2026-09-10 | All 1 recorded result & sources42 · raw 42 index Headline · unknown effort · Own vendor Source/record date: 2026-09-10 Vendor-reported AA Intelligence Index v4.1.1 (not live AA v4.3) https://huggingface.co/inclusionAI/Ling-3.0-flash-VL |
| Muse Spark OpenMeta | Meta | 39 | 2026-10-15 | All 1 recorded result & sources39 · raw 39 index Headline · xhigh effort · Own vendor Source/record date: 2026-10-15 Harness: AA Intelligence Index v4.3, cited by Meta as sourced 7 October 2026; direct AA model result unavailable at check time. Source date is not an execution date. As reported by Meta in Muse Spark Open release, not direct evaluator verification. Launch xhigh (strength 512), temperature/top_p=1.0, top_k disabled. Source checked 15 October 2026; exact execution date unpublished. https://huggingface.co/meta-models/Muse-Spark-Open-816B-A42B |
| Mistral Large 4Mistral AI | Mistral AI | 38 | 2026-10-15 | All 1 recorded result & sources38 · raw 38 index Headline · unknown effort · Peer vendor Source/record date: 2026-10-15 Harness: AA Intelligence Index v4.3, cited by Meta as sourced 7 October 2026; direct AA model result unavailable at check time. Source date is not an execution date. As reported by Meta in Muse Spark Open release, not direct evaluator verification. Source checked 15 October 2026; exact execution date unpublished. https://huggingface.co/meta-models/Muse-Spark-Open-816B-A42B |
| Agens Volundr 32B v1Blockway | Blockway | — | — | No recorded result |
| Beam 1.0Reflection AI | Reflection AI | — | — | No recorded result |
| Claude Haiku 5.5Anthropic | Anthropic | — | — | No recorded result |
| Claude Sonnet 5.5Anthropic | Anthropic | — | — | No recorded result |
| DeepSeek V4.1 FlashOlder versionView latest →DeepSeek | DeepSeek | — | — | No recorded result |
| DeepSeek V4.1 Flash 1017Latest versionDeepSeek | DeepSeek | — | — | No recorded result |
| Gemma 4 12B UnifiedGoogle | — | — | No recorded result | |
| Gemma 4 26B-A4BGoogle | — | — | No recorded result | |
| Gemma 4 31BGoogle | — | — | No recorded result | |
| Gemma 4 E2BGoogle | — | — | No recorded result | |
| Gemma 4 E4BGoogle | — | — | No recorded result | |
| GoTo-AI-Gemma-3-27B-ITGoTo / AI Singapore | GoTo / AI Singapore | — | — | No recorded result |
| GPT-6 LunaOpenAI | OpenAI | — | — | No recorded result |
| Grok 4.7xAI | xAI | — | — | No recorded result |
| Hy-Memory-30B-A3BTencent Hunyuan | Tencent Hunyuan | — | — | No recorded result |
| Hy4 previewTencent | Tencent | — | — | No recorded result |
| Jais 3 32BIFM / Inception42 | IFM / Inception42 | — | — | No recorded result |
| Jais 3 375B-A23BIFM / Inception42 | IFM / Inception42 | — | — | No recorded result |
| Jais 3 MoVA 36B-A4BIFM / Inception42 | IFM / Inception42 | — | — | No recorded result |
| Kolibri-1Aleph Alpha | Aleph Alpha | — | — | No recorded result |
| LFM2.5-24B-A2BLiquid AI | Liquid AI | — | — | No recorded result |
| Ling 3.1 FlashinclusionAI | inclusionAI | — | — | No recorded result |
| Mercury 2.5Older versionView latest →Inception | Inception | — | — | No recorded result |
| Mercury 3Latest versionInception | Inception | — | — | No recorded result |
| MiMo-V2.6-Distill-Qwen-9BXiaomi | Xiaomi | — | — | No recorded result |
| MiMo-V2.6-FlashXiaomi | Xiaomi | — | — | No recorded result |
| MiMo-V2.6-ProXiaomi | Xiaomi | — | — | No recorded result |
| MiniCPM-V 4.7 35B-A3BOpenBMB | OpenBMB | — | — | No recorded result |
| MiniMax M3.1 FlashMiniMax | MiniMax | — | — | No recorded result |
| Naive-N0.5-FlashNaiveAI | NaiveAI | — | — | No recorded result |
| Nemotron 3.5 Bolt 74B-A9B (BF16)NVIDIA | NVIDIA | — | — | No recorded result |
| Nemotron 3.5 Lightning 30B-A3BNVIDIA | NVIDIA | — | — | No recorded result |
| Nemotron 3.5 Super VL 120B-A12B (BF16)NVIDIA | NVIDIA | — | — | No recorded result |
| Nex-N2.5-ProNex AGI | Nex AGI | — | — | No recorded result |
| Pareto 26.10 PreviewUnbiased | Unbiased | — | — | No recorded result |
| Qwen3.8 27BAlibaba (Qwen) | Alibaba (Qwen) | — | — | No recorded result |
| Qwen3.8 FlashAlibaba (Qwen) | Alibaba (Qwen) | — | — | No recorded result |
| Qwen3.8 Max (0902)Alibaba (Qwen) | Alibaba (Qwen) | — | — | No recorded result |
| Qwen3.8 Omni FlashAlibaba (Qwen) | Alibaba (Qwen) | — | — | No recorded result |
| Solar Pro 4Upstage | Upstage | — | — | No recorded result |
| Step 5 PreviewStepFun | StepFun | — | — | No recorded result |