# GPT-5.6 SolMax > Source: Benchize (https://benchize.com) — https://benchize.com/models/gpt-5-6-sol-max. When citing or reusing this content, credit "Benchize" and link to https://benchize.com/models/gpt-5-6-sol-max. OpenAI Canonical URL: https://benchize.com/models/gpt-5-6-sol-max Last updated: Wed, 21 Oct 2026 18:52:20 GMT Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations. OpenAI ## Benchmarks | Benchmark | Score | ± | Rank | Cost | Latency | Source | | | --- | --- | --- | --- | --- | --- | --- | --- | | [Legal Research Bench / health](https://benchize.com/benchmarks/vals-ai%3Alegal_research%3Ahealth.md) | 80% | SE ±7.43 pp | 1 / 50 | $22.84 | 4,151.25source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_research.DiuL0R8P.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 80 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 22.836198 \| USD \| per_test \| Lower is better \| \| `latency` \| 4151.253 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±7.43 pp sourcePopulation 82 stderr 7.428 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_research.DiuL0R8P.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:45:52.389Z Evidence SHA-256 `26c58dfd47d0d2dc86f33c6d056f30309e0ee63570e7cd752c593b385f9d862e` Source locator `/tasks/health/openai~1gpt-5.6-sol` | | | | | | | | | [Earthborne Rangers (EBR-bench)](https://benchize.com/benchmarks/epoch-ai%3Aebr_bench.md) | 44.76% | SE ±4.15 pp | 8 / 13 | — | — | [epoch ai · EBR-bench](https://epoch.ai/data/benchmark_data.zip#file=ebr_bench.csv) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.4476190476190475 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.4476190476190475 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion EBR-bench reasoningBudget Not reported Reasoning effort max sourceModelVersion gpt-5.6-sol_max ### Reported statistics Uncertainty Standard error: ±4.15 pp standardError 0.041513323271815936 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=ebr_bench.csv) Source epoch ai Original model label gpt-5.6-sol Source version EBR-bench Evaluated 2026-09-04T22:22:24.000Z Observed 2026-10-21T16:30:24.199Z Evidence SHA-256 `15ec96ff8e424623e6a7452956d849312f595f2b5cb4ebe70ec47831f9087b44` Source locator `/rows/8` | | | | | | | | | [DeepSWE](https://benchize.com/benchmarks/deepswe%3Av1.1.md) | 73% | — | 1 / 6 | — | — | [Moonshot AI · sha256:0e806bbad76dc8e8dbc899a86051e3406bdd5995fe6c6aa1b2176dde4fb28e6c](https://www.kimi.ai/blog/kimi-k3) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 73.0 \| percent \| reported \| Higher is better \| ### Configuration Reasoning effort max thinkingEnabled true ### Source Score publisher [Moonshot AI](https://www.kimi.ai/blog/kimi-k3) Collected via [moonshot k3](https://www.kimi.ai/blog/kimi-k3) Publisher reference Referenced by the collection source; the upstream result has not been independently captured. Benchmark [https://www.kimi.ai/blog/kimi-k3](https://www.kimi.ai/blog/kimi-k3) [Collected via](https://www.kimi.ai/blog/kimi-k3) Source Moonshot AI Original model label GPT 5.6 Sol (max) Source version sha256:0e806bbad76dc8e8dbc899a86051e3406bdd5995fe6c6aa1b2176dde4fb28e6c Observed 2026-10-21T16:31:44.130Z Evidence SHA-256 `0e806bbad76dc8e8dbc899a86051e3406bdd5995fe6c6aa1b2176dde4fb28e6c` Source locator `/flight/sheet/data/0/scores/2` | | | | | | | | | [CyberBench v1.1 / patch](https://benchize.com/benchmarks/benchmark%3Acyber%3Apatch.md) | 89.29% | SE ±4.13 pp | 1 / 28 | $1.05 | 544.58source duration | [Vals AI · 1.1](https://www.vals.ai/_astro/benchmark_view_cyberbench.DS6UOlu0.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 89.286 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 1.054807 \| USD \| per_test \| Lower is better \| \| `latency` \| 544.579 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±4.13 pp sourcePopulation 47 stderr 4.133 tokenTotals {"cache_read_tokens":74366882,"cache_write_tokens":3717011,"input_tokens":78127183,"output_tokens":528210,"reasoning_tokens":316000} ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_cyberbench.DS6UOlu0.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1.1 Observed 2026-10-21T16:46:15.238Z Evidence SHA-256 `943f593f929f8971a6b746269a2851b5febc2aad4e2f1066895f715033cdc7f1` Source locator `/tasks/patch/openai~1gpt-5.6-sol` | | | | | | | | | [Vals Science Index / mysterymechanism](https://benchize.com/benchmarks/vals-ai%3Ascience_index%3Amysterymechanism.md) | 33.33% | SE ±3.17 pp | 9 / 17 | $0.96 | 522.74source duration | [Vals AI · 1.0](https://www.vals.ai/_astro/benchmark_view_science_index.CN7FN-f1.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 33.333 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.96335 \| USD \| per_test \| Lower is better \| \| `latency` \| 522.744 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±3.17 pp sourcePopulation 21 stderr 3.171 tokenTotals {"cache_read_tokens":121397470,"cache_write_tokens":8456854,"input_tokens":130077211,"output_tokens":6106439,"reasoning_tokens":3933893} ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_science_index.CN7FN-f1.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1.0 Observed 2026-10-21T16:45:50.879Z Evidence SHA-256 `fa4313008e91752fcfc185aaa78665f780d0fc23d7c7198a9853dbf2eaaaef1f` Source locator `/tasks/mysterymechanism/openai~1gpt-5.6-sol` | | | | | | | | | [Legal Research Bench / constitutional civil rights](https://benchize.com/benchmarks/vals-ai%3Alegal_research%3Aconstitutional_civil_rights.md) | 34.21% | SE ±7.8 pp | 19 / 50 | $14.53 | 3,868.67source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_research.DiuL0R8P.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 34.211 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 14.526185 \| USD \| per_test \| Lower is better \| \| `latency` \| 3868.674 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±7.8 pp sourcePopulation 82 stderr 7.799 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_research.DiuL0R8P.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:45:52.389Z Evidence SHA-256 `26c58dfd47d0d2dc86f33c6d056f30309e0ee63570e7cd752c593b385f9d862e` Source locator `/tasks/constitutional_civil_rights/openai~1gpt-5.6-sol` | | | | | | | | | [FrontierMath Tiers 1–3 v2 (private)](https://benchize.com/benchmarks/epoch-ai%3Afrontiermath_tiers_1_3_v2.md) | 89.12% | SE ±1.85 pp | 6 / 49 | — | — | [epoch ai · FrontierMath-Tiers-1-3-v2-Private](https://epoch.ai/data/benchmark_data.zip#file=frontiermath_tiers_1_3_v2.csv) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.8912280701754386 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.8912280701754386 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion FrontierMath-Tiers-1-3-v2-Private reasoningBudget Not reported Reasoning effort max sourceModelVersion gpt-5.6-sol_max ### Reported statistics Uncertainty Standard error: ±1.85 pp standardError 0.018475392571140503 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=frontiermath_tiers_1_3_v2.csv) Source epoch ai Original model label gpt-5.6-sol Source version FrontierMath-Tiers-1-3-v2-Private Evaluated 2026-07-09T02:45:09.000Z Observed 2026-10-21T16:30:24.199Z Evidence SHA-256 `6e31ece7503f8f89dffe8af33010ed7d1d6f0aa3a80cff14fa79f9b34a7b258f` Source locator `/rows/86` | | | | | | | | | [MMLU Pro / physics](https://benchize.com/benchmarks/vals-ai%3Ammlu_pro%3Aphysics.md) | 92.76% | SE ±0.72 pp | 15 / 40 | $0.03 | 13.72source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 92.764 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.032534 \| USD \| per_test \| Lower is better \| \| `latency` \| 13.717 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.72 pp sourcePopulation 138 stderr 0.719 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:46:06.503Z Evidence SHA-256 `dab025507f46c716dd8d145e90ec0a737d9c56219853f41e4b1cc3c5e8c222b4` Source locator `/tasks/physics/openai~1gpt-5.6-sol` | | | | | | | | | [Finance Agent (v2) / precedents](https://benchize.com/benchmarks/vals-ai%3Afabv2%3Aprecedents.md) | 26.19% | SE ±0.85 pp | 25 / 50 | $2.12 | 1,935.49source duration | [Vals AI · 2](https://www.vals.ai/_astro/benchmark_view_finance_agent_v2.DypCOnwd.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 26.192 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 2.11729 \| USD \| per_test \| Lower is better \| \| `latency` \| 1935.492 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.85 pp sourcePopulation 80 stderr 0.847 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_finance_agent_v2.DypCOnwd.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 2 Observed 2026-10-21T16:45:57.035Z Evidence SHA-256 `f731b20a26c126725d125519f2b5841aa45254656dba859a9570d7ce7e5d8191` Source locator `/tasks/precedents/openai~1gpt-5.6-sol` | | | | | | | | | [IOI / ioi2025](https://benchize.com/benchmarks/vals-ai%3Aioi%3Aioi2025.md) | 88.33% | SE ±10.65 pp | 5 / 29 | $8.93 | 3,965.79source duration | [Vals AI · 2](https://www.vals.ai/_astro/benchmark_view_ioi.CuUolFNv.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 88.333 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 8.93332 \| USD \| per_test \| Lower is better \| \| `latency` \| 3965.785 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±10.65 pp sourcePopulation 44 stderr 10.65 tokenTotals {"cache_read_tokens":4977405,"cache_write_tokens":637272,"input_tokens":5615082,"output_tokens":205890,"reasoning_tokens":160719} ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_ioi.CuUolFNv.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 2 Observed 2026-10-21T16:46:11.757Z Evidence SHA-256 `e1545b21b5b5c98d037aefa9d441b65859d07a10550f242d0e16162a49b8e8ab` Source locator `/tasks/ioi2025/openai~1gpt-5.6-sol` | | | | | | | | | [Harvey's Legal Agent Benchmark v1 / criteria pass rate banking finance](https://benchize.com/benchmarks/vals-ai%3Ahlab-v1%3Acriteria_pass_rate__banking_finance.md) | 81.41% | SE ±2.38 pp | 37 / 49 | $10.73 | 1,562.14source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 81.413 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 10.733228 \| USD \| per_test \| Lower is better \| \| `latency` \| 1562.144 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±2.38 pp sourcePopulation 81 stderr 2.376 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:45:53.909Z Evidence SHA-256 `65e7cd51e83066a42c9d782635dba5f2e9e1b189bd8118d3510cd17d2ddcba3f` Source locator `/tasks/criteria_pass_rate__banking_finance/openai~1gpt-5.6-sol` | | | | | | | | | [Terminal-Bench 4.0 / ml](https://benchize.com/benchmarks/vals-ai%3Aterminal-bench-4%3Aml.md) | 42.42% | SE ±8.02 pp | 11 / 36 | — | — | [Vals AI · 4.0](https://www.vals.ai/_astro/benchmark_view_terminal_bench_4.CAnGyzC_.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 42.424 \| percent \| reported \| Higher is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±8.02 pp sourcePopulation 52 stderr 8.017 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_terminal_bench_4.CAnGyzC_.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 4.0 Observed 2026-10-21T16:46:10.642Z Evidence SHA-256 `98f6964580e901f1aa143db664bd92aa558415f643569492545d67c47d7f519b` Source locator `/tasks/ml/openai~1gpt-5.6-sol` | | | | | | | | | [SAGE / linear algebra](https://benchize.com/benchmarks/vals-ai%3Asage%3Alinear_algebra.md) | 70.39% | SE ±5.15 pp | 12 / 41 | $0.11 | 43.59source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_sage.RRwIIzO5.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 70.388 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.112568 \| USD \| per_test \| Lower is better \| \| `latency` \| 43.593 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 30000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±5.15 pp sourcePopulation 91 stderr 5.146 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_sage.RRwIIzO5.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:46:07.515Z Evidence SHA-256 `cc5fb3fecdb0382d492ff167a42ad84b9c5c3883373c78ed87baaa972b8b6f7c` Source locator `/tasks/linear_algebra/openai~1gpt-5.6-sol` | | | | | | | | | [TaxEval v2 / overall](https://benchize.com/benchmarks/vals-ai%3Atax_eval_v2%3Aoverall.md) | 74.78% | SE ±0.86 pp | 14 / 40 | $0.14 | 62.03source duration | [Vals AI · 2](https://www.vals.ai/_astro/benchmark_view_tax_eval_v2.B3yoffr8.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 74.775 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.138418 \| USD \| per_test \| Lower is better \| \| `latency` \| 62.034 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.86 pp sourcePopulation 145 stderr 0.856 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_tax_eval_v2.B3yoffr8.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 2 Observed 2026-10-21T16:45:59.000Z Evidence SHA-256 `8b354a6ae848f5bb25a2e8b061b5f576d5b9e0c11b941dc1e6bed078e6529cd6` Source locator `/tasks/overall/openai~1gpt-5.6-sol` | | | | | | | | | [EMB / ma](https://benchize.com/benchmarks/vals-ai%3Aemb%3Ama.md) | 83.87% | SE ±2.84 pp | 2 / 47 | $3.78 | 511.17source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_emb.BY1LXsAw.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 83.873 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 3.781208 \| USD \| per_test \| Lower is better \| \| `latency` \| 511.166 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±2.84 pp sourcePopulation 76 stderr 2.837 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_emb.BY1LXsAw.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:45:57.495Z Evidence SHA-256 `d807aee620ea47152a1fca0257a8dd12a1be4512c76cc1744c1ae9e285180918` Source locator `/tasks/ma/openai~1gpt-5.6-sol` | | | | | | | | | [EMB / template](https://benchize.com/benchmarks/vals-ai%3Aemb%3Atemplate.md) | 75.3% | SE ±3.07 pp | 7 / 47 | $7.9 | 558.2source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_emb.BY1LXsAw.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 75.303 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 7.895 \| USD \| per_test \| Lower is better \| \| `latency` \| 558.195 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±3.07 pp sourcePopulation 76 stderr 3.068 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_emb.BY1LXsAw.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:45:57.495Z Evidence SHA-256 `d807aee620ea47152a1fca0257a8dd12a1be4512c76cc1744c1ae9e285180918` Source locator `/tasks/template/openai~1gpt-5.6-sol` | | | | | | | | | [MLS Bench](https://benchize.com/benchmarks/mls-bench-lite.md) | 46.2% | — | 3 / 6 | — | — | [Moonshot AI · sha256:0e806bbad76dc8e8dbc899a86051e3406bdd5995fe6c6aa1b2176dde4fb28e6c](https://www.kimi.ai/blog/kimi-k3) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 46.2 \| percent \| reported \| Higher is better \| ### Configuration harness Codex Reasoning effort max thinkingEnabled true ### Source Score publisher [Moonshot AI](https://www.kimi.ai/blog/kimi-k3) Collected via [moonshot k3](https://www.kimi.ai/blog/kimi-k3) Publisher reference Referenced by the collection source; the upstream result has not been independently captured. Benchmark [https://www.kimi.ai/blog/kimi-k3](https://www.kimi.ai/blog/kimi-k3) [Collected via](https://www.kimi.ai/blog/kimi-k3) Source Moonshot AI Original model label GPT 5.6 Sol (max) Source version sha256:0e806bbad76dc8e8dbc899a86051e3406bdd5995fe6c6aa1b2176dde4fb28e6c Observed 2026-10-21T16:31:44.130Z Evidence SHA-256 `0e806bbad76dc8e8dbc899a86051e3406bdd5995fe6c6aa1b2176dde4fb28e6c` Source locator `/flight/sheet/data/6/scores/2` | | | | | | | | | [Harvey's Legal Agent Benchmark v1 / criteria pass rate trusts estates private client](https://benchize.com/benchmarks/vals-ai%3Ahlab-v1%3Acriteria_pass_rate__trusts_estates_private_client.md) | 86.26% | SE ±2.13 pp | 25 / 49 | $8.58 | 1,368.64source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 86.26 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 8.582153 \| USD \| per_test \| Lower is better \| \| `latency` \| 1368.64 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±2.13 pp sourcePopulation 81 stderr 2.131 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:45:53.909Z Evidence SHA-256 `65e7cd51e83066a42c9d782635dba5f2e9e1b189bd8118d3510cd17d2ddcba3f` Source locator `/tasks/criteria_pass_rate__trusts_estates_private_client/openai~1gpt-5.6-sol` | | | | | | | | | [Harvey's Legal Agent Benchmark v1 / antitrust competition](https://benchize.com/benchmarks/vals-ai%3Ahlab-v1%3Aantitrust_competition.md) | 0% | SE ±0 pp | 7 / 49 | $8.94 | 1,172.08source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 0 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 8.940461 \| USD \| per_test \| Lower is better \| \| `latency` \| 1172.084 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0 pp sourcePopulation 81 stderr 0 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:45:53.909Z Evidence SHA-256 `65e7cd51e83066a42c9d782635dba5f2e9e1b189bd8118d3510cd17d2ddcba3f` Source locator `/tasks/antitrust_competition/openai~1gpt-5.6-sol` | | | | | | | | | [Terminal-Bench 4.0 / science](https://benchize.com/benchmarks/vals-ai%3Aterminal-bench-4%3Ascience.md) | 42.86% | SE ±0 pp | 10 / 36 | — | — | [Vals AI · 4.0](https://www.vals.ai/_astro/benchmark_view_terminal_bench_4.CAnGyzC_.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 42.857 \| percent \| reported \| Higher is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0 pp sourcePopulation 52 stderr 0 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_terminal_bench_4.CAnGyzC_.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 4.0 Observed 2026-10-21T16:46:10.642Z Evidence SHA-256 `98f6964580e901f1aa143db664bd92aa558415f643569492545d67c47d7f519b` Source locator `/tasks/science/openai~1gpt-5.6-sol` | | | | | | | | | [CorpFin v2 / overall](https://benchize.com/benchmarks/vals-ai%3Acorp_fin_v2%3Aoverall.md) | 64.38% | SE ±0.94 pp | 17 / 39 | $0.48 | 15.94source duration | [Vals AI · 2](https://www.vals.ai/_astro/benchmark_view_corp_fin_v2.CectKwl1.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 64.375 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.484982 \| USD \| per_test \| Lower is better \| \| `latency` \| 15.941 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.94 pp sourcePopulation 134 stderr 0.943 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_corp_fin_v2.CectKwl1.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 2 Observed 2026-10-21T16:45:57.998Z Evidence SHA-256 `7cf2217ab3728d5a84bffce82aab9fc52d7f810b0cbe8c65b387df47f3d31c9b` Source locator `/tasks/overall/openai~1gpt-5.6-sol` | | | | | | | | | [MortgageTax / numerical extraction](https://benchize.com/benchmarks/vals-ai%3Amortgage_tax%3Anumerical_extraction.md) | 75.12% | SE ±1.22 pp | 18 / 31 | $0.08 | 15.56source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_mortgage_tax.DCd-oO5Y.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 75.119 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.079634 \| USD \| per_test \| Lower is better \| \| `latency` \| 15.561 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.22 pp sourcePopulation 98 stderr 1.219 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_mortgage_tax.DCd-oO5Y.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:45:58.500Z Evidence SHA-256 `e5c844561f97d119d66d70269e726ecfb68be79eae39acf14ead3e95422e648c` Source locator `/tasks/numerical_extraction/openai~1gpt-5.6-sol` | | | | | | | | | [Harvey's Legal Agent Benchmark v1 / criteria pass rate immigration](https://benchize.com/benchmarks/vals-ai%3Ahlab-v1%3Acriteria_pass_rate__immigration.md) | 84.36% | SE ±2.19 pp | 26 / 49 | $5.82 | 1,017.4source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 84.364 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 5.823174 \| USD \| per_test \| Lower is better \| \| `latency` \| 1017.402 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±2.19 pp sourcePopulation 81 stderr 2.194 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:45:53.909Z Evidence SHA-256 `65e7cd51e83066a42c9d782635dba5f2e9e1b189bd8118d3510cd17d2ddcba3f` Source locator `/tasks/criteria_pass_rate__immigration/openai~1gpt-5.6-sol` | | | | | | | | | [CharXiv (RQ) w/ python](https://benchize.com/benchmarks/charxiv-rq-python.md) | 89.1% | — | 4 / 5 | — | — | [Moonshot AI · sha256:0e806bbad76dc8e8dbc899a86051e3406bdd5995fe6c6aa1b2176dde4fb28e6c](https://www.kimi.ai/blog/kimi-k3) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 89.1 \| percent \| reported \| Higher is better \| ### Configuration Reasoning effort max runs 3 subset RQ thinkingEnabled true tools ["python"] toolsEnabled true ### Reported statistics runCount 3 ### Source Score publisher [Moonshot AI](https://www.kimi.ai/blog/kimi-k3) Collected via [moonshot k3](https://www.kimi.ai/blog/kimi-k3) Publisher reference Referenced by the collection source; the upstream result has not been independently captured. Benchmark [https://www.kimi.ai/blog/kimi-k3](https://www.kimi.ai/blog/kimi-k3) [Collected via](https://www.kimi.ai/blog/kimi-k3) Source Moonshot AI Original model label GPT 5.6 Sol (max) Source version sha256:0e806bbad76dc8e8dbc899a86051e3406bdd5995fe6c6aa1b2176dde4fb28e6c Observed 2026-10-21T16:31:44.130Z Evidence SHA-256 `0e806bbad76dc8e8dbc899a86051e3406bdd5995fe6c6aa1b2176dde4fb28e6c` Source locator `/flight/sheet/data/26/scores/2` | | | | | | | | | [Harvey's Legal Agent Benchmark v1 / criteria pass rate healthcare life sciences](https://benchize.com/benchmarks/vals-ai%3Ahlab-v1%3Acriteria_pass_rate__healthcare_life_sciences.md) | 82.51% | SE ±2.19 pp | 30 / 49 | $11.6 | 1,594.3source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 82.508 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 11.601398 \| USD \| per_test \| Lower is better \| \| `latency` \| 1594.302 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±2.19 pp sourcePopulation 81 stderr 2.186 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:45:53.909Z Evidence SHA-256 `65e7cd51e83066a42c9d782635dba5f2e9e1b189bd8118d3510cd17d2ddcba3f` Source locator `/tasks/criteria_pass_rate__healthcare_life_sciences/openai~1gpt-5.6-sol` | | | | | | | | | [Harvey's Legal Agent Benchmark v1 / immigration](https://benchize.com/benchmarks/vals-ai%3Ahlab-v1%3Aimmigration.md) | 0% | SE ±0 pp | 6 / 49 | $5.82 | 1,017.4source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 0 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 5.823174 \| USD \| per_test \| Lower is better \| \| `latency` \| 1017.402 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0 pp sourcePopulation 81 stderr 0 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:45:53.909Z Evidence SHA-256 `65e7cd51e83066a42c9d782635dba5f2e9e1b189bd8118d3510cd17d2ddcba3f` Source locator `/tasks/immigration/openai~1gpt-5.6-sol` | | | | | | | | | [Vals Web Search Index / legal](https://benchize.com/benchmarks/vals-ai%3Aweb_search_backends%3Alegal.md) | 37.02% | SE ±3.36 pp | 2 / 3 | $1.17 | 280.85source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_web_search_backends.DAfqOqhu.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 37.019230769230774 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 1.1716600985576924 \| USD \| per_test \| Lower is better \| \| `latency` \| 280.8461201923077 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Native maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±3.36 pp sourcePopulation 8 stderr 3.3560815302332174 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_web_search_backends.DAfqOqhu.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:45:50.373Z Evidence SHA-256 `8a022ad53b5c39bc71f346f44f4a1635122ecdca08efd420a41ddb2fba3082bb` Source locator `/tasks/legal/openai~1gpt-5.6-sol` | | | | | | | | | [PerceptionBench](https://benchize.com/benchmarks/perceptionbench.md) | 59.7% | — | 1 / 5 | — | — | [Moonshot AI · sha256:0e806bbad76dc8e8dbc899a86051e3406bdd5995fe6c6aa1b2176dde4fb28e6c](https://www.kimi.ai/blog/kimi-k3) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 59.7 \| percent \| reported \| Higher is better \| ### Configuration Reasoning effort max runs 3 thinkingEnabled true ### Reported statistics runCount 3 ### Source Score publisher [Moonshot AI](https://www.kimi.ai/blog/kimi-k3) Collected via [moonshot k3](https://www.kimi.ai/blog/kimi-k3) Publisher reference Referenced by the collection source; the upstream result has not been independently captured. Benchmark [https://www.kimi.ai/blog/kimi-k3](https://www.kimi.ai/blog/kimi-k3) [Collected via](https://www.kimi.ai/blog/kimi-k3) Source Moonshot AI Original model label GPT 5.6 Sol (max) Source version sha256:0e806bbad76dc8e8dbc899a86051e3406bdd5995fe6c6aa1b2176dde4fb28e6c Observed 2026-10-21T16:31:44.130Z Evidence SHA-256 `0e806bbad76dc8e8dbc899a86051e3406bdd5995fe6c6aa1b2176dde4fb28e6c` Source locator `/flight/sheet/data/34/scores/2` | | | | | | | | | [Public Benefits Bench v1.1 / overall](https://benchize.com/benchmarks/vals-ai%3Apublic-benefits-bench%3Aoverall.md) | 66.51% | SE ±1.23 pp | 12 / 34 | $8.85 | 3,677.63source duration | [Vals AI · 1.1](https://www.vals.ai/_astro/benchmark_view_snap.CUcEPb0v.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 66.509 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 8.847882 \| USD \| per_test \| Lower is better \| \| `latency` \| 3677.634 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.23 pp sourcePopulation 50 stderr 1.228 tokenTotals {"cache_read_tokens":1350622720,"cache_write_tokens":null,"input_tokens":1506316388,"output_tokens":8001721,"reasoning_tokens":4848671} ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_snap.CUcEPb0v.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1.1 Observed 2026-10-21T16:46:17.865Z Evidence SHA-256 `6f091831ab607a26d65d2ade18cba7ce345ea3a67297b8c378e8a06ce398360d` Source locator `/tasks/overall/openai~1gpt-5.6-sol` | | | | | | | | | [ARC-AGI-2](https://benchize.com/benchmarks/arc-prize%3Av2_Semi_Private.md) | 92.5% | — | 5 / 212 | 1.44usd per task | — | [arc prize · v2](https://arcprize.org/media/data/leaderboard/v2.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.925 \| score_fraction \| v2_Semi_Private \| Higher is better \| \| `cost_per_task` \| 1.44 \| usd_per_task \| v2_Semi_Private \| Lower is better \| ### Configuration evaluationSplit v2_Semi_Private harness Not reported modelGroup openai-gpt-5-6-sol modelType CoT Reasoning effort max sourceModelVersion openai-gpt-5-6-sol-max thinkingEnabled true ### Source [Original source](https://arcprize.org/media/data/leaderboard/v2.json) Source arc prize Original model label GPT-5.6 Sol (Max) Source version v2 Observed 2026-10-21T16:34:20.750Z Evidence SHA-256 `bca68e12cc9a01954ae21b641844c1ecbabe146cb24b87f0f8e9b1db27433c29` Source locator `/evaluations/160` | | | | | | | | | [Terminal-Bench Science 0.1 · physical](https://benchize.com/benchmarks/terminal-science%3Av0-1-eval%3Aphysical.md) | 23.53% | SE ±5.94 pp | 3 / 9 | $1,144.63 | — | [terminal science](https://www.terminal-bench-science.ai/api/leaderboard?package=terminal-bench-science%2Fterminal-bench-science&name=v0-1-eval) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 23.52941176470588 \| percent \| reported \| Higher is better \| \| `total_cost` \| 1144.6274403999996 \| USD \| all_trials \| Lower is better \| \| `total_tokens` \| 2444538546 \| tokens \| all_trials \| Lower is better \| ### Configuration agent Codex benchmarkVersion v0-1-eval domain physical Reasoning effort max ### Reported statistics Uncertainty Standard error: ±5.94 pp accuracyStandardError 5.939743109381191 passes 12 rank 5 tasks 51 ### Source [Original source](https://www.terminal-bench-science.ai/api/leaderboard?package=terminal-bench-science%2Fterminal-bench-science&name=v0-1-eval) Source terminal science Original model label GPT-5.6 Sol Evaluated 2026-09-16T13:45:27.369938+00:00 Observed 2026-10-21T16:32:46.684Z Evidence SHA-256 `86e6278ca64da88b69c1efd6059a33248bd300f27673098f60184286b470c4a7` Source locator `/rows/4/metrics/domain_metrics/physical` | | | | | | | | | [MMLU Pro / psychology](https://benchize.com/benchmarks/vals-ai%3Ammlu_pro%3Apsychology.md) | 89.22% | SE ±1.1 pp | 11 / 40 | $0.02 | 6.7source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 89.223 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.016633 \| USD \| per_test \| Lower is better \| \| `latency` \| 6.702 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.1 pp sourcePopulation 138 stderr 1.098 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:46:06.503Z Evidence SHA-256 `dab025507f46c716dd8d145e90ec0a737d9c56219853f41e4b1cc3c5e8c222b4` Source locator `/tasks/psychology/openai~1gpt-5.6-sol` | | | | | | | | | [Legal Research Bench / weighted pass immigration](https://benchize.com/benchmarks/vals-ai%3Alegal_research%3Aweighted_pass__immigration.md) | 81.16% | SE ±7.63 pp | 15 / 50 | $29.78 | 5,565.4source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_research.DiuL0R8P.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 81.155 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 29.782421 \| USD \| per_test \| Lower is better \| \| `latency` \| 5565.396 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±7.63 pp sourcePopulation 82 stderr 7.633 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_research.DiuL0R8P.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:45:52.389Z Evidence SHA-256 `26c58dfd47d0d2dc86f33c6d056f30309e0ee63570e7cd752c593b385f9d862e` Source locator `/tasks/weighted_pass__immigration/openai~1gpt-5.6-sol` | | | | | | | | | [LiveCodeBench / medium](https://benchize.com/benchmarks/vals-ai%3Alcb%3Amedium.md) | 82.25% | SE ±1.95 pp | 33 / 43 | $0.04 | 18.45source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_lcb.miyRUvVa.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 82.245 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.035584 \| USD \| per_test \| Lower is better \| \| `latency` \| 18.454 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.95 pp sourcePopulation 143 stderr 1.953 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_lcb.miyRUvVa.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:46:14.220Z Evidence SHA-256 `1a7c7dabc9d95a0182886b1edc42623987cac2095a0d407a5e334f37acdfa2f5` Source locator `/tasks/medium/openai~1gpt-5.6-sol` | | | | | | | | | [BioMysteryBench / human difficult](https://benchize.com/benchmarks/vals-ai%3Abiomysterybench%3Ahuman_difficult.md) | 29.41% | SE ±3.4 pp | 8 / 20 | $3.45 | 1,098.26source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_biomysterybench.Bley-WAP.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 29.412 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 3.451958 \| USD \| per_test \| Lower is better \| \| `latency` \| 1098.261 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Terminus 2 maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±3.4 pp sourcePopulation 27 stderr 3.396 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_biomysterybench.Bley-WAP.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:46:04.029Z Evidence SHA-256 `59bf79d38ec415a34ffb1c2901a16ecbbe101b7fa864e86104d2571fc7cfc23d` Source locator `/tasks/human_difficult/openai~1gpt-5.6-sol` | | | | | | | | | [Terminal-Bench 4.0 / security](https://benchize.com/benchmarks/vals-ai%3Aterminal-bench-4%3Asecurity.md) | 53.33% | SE ±6.67 pp | 12 / 36 | — | — | [Vals AI · 4.0](https://www.vals.ai/_astro/benchmark_view_terminal_bench_4.CAnGyzC_.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 53.333 \| percent \| reported \| Higher is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±6.67 pp sourcePopulation 52 stderr 6.667 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_terminal_bench_4.CAnGyzC_.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 4.0 Observed 2026-10-21T16:46:10.642Z Evidence SHA-256 `98f6964580e901f1aa143db664bd92aa558415f643569492545d67c47d7f519b` Source locator `/tasks/security/openai~1gpt-5.6-sol` | | | | | | | | | [Terminal-Bench 2.1 / overall](https://benchize.com/benchmarks/vals-ai%3Aterminal-bench-2-1%3Aoverall.md) | 85.77% | SE ±1.35 pp | 3 / 43 | $1.02 | 372.82source duration | [Vals AI · 2.1](https://www.vals.ai/_astro/benchmark_view_terminal_bench_2_1.CdyoObsA.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 85.768 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 1.023319 \| USD \| per_test \| Lower is better \| \| `latency` \| 372.819 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.35 pp sourcePopulation 76 stderr 1.35 tokenTotals {"cache_read_tokens":20938069,"cache_write_tokens":0,"input_tokens":29114624,"output_tokens":1324119,"reasoning_tokens":721900} ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_terminal_bench_2_1.CdyoObsA.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 2.1 Observed 2026-10-21T16:46:13.216Z Evidence SHA-256 `a5306805cdf86495bdcceff6b2c8534a3768b9853f5077895dab975b809b054f` Source locator `/tasks/overall/openai~1gpt-5.6-sol` | | | | | | | | | [Harvey's Legal Agent Benchmark v1 / criteria pass rate insurance](https://benchize.com/benchmarks/vals-ai%3Ahlab-v1%3Acriteria_pass_rate__insurance.md) | 84.25% | SE ±2.21 pp | 29 / 49 | $8.59 | 1,239.26source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 84.249 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 8.5933 \| USD \| per_test \| Lower is better \| \| `latency` \| 1239.256 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±2.21 pp sourcePopulation 81 stderr 2.209 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:45:53.909Z Evidence SHA-256 `65e7cd51e83066a42c9d782635dba5f2e9e1b189bd8118d3510cd17d2ddcba3f` Source locator `/tasks/criteria_pass_rate__insurance/openai~1gpt-5.6-sol` | | | | | | | | | [Harvey's Legal Agent Benchmark v1 / bankruptcy restructuring](https://benchize.com/benchmarks/vals-ai%3Ahlab-v1%3Abankruptcy_restructuring.md) | 0% | SE ±0 pp | 3 / 49 | $13.53 | 1,473.25source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 0 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 13.525029 \| USD \| per_test \| Lower is better \| \| `latency` \| 1473.246 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0 pp sourcePopulation 81 stderr 0 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:45:53.909Z Evidence SHA-256 `65e7cd51e83066a42c9d782635dba5f2e9e1b189bd8118d3510cd17d2ddcba3f` Source locator `/tasks/bankruptcy_restructuring/openai~1gpt-5.6-sol` | | | | | | | | | [MMMU Pro / overall](https://benchize.com/benchmarks/vals-ai%3Ammmu%3Aoverall.md) | 83% | — | 1 / 5 | — | — | [Moonshot AI · sha256:0e806bbad76dc8e8dbc899a86051e3406bdd5995fe6c6aa1b2176dde4fb28e6c](https://www.kimi.ai/blog/kimi-k3) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 83.0 \| percent \| reported \| Higher is better \| ### Configuration imageOrder original_images_prepended Reasoning effort max runs 3 thinkingEnabled true toolsEnabled false ### Reported statistics runCount 3 ### Source Score publisher [Moonshot AI](https://www.kimi.ai/blog/kimi-k3) Collected via [moonshot k3](https://www.kimi.ai/blog/kimi-k3) Publisher reference Referenced by the collection source; the upstream result has not been independently captured. Benchmark [https://www.kimi.ai/blog/kimi-k3](https://www.kimi.ai/blog/kimi-k3) [Collected via](https://www.kimi.ai/blog/kimi-k3) Source Moonshot AI Original model label GPT 5.6 Sol (max) Source version sha256:0e806bbad76dc8e8dbc899a86051e3406bdd5995fe6c6aa1b2176dde4fb28e6c Observed 2026-10-21T16:31:44.130Z Evidence SHA-256 `0e806bbad76dc8e8dbc899a86051e3406bdd5995fe6c6aa1b2176dde4fb28e6c` Source locator `/flight/sheet/data/23/scores/2` | | | | | | | | | [Legal Research Bench / family](https://benchize.com/benchmarks/vals-ai%3Alegal_research%3Afamily.md) | 13.64% | SE ±7.49 pp | 28 / 50 | $30.08 | 6,569.66source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_research.DiuL0R8P.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 13.636 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 30.084962 \| USD \| per_test \| Lower is better \| \| `latency` \| 6569.663 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±7.49 pp sourcePopulation 82 stderr 7.489 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_research.DiuL0R8P.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:45:52.389Z Evidence SHA-256 `26c58dfd47d0d2dc86f33c6d056f30309e0ee63570e7cd752c593b385f9d862e` Source locator `/tasks/family/openai~1gpt-5.6-sol` | | | | | | | | | [EMB / dcf](https://benchize.com/benchmarks/vals-ai%3Aemb%3Adcf.md) | 62.76% | SE ±7.23 pp | 14 / 47 | $3.85 | 510.32source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_emb.BY1LXsAw.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 62.764 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 3.850982 \| USD \| per_test \| Lower is better \| \| `latency` \| 510.322 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±7.23 pp sourcePopulation 76 stderr 7.225 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_emb.BY1LXsAw.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:45:57.495Z Evidence SHA-256 `d807aee620ea47152a1fca0257a8dd12a1be4512c76cc1744c1ae9e285180918` Source locator `/tasks/dcf/openai~1gpt-5.6-sol` | | | | | | | | | [Terminal-Bench 2.1](https://benchize.com/benchmarks/artificial-analysis%3Aterminalbench_v2_1.md) | 88.8% | — | 1 / 6 | — | — | [Moonshot AI · sha256:0e806bbad76dc8e8dbc899a86051e3406bdd5995fe6c6aa1b2176dde4fb28e6c](https://www.kimi.ai/blog/kimi-k3) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 88.8 \| percent \| reported \| Higher is better \| ### Configuration harness Codex Reasoning effort max thinkingEnabled true ### Source Score publisher [Moonshot AI](https://www.kimi.ai/blog/kimi-k3) Collected via [moonshot k3](https://www.kimi.ai/blog/kimi-k3) Publisher reference Referenced by the collection source; the upstream result has not been independently captured. Benchmark [https://www.kimi.ai/blog/kimi-k3](https://www.kimi.ai/blog/kimi-k3) [Collected via](https://www.kimi.ai/blog/kimi-k3) Source Moonshot AI Original model label GPT 5.6 Sol (max) Source version sha256:0e806bbad76dc8e8dbc899a86051e3406bdd5995fe6c6aa1b2176dde4fb28e6c Observed 2026-10-21T16:31:44.130Z Evidence SHA-256 `0e806bbad76dc8e8dbc899a86051e3406bdd5995fe6c6aa1b2176dde4fb28e6c` Source locator `/flight/sheet/data/2/scores/2` | | | | | | | | | [Code Migration / cli](https://benchize.com/benchmarks/vals-ai%3Acode-migration%3Acli.md) | 47.22% | SE ±2.79 pp | 11 / 47 | $31.19 | 4,369.05source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_code_migration.Dttzoqk3.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 47.221 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 31.186416 \| USD \| per_test \| Lower is better \| \| `latency` \| 4369.049 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±2.79 pp sourcePopulation 79 stderr 2.786 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_code_migration.Dttzoqk3.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:46:12.712Z Evidence SHA-256 `99194597f2c76c402195be47839409046e18bd30454616da6dd40b736a088fa4` Source locator `/tasks/cli/openai~1gpt-5.6-sol` | | | | | | | | | [LegalBench / interpretation tasks](https://benchize.com/benchmarks/vals-ai%3Alegal_bench%3Ainterpretation_tasks.md) | 84.4% | SE ±0.2 pp | 7 / 44 | $0.02 | 7.67source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_bench.D6uTgA3b.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 84.398 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.01698 \| USD \| per_test \| Lower is better \| \| `latency` \| 7.666 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.2 pp sourcePopulation 151 stderr 0.203 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_bench.D6uTgA3b.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:45:53.390Z Evidence SHA-256 `c8486ba756baa5cd3955d035edff67440e8db23e69d62ad1a9e18d15b8c4bc52` Source locator `/tasks/interpretation_tasks/openai~1gpt-5.6-sol` | | | | | | | | | [SkillsBench / no skills](https://benchize.com/benchmarks/vals-ai%3Askillsbench%3Ano_skills.md) | 43.31% | SE ±4.73 pp | 10 / 20 | $4.08 | 799.07source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_skillsbench.BE2TXB-M.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 43.312 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 4.075143 \| USD \| per_test \| Lower is better \| \| `latency` \| 799.069 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness OpenHands maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±4.73 pp sourcePopulation 35 stderr 4.728 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_skillsbench.BE2TXB-M.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:46:11.147Z Evidence SHA-256 `aaad242949d81b7c7c61c36d4895d4460e9146760c1e6b4b38d235a16043bc61` Source locator `/tasks/no_skills/openai~1gpt-5.6-sol` | | | | | | | | | [ProgramBench / strict](https://benchize.com/benchmarks/vals-ai%3Aprogrambench%3Astrict.md) | 1.5% | SE ±0.86 pp | 11 / 40 | $15.29 | 1,764.49source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_programbench.C_J7ZU4X.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 1.5 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 15.289359 \| USD \| per_test \| Lower is better \| \| `latency` \| 1764.488 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.86 pp sourcePopulation 64 stderr 0.862 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_programbench.C_J7ZU4X.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:46:10.137Z Evidence SHA-256 `e9bbb4378c7a058441a21d456baf9316b96c2cf5b58d371a3c7c803f5000bd8c` Source locator `/tasks/strict/openai~1gpt-5.6-sol` | | | | | | | | | [LiveCodeBench / easy](https://benchize.com/benchmarks/vals-ai%3Alcb%3Aeasy.md) | 98.14% | SE ±0.75 pp | 30 / 43 | $0.00772 | 4.23source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_lcb.miyRUvVa.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 98.137 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.007722 \| USD \| per_test \| Lower is better \| \| `latency` \| 4.226 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.75 pp sourcePopulation 143 stderr 0.754 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_lcb.miyRUvVa.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:46:14.220Z Evidence SHA-256 `1a7c7dabc9d95a0182886b1edc42623987cac2095a0d407a5e334f37acdfa2f5` Source locator `/tasks/easy/openai~1gpt-5.6-sol` | | | | | | | | | [Harvey's Legal Agent Benchmark v1 / real estate](https://benchize.com/benchmarks/vals-ai%3Ahlab-v1%3Areal_estate.md) | 0% | SE ±0 pp | 6 / 49 | $12.83 | 1,732.6source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 0 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 12.830219 \| USD \| per_test \| Lower is better \| \| `latency` \| 1732.598 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0 pp sourcePopulation 81 stderr 0 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:45:53.909Z Evidence SHA-256 `65e7cd51e83066a42c9d782635dba5f2e9e1b189bd8118d3510cd17d2ddcba3f` Source locator `/tasks/real_estate/openai~1gpt-5.6-sol` | | | | | | | | | [DECK-Bench (Internal)](https://benchize.com/benchmarks/deck-bench.md) | 74.7% | — | 1 / 6 | — | — | [Moonshot AI · sha256:0e806bbad76dc8e8dbc899a86051e3406bdd5995fe6c6aa1b2176dde4fb28e6c](https://www.kimi.ai/blog/kimi-k3) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 74.7 \| percent \| reported \| Higher is better \| ### Configuration benchmarkVisibility internal Reasoning effort max thinkingEnabled true ### Source Score publisher [Moonshot AI](https://www.kimi.ai/blog/kimi-k3) Collected via [moonshot k3](https://www.kimi.ai/blog/kimi-k3) Publisher reference Referenced by the collection source; the upstream result has not been independently captured. Benchmark [https://www.kimi.ai/blog/kimi-k3](https://www.kimi.ai/blog/kimi-k3) [Collected via](https://www.kimi.ai/blog/kimi-k3) Source Moonshot AI Original model label GPT 5.6 Sol (max) Source version sha256:0e806bbad76dc8e8dbc899a86051e3406bdd5995fe6c6aa1b2176dde4fb28e6c Observed 2026-10-21T16:31:44.130Z Evidence SHA-256 `0e806bbad76dc8e8dbc899a86051e3406bdd5995fe6c6aa1b2176dde4fb28e6c` Source locator `/flight/sheet/data/19/scores/2` | | | | | | | | | [MMLU Pro / engineering](https://benchize.com/benchmarks/vals-ai%3Ammlu_pro%3Aengineering.md) | 87.82% | SE ±1.05 pp | 9 / 40 | $0.1 | 46.83source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 87.822 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.096053 \| USD \| per_test \| Lower is better \| \| `latency` \| 46.83 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.05 pp sourcePopulation 138 stderr 1.051 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:46:06.503Z Evidence SHA-256 `dab025507f46c716dd8d145e90ec0a737d9c56219853f41e4b1cc3c5e8c222b4` Source locator `/tasks/engineering/openai~1gpt-5.6-sol` | | | | | | | | | [BrowseComp](https://benchize.com/benchmarks/browsecomp.md) | 90.4% | — | 2 / 5 | — | — | [Moonshot AI · sha256:0e806bbad76dc8e8dbc899a86051e3406bdd5995fe6c6aa1b2176dde4fb28e6c](https://www.kimi.ai/blog/kimi-k3) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 90.4 \| percent \| reported \| Higher is better \| ### Configuration Reasoning effort max thinkingEnabled true ### Source Score publisher [Moonshot AI](https://www.kimi.ai/blog/kimi-k3) Collected via [moonshot k3](https://www.kimi.ai/blog/kimi-k3) Publisher reference Referenced by the collection source; the upstream result has not been independently captured. Benchmark [https://www.kimi.ai/blog/kimi-k3](https://www.kimi.ai/blog/kimi-k3) [Collected via](https://www.kimi.ai/blog/kimi-k3) Source Moonshot AI Original model label GPT 5.6 Sol (max) Source version sha256:0e806bbad76dc8e8dbc899a86051e3406bdd5995fe6c6aa1b2176dde4fb28e6c Observed 2026-10-21T16:31:44.130Z Evidence SHA-256 `0e806bbad76dc8e8dbc899a86051e3406bdd5995fe6c6aa1b2176dde4fb28e6c` Source locator `/flight/sheet/data/9/scores/2` | | | | | | | | | [Harvey's Legal Agent Benchmark v1 / criteria pass rate energy natural resources](https://benchize.com/benchmarks/vals-ai%3Ahlab-v1%3Acriteria_pass_rate__energy_natural_resources.md) | 92.74% | SE ±1.49 pp | 25 / 49 | $17.77 | 1,722.81source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 92.739 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 17.774066 \| USD \| per_test \| Lower is better \| \| `latency` \| 1722.806 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.49 pp sourcePopulation 81 stderr 1.493 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:45:53.909Z Evidence SHA-256 `65e7cd51e83066a42c9d782635dba5f2e9e1b189bd8118d3510cd17d2ddcba3f` Source locator `/tasks/criteria_pass_rate__energy_natural_resources/openai~1gpt-5.6-sol` | | | | | | | | | [FrontierCode 1.1 extended](https://benchize.com/benchmarks/frontiercode%3Av1_1%3Aextended.md) | 60.55% | — | 24 / 125 | $4.25 | — | [frontiercode](https://cognition.com/data/frontiercode-leaderboard/data.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.6055 \| score_fraction \| blocking_criteria_adjusted \| Higher is better \| \| `correct` \| 0.6661 \| score_fraction \| raw_rubric \| Higher is better \| \| `cost` \| 4.253 \| USD \| per_rollout \| Lower is better \| ### Configuration harness codex Reasoning effort max sourceVersion v1_1 subset extended ### Reported statistics flaggedRate 0 sampleSize 150 ### Source [Original source](https://cognition.com/data/frontiercode-leaderboard/data.json) Source frontiercode Original model label GPT-5.6 Sol Observed 2026-10-21T16:31:00.878Z Evidence SHA-256 `ff0040778b7bdf69c705ad7474f771fb5e53cfaf5cf8573b3a4614153543d75f` Source locator `/v1_1/data/GPT-5.6%20Sol/max/extended` | | | | | | | | | [Vals Science Index / biomysterybench](https://benchize.com/benchmarks/vals-ai%3Ascience_index%3Abiomysterybench.md) | 71.11% | SE ±0.64 pp | 8 / 17 | $1.93 | 1,098.26source duration | [Vals AI · 1.0](https://www.vals.ai/_astro/benchmark_view_science_index.CN7FN-f1.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 71.111 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 1.925036 \| USD \| per_test \| Lower is better \| \| `latency` \| 1098.261 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.64 pp sourcePopulation 21 stderr 0.642 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_science_index.CN7FN-f1.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1.0 Observed 2026-10-21T16:45:50.879Z Evidence SHA-256 `fa4313008e91752fcfc185aaa78665f780d0fc23d7c7198a9853dbf2eaaaef1f` Source locator `/tasks/biomysterybench/openai~1gpt-5.6-sol` | | | | | | | | | [Terminal-Bench 2.1 / medium](https://benchize.com/benchmarks/vals-ai%3Aterminal-bench-2-1%3Amedium.md) | 86.06% | SE ±2.19 pp | 2 / 43 | $1.66 | 603.29source duration | [Vals AI · 2.1](https://www.vals.ai/_astro/benchmark_view_terminal_bench_2_1.CdyoObsA.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 86.061 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 1.655916 \| USD \| per_test \| Lower is better \| \| `latency` \| 603.288 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±2.19 pp sourcePopulation 76 stderr 2.185 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_terminal_bench_2_1.CdyoObsA.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 2.1 Observed 2026-10-21T16:46:13.216Z Evidence SHA-256 `a5306805cdf86495bdcceff6b2c8534a3768b9853f5077895dab975b809b054f` Source locator `/tasks/medium/openai~1gpt-5.6-sol` | | | | | | | | | [OTIS Mock AIME 2024–2025](https://benchize.com/benchmarks/epoch-ai%3Aotis_mock_aime_2024_2025.md) | 100% | SE ±0 pp | 1 / 123 | — | — | [epoch ai · OTIS Mock AIME 2024-2025](https://epoch.ai/data/benchmark_data.zip#file=otis_mock_aime_2024_2025.csv) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 1.0 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 1.0 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion OTIS Mock AIME 2024-2025 reasoningBudget Not reported Reasoning effort max sourceModelVersion gpt-5.6-sol_max ### Reported statistics Uncertainty Standard error: ±0 pp standardError 0 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=otis_mock_aime_2024_2025.csv) Source epoch ai Original model label gpt-5.6-sol Source version OTIS Mock AIME 2024-2025 Evaluated 2026-07-09T02:07:13.000Z Observed 2026-10-21T16:30:24.199Z Evidence SHA-256 `5b411612f91e155dff4b09d09b548b42f7936482ea8b3c00b510bd46e2f6bc2c` Source locator `/rows/165` | | | | | | | | | [Vals Multimodal Index / overall](https://benchize.com/benchmarks/vals-ai%3Avals_multimodal_index%3Aoverall.md) | 72.64% | SE ±0.68 pp | 3 / 20 | $5.36 | 550.77source duration | [Vals AI · 1.2](https://www.vals.ai/_astro/benchmark_view_vals_multimodal_index.virVpWMs.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 72.64 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 5.357844 \| USD \| per_test \| Lower is better \| \| `latency` \| 550.773 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.68 pp sourcePopulation 33 stderr 0.676 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_vals_multimodal_index.virVpWMs.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1.2 Observed 2026-10-21T16:45:51.881Z Evidence SHA-256 `077b22575f6e075b7b78157d000ec8f94d7ead409c7dcbcf04887630ed572a2d` Source locator `/tasks/overall/openai~1gpt-5.6-sol` | | | | | | | | | [Tax Agent Bench / weighted pass controversy precedence analysis](https://benchize.com/benchmarks/vals-ai%3Atax_agent_bench%3Aweighted_pass__controversy_precedence_analysis.md) | 68.5% | SE ±7.77 pp | 5 / 46 | $8.65 | 3,046.84source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_tax_agent_bench.BFpexnpS.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 68.503 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 8.653012 \| USD \| per_test \| Lower is better \| \| `latency` \| 3046.844 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±7.77 pp sourcePopulation 73 stderr 7.769 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_tax_agent_bench.BFpexnpS.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:45:55.958Z Evidence SHA-256 `446db182b67efb7923b3187a4040ec3a3ea492b8ad699a2b6d708d714cc063ac` Source locator `/tasks/weighted_pass__controversy_precedence_analysis/openai~1gpt-5.6-sol` | | | | | | | | | [Harvey's Legal Agent Benchmark v1 / criteria pass rate environmental esg](https://benchize.com/benchmarks/vals-ai%3Ahlab-v1%3Acriteria_pass_rate__environmental_esg.md) | 80.65% | SE ±2.37 pp | 32 / 49 | $7.58 | 1,111.07source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 80.645 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 7.575723 \| USD \| per_test \| Lower is better \| \| `latency` \| 1111.074 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±2.37 pp sourcePopulation 81 stderr 2.37 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:45:53.909Z Evidence SHA-256 `65e7cd51e83066a42c9d782635dba5f2e9e1b189bd8118d3510cd17d2ddcba3f` Source locator `/tasks/criteria_pass_rate__environmental_esg/openai~1gpt-5.6-sol` | | | | | | | | | [Terminal-Bench Science 0.1 · life](https://benchize.com/benchmarks/terminal-science%3Av0-1-eval%3Alife.md) | 17.54% | SE ±5.04 pp | 2 / 9 | $513.19 | — | [terminal science](https://www.terminal-bench-science.ai/api/leaderboard?package=terminal-bench-science%2Fterminal-bench-science&name=v0-1-eval) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 17.543859649122805 \| percent \| reported \| Higher is better \| \| `total_cost` \| 513.1874942 \| USD \| all_trials \| Lower is better \| \| `total_tokens` \| 911217942 \| tokens \| all_trials \| Lower is better \| ### Configuration agent Codex benchmarkVersion v0-1-eval domain life Reasoning effort max ### Reported statistics Uncertainty Standard error: ±5.04 pp accuracyStandardError 5.03775039171214 passes 10 rank 5 tasks 57 ### Source [Original source](https://www.terminal-bench-science.ai/api/leaderboard?package=terminal-bench-science%2Fterminal-bench-science&name=v0-1-eval) Source terminal science Original model label GPT-5.6 Sol Evaluated 2026-09-16T13:45:27.369938+00:00 Observed 2026-10-21T16:32:46.684Z Evidence SHA-256 `86e6278ca64da88b69c1efd6059a33248bd300f27673098f60184286b470c4a7` Source locator `/rows/4/metrics/domain_metrics/life` | | | | | | | | | [Tax Agent Bench / rule source lookup](https://benchize.com/benchmarks/vals-ai%3Atax_agent_bench%3Arule_source_lookup.md) | 30% | SE ±8.51 pp | 30 / 46 | $5.49 | 2,236.43source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_tax_agent_bench.BFpexnpS.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 30 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 5.48599 \| USD \| per_test \| Lower is better \| \| `latency` \| 2236.425 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±8.51 pp sourcePopulation 73 stderr 8.51 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_tax_agent_bench.BFpexnpS.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:45:55.958Z Evidence SHA-256 `446db182b67efb7923b3187a4040ec3a3ea492b8ad699a2b6d708d714cc063ac` Source locator `/tasks/rule_source_lookup/openai~1gpt-5.6-sol` | | | | | | | | | [Harvey's Legal Agent Benchmark v1 / criteria pass rate real estate](https://benchize.com/benchmarks/vals-ai%3Ahlab-v1%3Acriteria_pass_rate__real_estate.md) | 79.01% | SE ±2.2 pp | 35 / 49 | $12.83 | 1,732.6source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 79.009 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 12.830219 \| USD \| per_test \| Lower is better \| \| `latency` \| 1732.598 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±2.2 pp sourcePopulation 81 stderr 2.202 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:45:53.909Z Evidence SHA-256 `65e7cd51e83066a42c9d782635dba5f2e9e1b189bd8118d3510cd17d2ddcba3f` Source locator `/tasks/criteria_pass_rate__real_estate/openai~1gpt-5.6-sol` | | | | | | | | | [MedScribe / overall](https://benchize.com/benchmarks/vals-ai%3Amedscribe%3Aoverall.md) | 85.23% | SE ±1.97 pp | 19 / 49 | $0.28 | 94.4source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_medscribe.BYf5a3C-.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 85.233 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.276691 \| USD \| per_test \| Lower is better \| \| `latency` \| 94.404 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 30000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.97 pp sourcePopulation 109 stderr 1.973 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_medscribe.BYf5a3C-.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:46:00.004Z Evidence SHA-256 `271fc122ddc2b0602bd6c7947f65a9a7f0d8cab94f6dc27d62a9380a9317f9c0` Source locator `/tasks/overall/openai~1gpt-5.6-sol` | | | | | | | | | [Terminal-Bench 4](https://benchize.com/benchmarks/harbor%3Aterminal-bench-4.md) | 37.27% | 95% CI 33.49–41.05% | 9 / 17 | — | — | [harbor](https://www.tbench.ai/) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 37.27 \| percent \| reported \| Higher is better \| \| `pass_at_2` \| 0.4955 \| score_fraction \| reported \| Higher is better \| \| `pass_at_3` \| 0.55 \| score_fraction \| reported \| Higher is better \| \| `pass_at_4` \| 0.5818 \| score_fraction \| reported \| Higher is better \| \| `pass_at_5` \| 0.6061 \| score_fraction \| reported \| Higher is better \| ### Configuration agent Codex Reasoning effort max sourceSubmission 0e349bde-b264-494d-a853-fada9c696192 ### Reported statistics Uncertainty 95% confidence interval: 33.49–41.05% confidenceHalfWidth95 3.78 sampleSize 330 ### Source [Original source](https://www.tbench.ai/) Source harbor Original model label GPT-5.6 Sol Evaluated 2026-06-26 Observed 2026-10-21T16:33:12.399Z Evidence SHA-256 `0c2d7608e0711b34acae3e757dc2b8bf58bf1f5f04fec84de6cd02598168712c` Source locator `/rows/21` | | | | | | | | | [Harvey's Legal Agent Benchmark v1 / emerging companies venture capital](https://benchize.com/benchmarks/vals-ai%3Ahlab-v1%3Aemerging_companies_venture_capital.md) | 0% | SE ±0 pp | 18 / 49 | $10.39 | 1,289.84source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 0 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 10.388772 \| USD \| per_test \| Lower is better \| \| `latency` \| 1289.842 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0 pp sourcePopulation 81 stderr 0 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:45:53.909Z Evidence SHA-256 `65e7cd51e83066a42c9d782635dba5f2e9e1b189bd8118d3510cd17d2ddcba3f` Source locator `/tasks/emerging_companies_venture_capital/openai~1gpt-5.6-sol` | | | | | | | | | [Harvey's Legal Agent Benchmark v1 / healthcare life sciences](https://benchize.com/benchmarks/vals-ai%3Ahlab-v1%3Ahealthcare_life_sciences.md) | 0% | SE ±0 pp | 24 / 49 | $11.6 | 1,594.3source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 0 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 11.601398 \| USD \| per_test \| Lower is better \| \| `latency` \| 1594.302 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0 pp sourcePopulation 81 stderr 0 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:45:53.909Z Evidence SHA-256 `65e7cd51e83066a42c9d782635dba5f2e9e1b189bd8118d3510cd17d2ddcba3f` Source locator `/tasks/healthcare_life_sciences/openai~1gpt-5.6-sol` | | | | | | | | | [Terminal-Bench-Science / physical sciences](https://benchize.com/benchmarks/vals-ai%3Aterminal-bench-science%3Aphysical_sciences.md) | 29.41% | SE ±11.39 pp | 8 / 30 | — | — | [Vals AI · 0.1](https://www.vals.ai/_astro/benchmark_view_terminal_bench_science.o-HR8Nyt.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 29.412 \| percent \| reported \| Higher is better \| ### Configuration computeEffort Not reported harness Mini-SWE-agent maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±11.39 pp sourcePopulation 41 stderr 11.391 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_terminal_bench_science.o-HR8Nyt.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 0.1 Observed 2026-10-21T16:46:03.529Z Evidence SHA-256 `a30a8618deaecf018ea1c8c9f675576cdd9ab79742d05788067db49afcc5f91b` Source locator `/tasks/physical_sciences/openai~1gpt-5.6-sol` | | | | | | | | | [Legal Research Bench / weighted pass health](https://benchize.com/benchmarks/vals-ai%3Alegal_research%3Aweighted_pass__health.md) | 97.51% | SE ±1.19 pp | 1 / 50 | $22.84 | 4,151.25source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_research.DiuL0R8P.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 97.511 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 22.836198 \| USD \| per_test \| Lower is better \| \| `latency` \| 4151.253 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.19 pp sourcePopulation 82 stderr 1.194 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_research.DiuL0R8P.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:45:52.389Z Evidence SHA-256 `26c58dfd47d0d2dc86f33c6d056f30309e0ee63570e7cd752c593b385f9d862e` Source locator `/tasks/weighted_pass__health/openai~1gpt-5.6-sol` | | | | | | | | | [Toolathlon-Verified](https://benchize.com/benchmarks/toolathlon-verified.md) | 74.9% | — | 3 / 6 | — | — | [Moonshot AI · sha256:0e806bbad76dc8e8dbc899a86051e3406bdd5995fe6c6aa1b2176dde4fb28e6c](https://www.kimi.ai/blog/kimi-k3) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 74.9 \| percent \| reported \| Higher is better \| ### Configuration Reasoning effort max thinkingEnabled true ### Source Score publisher [Moonshot AI](https://www.kimi.ai/blog/kimi-k3) Collected via [moonshot k3](https://www.kimi.ai/blog/kimi-k3) Publisher reference Referenced by the collection source; the upstream result has not been independently captured. Benchmark [https://www.kimi.ai/blog/kimi-k3](https://www.kimi.ai/blog/kimi-k3) [Collected via](https://www.kimi.ai/blog/kimi-k3) Source Moonshot AI Original model label GPT 5.6 Sol (max) Source version sha256:0e806bbad76dc8e8dbc899a86051e3406bdd5995fe6c6aa1b2176dde4fb28e6c Observed 2026-10-21T16:31:44.130Z Evidence SHA-256 `0e806bbad76dc8e8dbc899a86051e3406bdd5995fe6c6aa1b2176dde4fb28e6c` Source locator `/flight/sheet/data/11/scores/2` | | | | | | | | | [Tax Agent Bench / weighted pass forms filings](https://benchize.com/benchmarks/vals-ai%3Atax_agent_bench%3Aweighted_pass__forms_filings.md) | 72.51% | SE ±7.51 pp | 4 / 46 | $11.45 | 3,672.35source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_tax_agent_bench.BFpexnpS.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 72.508 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 11.447471 \| USD \| per_test \| Lower is better \| \| `latency` \| 3672.354 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±7.51 pp sourcePopulation 73 stderr 7.509 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_tax_agent_bench.BFpexnpS.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:45:55.958Z Evidence SHA-256 `446db182b67efb7923b3187a4040ec3a3ea492b8ad699a2b6d708d714cc063ac` Source locator `/tasks/weighted_pass__forms_filings/openai~1gpt-5.6-sol` | | | | | | | | | [MedCode / overall](https://benchize.com/benchmarks/vals-ai%3Amedcode%3Aoverall.md) | 43.97% | SE ±2.26 pp | 28 / 49 | $0.28 | 96.59source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_medcode.DehpEDgG.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 43.974 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.280517 \| USD \| per_test \| Lower is better \| \| `latency` \| 96.589 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 30000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±2.26 pp sourcePopulation 107 stderr 2.258 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_medcode.DehpEDgG.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:45:59.516Z Evidence SHA-256 `988a6ae1e07e33ce031572ed4a804be11c36ee97a1dd75cbe4740fff3b534f8c` Source locator `/tasks/overall/openai~1gpt-5.6-sol` | | | | | | | | | [SimpleQA Verified](https://benchize.com/benchmarks/epoch-ai%3Asimpleqa_verified.md) | 69.7% | SE ±1.45 pp | 8 / 39 | — | — | [epoch ai · SimpleQA Verified](https://epoch.ai/data/benchmark_data.zip#file=simpleqa_verified.csv) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.697 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.697 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion SimpleQA Verified reasoningBudget Not reported Reasoning effort max sourceModelVersion gpt-5.6-sol_max ### Reported statistics Uncertainty Standard error: ±1.45 pp standardError 0.014539683710535193 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=simpleqa_verified.csv) Source epoch ai Original model label gpt-5.6-sol Source version SimpleQA Verified Evaluated 2026-08-10T23:44:30.000Z Observed 2026-10-21T16:30:24.199Z Evidence SHA-256 `d4ef3a7d6ccc9c611a30e98d0561021e903c0f4a224851311a7c420862154dd8` Source locator `/rows/79` | | | | | | | | | [τ³-Banking](https://benchize.com/benchmarks/mercor%3Atau3-banking.md) | 43% | — | 10 / 24 | — | — | [mercor](https://www.mercor.com/apex/partner-benchmarks/tau-3-banking-leaderboard/) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `pass_1` \| 43 \| percent \| task_completion_pass_at_1 \| Higher is better \| ### Configuration datasetUrl Not reported datasetVersion Not reported harness Not reported Reasoning effort max ### Reported statistics reportedErrors {"pass_1":8.2} sampleSize 291 ### Source [Original source](https://www.mercor.com/apex/partner-benchmarks/tau-3-banking-leaderboard/) Source mercor Original model label GPT-5.6 Sol Observed 2026-10-21T16:33:27.812Z Evidence SHA-256 `78850adeb8ad047fcb1dd65cc04ffaca61c86fc67e7035f9973805b02483ed07` Source locator `/__NEXT_DATA__/props/pageProps/leaderboard/rows/9` | | | | | | | | | [Harvey's Legal Agent Benchmark v1 / criteria pass rate funds asset management](https://benchize.com/benchmarks/vals-ai%3Ahlab-v1%3Acriteria_pass_rate__funds_asset_management.md) | 74.93% | SE ±2.34 pp | 33 / 49 | $13.03 | 3,107.42source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 74.927 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 13.033612 \| USD \| per_test \| Lower is better \| \| `latency` \| 3107.416 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±2.34 pp sourcePopulation 81 stderr 2.344 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:45:53.909Z Evidence SHA-256 `65e7cd51e83066a42c9d782635dba5f2e9e1b189bd8118d3510cd17d2ddcba3f` Source locator `/tasks/criteria_pass_rate__funds_asset_management/openai~1gpt-5.6-sol` | | | | | | | | | [Harvey's Legal Agent Benchmark v1 / criteria pass rate intellectual property](https://benchize.com/benchmarks/vals-ai%3Ahlab-v1%3Acriteria_pass_rate__intellectual_property.md) | 85.51% | SE ±2.1 pp | 37 / 49 | $8.44 | 1,126.24source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 85.512 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 8.439215 \| USD \| per_test \| Lower is better \| \| `latency` \| 1126.242 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±2.1 pp sourcePopulation 81 stderr 2.096 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:45:53.909Z Evidence SHA-256 `65e7cd51e83066a42c9d782635dba5f2e9e1b189bd8118d3510cd17d2ddcba3f` Source locator `/tasks/criteria_pass_rate__intellectual_property/openai~1gpt-5.6-sol` | | | | | | | | | [TaxEval v2 / correctness](https://benchize.com/benchmarks/vals-ai%3Atax_eval_v2%3Acorrectness.md) | 65% | SE ±1.36 pp | 8 / 40 | $0.14 | 62.03source duration | [Vals AI · 2](https://www.vals.ai/_astro/benchmark_view_tax_eval_v2.B3yoffr8.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 65.004 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.138418 \| USD \| per_test \| Lower is better \| \| `latency` \| 62.034 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.36 pp sourcePopulation 145 stderr 1.364 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_tax_eval_v2.B3yoffr8.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 2 Observed 2026-10-21T16:45:59.000Z Evidence SHA-256 `8b354a6ae848f5bb25a2e8b061b5f576d5b9e0c11b941dc1e6bed078e6529cd6` Source locator `/tasks/correctness/openai~1gpt-5.6-sol` | | | | | | | | | [Harvey's Legal Agent Benchmark v1 / criteria pass rate employment labor](https://benchize.com/benchmarks/vals-ai%3Ahlab-v1%3Acriteria_pass_rate__employment_labor.md) | 67.04% | SE ±2.88 pp | 38 / 49 | $7.49 | 1,419.99source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 67.041 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 7.485275 \| USD \| per_test \| Lower is better \| \| `latency` \| 1419.994 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±2.88 pp sourcePopulation 81 stderr 2.882 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:45:53.909Z Evidence SHA-256 `65e7cd51e83066a42c9d782635dba5f2e9e1b189bd8118d3510cd17d2ddcba3f` Source locator `/tasks/criteria_pass_rate__employment_labor/openai~1gpt-5.6-sol` | | | | | | | | | [CUA-bench / held out sports](https://benchize.com/benchmarks/vals-ai%3Acua_bench%3Aheld_out_sports.md) | 0% | SE ±0 pp | 1 / 8 | $24.82 | 26.93source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_cua_bench.DpgrKYWA.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 0 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 24.816925 \| USD \| per_test \| Lower is better \| \| `latency` \| 26.93 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort max harness codex maxOutputTokens 128000 provider openai reasoning true Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0 pp sourcePopulation 9 stderr 0 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_cua_bench.DpgrKYWA.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:46:16.228Z Evidence SHA-256 `8c415c63f28cd80496a4ccca27d1062ec98bb55268e58cba105b8cf2d7ee53d3` Source locator `/tasks/held_out_sports/openai~1gpt-5.6-sol` | | | | | | | | | [CyberBench v1.1 / poc](https://benchize.com/benchmarks/benchmark%3Acyber%3Apoc.md) | 63.33% | SE ±6.22 pp | 6 / 28 | $5.04 | 748.95source duration | [Vals AI · 1.1](https://www.vals.ai/_astro/benchmark_view_cyberbench.DS6UOlu0.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 63.333 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 5.041798 \| USD \| per_test \| Lower is better \| \| `latency` \| 748.947 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±6.22 pp sourcePopulation 47 stderr 6.221 tokenTotals {"cache_read_tokens":428829703,"cache_write_tokens":6869793,"input_tokens":435759534,"output_tokens":900060,"reasoning_tokens":450179} ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_cyberbench.DS6UOlu0.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1.1 Observed 2026-10-21T16:46:15.238Z Evidence SHA-256 `943f593f929f8971a6b746269a2851b5febc2aad4e2f1066895f715033cdc7f1` Source locator `/tasks/poc/openai~1gpt-5.6-sol` | | | | | | | | | [Tax Agent Bench / controversy precedence analysis](https://benchize.com/benchmarks/vals-ai%3Atax_agent_bench%3Acontroversy_precedence_analysis.md) | 20% | SE ±7.43 pp | 5 / 46 | $8.65 | 3,046.84source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_tax_agent_bench.BFpexnpS.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 20 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 8.653012 \| USD \| per_test \| Lower is better \| \| `latency` \| 3046.844 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±7.43 pp sourcePopulation 73 stderr 7.428 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_tax_agent_bench.BFpexnpS.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:45:55.958Z Evidence SHA-256 `446db182b67efb7923b3187a4040ec3a3ea492b8ad699a2b6d708d714cc063ac` Source locator `/tasks/controversy_precedence_analysis/openai~1gpt-5.6-sol` | | | | | | | | | [Legal Research Bench / weighted pass constitutional civil rights](https://benchize.com/benchmarks/vals-ai%3Alegal_research%3Aweighted_pass__constitutional_civil_rights.md) | 88.31% | SE ±1.83 pp | 6 / 50 | $14.53 | 3,868.67source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_research.DiuL0R8P.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 88.31 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 14.526185 \| USD \| per_test \| Lower is better \| \| `latency` \| 3868.674 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.83 pp sourcePopulation 82 stderr 1.827 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_research.DiuL0R8P.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:45:52.389Z Evidence SHA-256 `26c58dfd47d0d2dc86f33c6d056f30309e0ee63570e7cd752c593b385f9d862e` Source locator `/tasks/weighted_pass__constitutional_civil_rights/openai~1gpt-5.6-sol` | | | | | | | | | [Terminal-Bench-Science / earth sciences](https://benchize.com/benchmarks/vals-ai%3Aterminal-bench-science%3Aearth_sciences.md) | 25% | SE ±16.37 pp | 6 / 30 | — | — | [Vals AI · 0.1](https://www.vals.ai/_astro/benchmark_view_terminal_bench_science.o-HR8Nyt.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 25 \| percent \| reported \| Higher is better \| ### Configuration computeEffort Not reported harness Mini-SWE-agent maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±16.37 pp sourcePopulation 41 stderr 16.366 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_terminal_bench_science.o-HR8Nyt.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 0.1 Observed 2026-10-21T16:46:03.529Z Evidence SHA-256 `a30a8618deaecf018ea1c8c9f675576cdd9ab79742d05788067db49afcc5f91b` Source locator `/tasks/earth_sciences/openai~1gpt-5.6-sol` | | | | | | | | | [Time Horizon Index: KSP / mean progress to date](https://benchize.com/benchmarks/vals-ai%3Atime_horizon_index%3Amean_progress_to_date.md) | 13.66% | SE ±0 pp | 7 / 10 | $2,027.2 | 0source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_ksp_bench.CDDTSam7.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 13.662 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 2027.203388 \| USD \| per_test \| Lower is better \| \| `latency` \| 0 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0 pp sourcePopulation 13 stderr 0 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_ksp_bench.CDDTSam7.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:46:16.730Z Evidence SHA-256 `be251b72ecceae7912b9577f9b3a3512740c308a34f81ac823952e919adae50f` Source locator `/tasks/mean_progress_to_date/openai~1gpt-5.6-sol` | | | | | | | | | [PRBench Finance](https://benchize.com/benchmarks/scale%3Aprbench-finance.md) | 50.45source score | CI 50.12–50.78 | 7 / 22 | — | — | [scale](https://labs.scale.com/leaderboard/prbench-finance) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 50.45 \| source_score \| reported \| Higher is better \| ### Configuration Reasoning effort max Model configuration gpt-5.6-sol (max) sourceModelVersion Not reported thinkingEnabled true ### Reported statistics Uncertainty Confidence interval: 50.12–50.78 contaminationWarning Not reported rank 10 reportedConfidenceHalfWidth 0.33 ### Source [Original source](https://labs.scale.com/leaderboard/prbench-finance) Source scale Original model label gpt-5.6-sol (max) Observed 2026-10-21T16:35:34.798Z Evidence SHA-256 `948d67409f0ae9c93fd41428f634cfc93c7815a21f43690cecb9095c9d3ec8f1` Source locator `/rows/9` | | | | | | | | | [ProofBench v1.1 / overall](https://benchize.com/benchmarks/vals-ai%3Aproof_bench%3Aoverall.md) | 83% | SE ±3.78 pp | 11 / 34 | $1.44 | 520.41source duration | [Vals AI · 1.1](https://www.vals.ai/_astro/benchmark_view_proof_bench.i3Hwh8rW.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 83 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 1.438313 \| USD \| per_test \| Lower is better \| \| `latency` \| 520.405 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±3.78 pp sourcePopulation 52 stderr 3.775 tokenTotals {"cache_read_tokens":115350727,"cache_write_tokens":null,"input_tokens":123160663,"output_tokens":1522264,"reasoning_tokens":541932} ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_proof_bench.i3Hwh8rW.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1.1 Observed 2026-10-21T16:46:01.401Z Evidence SHA-256 `22be2aca25de5c4a9eb6448a95713e09a7c97126dfc6f4f75c4afd0e563209cb` Source locator `/tasks/overall/openai~1gpt-5.6-sol` | | | | | | | | | [LegalBench / rule tasks](https://benchize.com/benchmarks/vals-ai%3Alegal_bench%3Arule_tasks.md) | 86.44% | SE ±1.34 pp | 7 / 44 | $0.03 | 14.84source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_bench.D6uTgA3b.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 86.443 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.025965 \| USD \| per_test \| Lower is better \| \| `latency` \| 14.835 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.34 pp sourcePopulation 151 stderr 1.335 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_bench.D6uTgA3b.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:45:53.390Z Evidence SHA-256 `c8486ba756baa5cd3955d035edff67440e8db23e69d62ad1a9e18d15b8c4bc52` Source locator `/tasks/rule_tasks/openai~1gpt-5.6-sol` | | | | | | | | | [Finance Agent (v2) / earnings analysis](https://benchize.com/benchmarks/vals-ai%3Afabv2%3Aearnings_analysis.md) | 74.35% | SE ±1.29 pp | 20 / 50 | $0.69 | 423.56source duration | [Vals AI · 2](https://www.vals.ai/_astro/benchmark_view_finance_agent_v2.DypCOnwd.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 74.351 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.687883 \| USD \| per_test \| Lower is better \| \| `latency` \| 423.559 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.29 pp sourcePopulation 80 stderr 1.294 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_finance_agent_v2.DypCOnwd.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 2 Observed 2026-10-21T16:45:57.035Z Evidence SHA-256 `f731b20a26c126725d125519f2b5841aa45254656dba859a9570d7ce7e5d8191` Source locator `/tasks/earnings_analysis/openai~1gpt-5.6-sol` | | | | | | | | | [LegalBench / rhetoric tasks](https://benchize.com/benchmarks/vals-ai%3Alegal_bench%3Arhetoric_tasks.md) | 82.05% | SE ±1.12 pp | 14 / 44 | $0.00629 | 2.61source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_bench.D6uTgA3b.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 82.054 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.00629 \| USD \| per_test \| Lower is better \| \| `latency` \| 2.608 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.12 pp sourcePopulation 151 stderr 1.12 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_bench.D6uTgA3b.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:45:53.390Z Evidence SHA-256 `c8486ba756baa5cd3955d035edff67440e8db23e69d62ad1a9e18d15b8c4bc52` Source locator `/tasks/rhetoric_tasks/openai~1gpt-5.6-sol` | | | | | | | | | [Terminal-Bench 4.0 / hardware](https://benchize.com/benchmarks/vals-ai%3Aterminal-bench-4%3Ahardware.md) | 0% | SE ±0 pp | 21 / 36 | — | — | [Vals AI · 4.0](https://www.vals.ai/_astro/benchmark_view_terminal_bench_4.CAnGyzC_.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 0 \| percent \| reported \| Higher is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0 pp sourcePopulation 52 stderr 0 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_terminal_bench_4.CAnGyzC_.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 4.0 Observed 2026-10-21T16:46:10.642Z Evidence SHA-256 `98f6964580e901f1aa143db664bd92aa558415f643569492545d67c47d7f519b` Source locator `/tasks/hardware/openai~1gpt-5.6-sol` | | | | | | | | | [Time Horizon Index: KSP / overall](https://benchize.com/benchmarks/vals-ai%3Atime_horizon_index%3Aoverall.md) | 23.83% | SE ±0 pp | 5 / 10 | $2,027.2 | 0source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_ksp_bench.CDDTSam7.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 23.833 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 2027.203388 \| USD \| per_test \| Lower is better \| \| `latency` \| 0 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0 pp sourcePopulation 13 stderr 0 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_ksp_bench.CDDTSam7.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:46:16.730Z Evidence SHA-256 `be251b72ecceae7912b9577f9b3a3512740c308a34f81ac823952e919adae50f` Source locator `/tasks/overall/openai~1gpt-5.6-sol` | | | | | | | | | [Legal Research Bench / weighted pass civil litigation](https://benchize.com/benchmarks/vals-ai%3Alegal_research%3Aweighted_pass__civil_litigation.md) | 90.23% | SE ±2.78 pp | 9 / 50 | $18.56 | 3,816.9source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_research.DiuL0R8P.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 90.225 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 18.560919 \| USD \| per_test \| Lower is better \| \| `latency` \| 3816.903 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±2.78 pp sourcePopulation 82 stderr 2.781 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_research.DiuL0R8P.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:45:52.389Z Evidence SHA-256 `26c58dfd47d0d2dc86f33c6d056f30309e0ee63570e7cd752c593b385f9d862e` Source locator `/tasks/weighted_pass__civil_litigation/openai~1gpt-5.6-sol` | | | | | | | | | [ProgramBench / overall](https://benchize.com/benchmarks/vals-ai%3Aprogrambench%3Aoverall.md) | 1.5% | SE ±0.86 pp | 11 / 40 | $15.29 | 1,764.49source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_programbench.C_J7ZU4X.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 1.5 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 15.289359 \| USD \| per_test \| Lower is better \| \| `latency` \| 1764.488 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.86 pp sourcePopulation 64 stderr 0.862 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_programbench.C_J7ZU4X.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:46:10.137Z Evidence SHA-256 `e9bbb4378c7a058441a21d456baf9316b96c2cf5b58d371a3c7c803f5000bd8c` Source locator `/tasks/overall/openai~1gpt-5.6-sol` | | | | | | | | | [Vals Multimodal Index / terminal bench 2 1](https://benchize.com/benchmarks/vals-ai%3Avals_multimodal_index%3Aterminal_bench_2_1.md) | 85.77% | SE ±1.35 pp | 1 / 20 | $1.02 | 372.82source duration | [Vals AI · 1.2](https://www.vals.ai/_astro/benchmark_view_vals_multimodal_index.virVpWMs.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 85.768 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 1.023319 \| USD \| per_test \| Lower is better \| \| `latency` \| 372.819 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.35 pp sourcePopulation 33 stderr 1.35 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_vals_multimodal_index.virVpWMs.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1.2 Observed 2026-10-21T16:45:51.881Z Evidence SHA-256 `077b22575f6e075b7b78157d000ec8f94d7ead409c7dcbcf04887630ed572a2d` Source locator `/tasks/terminal_bench_2_1/openai~1gpt-5.6-sol` | | | | | | | | | [MortgageTax / overall](https://benchize.com/benchmarks/vals-ai%3Amortgage_tax%3Aoverall.md) | 67.29% | SE ±0.92 pp | 19 / 31 | $0.07 | 12.62source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_mortgage_tax.DCd-oO5Y.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 67.289 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.071198 \| USD \| per_test \| Lower is better \| \| `latency` \| 12.618 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.92 pp sourcePopulation 98 stderr 0.922 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_mortgage_tax.DCd-oO5Y.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:45:58.500Z Evidence SHA-256 `e5c844561f97d119d66d70269e726ecfb68be79eae39acf14ead3e95422e648c` Source locator `/tasks/overall/openai~1gpt-5.6-sol` | | | | | | | | | [WorldVQA ForceAnswer](https://benchize.com/benchmarks/worldvqa-force-answer.md) | 41.8% | — | 3 / 5 | — | — | [Moonshot AI · sha256:0e806bbad76dc8e8dbc899a86051e3406bdd5995fe6c6aa1b2176dde4fb28e6c](https://www.kimi.ai/blog/kimi-k3) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 41.8 \| percent \| reported \| Higher is better \| ### Configuration forceAnswer true Reasoning effort max runs 3 thinkingEnabled true ### Reported statistics runCount 3 ### Source Score publisher [Moonshot AI](https://www.kimi.ai/blog/kimi-k3) Collected via [moonshot k3](https://www.kimi.ai/blog/kimi-k3) Publisher reference Referenced by the collection source; the upstream result has not been independently captured. Benchmark [https://www.kimi.ai/blog/kimi-k3](https://www.kimi.ai/blog/kimi-k3) [Collected via](https://www.kimi.ai/blog/kimi-k3) Source Moonshot AI Original model label GPT 5.6 Sol (max) Source version sha256:0e806bbad76dc8e8dbc899a86051e3406bdd5995fe6c6aa1b2176dde4fb28e6c Observed 2026-10-21T16:31:44.130Z Evidence SHA-256 `0e806bbad76dc8e8dbc899a86051e3406bdd5995fe6c6aa1b2176dde4fb28e6c` Source locator `/flight/sheet/data/32/scores/2` | | | | | | | | | [CUA-bench / held out reflex](https://benchize.com/benchmarks/vals-ai%3Acua_bench%3Aheld_out_reflex.md) | 22% | SE ±0 pp | 1 / 8 | $43.54 | 15.02source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_cua_bench.DpgrKYWA.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 22 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 43.544694 \| USD \| per_test \| Lower is better \| \| `latency` \| 15.02 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort max harness codex maxOutputTokens 128000 provider openai reasoning true Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0 pp sourcePopulation 9 stderr 0 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_cua_bench.DpgrKYWA.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:46:16.228Z Evidence SHA-256 `8c415c63f28cd80496a4ccca27d1062ec98bb55268e58cba105b8cf2d7ee53d3` Source locator `/tasks/held_out_reflex/openai~1gpt-5.6-sol` | | | | | | | | | [MMLU-Pro](https://benchize.com/benchmarks/mmlu-pro.md) | 89.1% | SE ±0.31 pp | 11 / 40 | $0.03 | 15.65source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 89.1 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.032087 \| USD \| per_test \| Lower is better \| \| `latency` \| 15.654 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.31 pp sourcePopulation 138 stderr 0.308 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1 Observed 2026-10-21T16:46:06.503Z Evidence SHA-256 `dab025507f46c716dd8d145e90ec0a737d9c56219853f41e4b1cc3c5e8c222b4` Source locator `/tasks/overall/openai~1gpt-5.6-sol` | | | | | | | | | [Terminal-Bench 4.0 / media](https://benchize.com/benchmarks/vals-ai%3Aterminal-bench-4%3Amedia.md) | 25% | SE ±0 pp | 12 / 36 | — | — | [Vals AI · 4.0](https://www.vals.ai/_astro/benchmark_view_terminal_bench_4.CAnGyzC_.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 25 \| percent \| reported \| Higher is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0 pp sourcePopulation 52 stderr 0 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_terminal_bench_4.CAnGyzC_.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 4.0 Observed 2026-10-21T16:46:10.642Z Evidence SHA-256 `98f6964580e901f1aa143db664bd92aa558415f643569492545d67c47d7f519b` Source locator `/tasks/media/openai~1gpt-5.6-sol` | | | | | | | | | [ARC-AGI-3](https://benchize.com/benchmarks/arc-prize%3Av3_Semi_Private.md) | 7.78% | — | 15 / 53 | 25,064.11usd | — | [arc prize · v3](https://arcprize.org/media/data/leaderboard/v3.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.0778 \| score_fraction \| v3_Semi_Private \| Higher is better \| \| `total_cost` \| 25064.11 \| usd \| v3_Semi_Private \| Lower is better \| ### Configuration evaluationSplit v3_Semi_Private harness standard modelGroup openai-gpt-5-6-sol modelType CoT Reasoning effort max sourceModelVersion openai-gpt-5-6-sol-max thinkingEnabled true ### Source [Original source](https://arcprize.org/media/data/leaderboard/v3.json) Source arc prize Original model label GPT-5.6 Sol (Max) Source version v3 Observed 2026-10-21T16:34:21.112Z Evidence SHA-256 `1aaee2199f8c6d9b5a589aab2fd2480a729e9132f8cf8fbf7b49f81dbd5b2c49` Source locator `/evaluations/11` | | | | | | | | [Next page](https://benchize.com/models/gpt-5-6-sol-max.md?cursor=4b55053e3a951c8e35b8aff03e48e1f58ed861cc531578b284f2ef7f25c15a76) --- Cite as: GPT-5.6 SolMax — Benchize, https://benchize.com/models/gpt-5-6-sol-max (retrieved 2026-10-21)