# GPT-5.6 Sol

> Source: Benchize (https://benchize.com) — https://benchize.com/models/gpt-5-6-sol. When citing or reusing this content, credit "Benchize" and link to https://benchize.com/models/gpt-5-6-sol.

OpenAI

Canonical URL: https://benchize.com/models/gpt-5-6-sol
Last updated: Wed, 21 Oct 2026 18:52:20 GMT

Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations.

OpenAI

## Benchmarks

| Benchmark | Score | ± | Rank | Cost | Latency | Source |  |
| --- | --- | --- | --- | --- | --- | --- | --- |
| [FinanceBenchmark v2](https://benchize.com/benchmarks/financebenchmark%3Av2.md) | 91.78% | CI 84.93–97.26% | 3 / 21 | — | — | [financebenchmark](https://finbenchmark.ai/) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `pass_at_1` \| 0.917808 \| score_fraction \| reported \| Higher is better \| \| `accuracy` \| 0.890411 \| score_fraction \| reported \| Higher is better \| \| `knowledge` \| 1 \| score_fraction \| category \| Higher is better \| \| `analysis` \| 1 \| score_fraction \| category \| Higher is better \| \| `quant` \| 0.6 \| score_fraction \| category \| Higher is better \| \| `portfolio_mgmt` \| 1 \| score_fraction \| category \| Higher is better \| \| `credit_underwriting` \| 1 \| score_fraction \| category \| Higher is better \| \| `banking_regulation` \| 1 \| score_fraction \| category \| Higher is better \| \| `derivatives_structuring` \| 1 \| score_fraction \| category \| Higher is better \| \| `corporate_finance` \| 1 \| score_fraction \| category \| Higher is better \| ### Configuration harnessVersion 0.2.0 Reasoning effort unknown sourceRunId af4dc55e-ce54-4eb6-9a79-35b8d412d394 taskSetVersion v2 ### Reported statistics Uncertainty Confidence interval: 84.93–97.26% confidenceInterval [0.8493,0.9726] confidenceMethod percentile bootstrap over tasks, n=5000, alpha=0.05 sampleSize 73 ### Source [Original source](https://finbenchmark.ai/) Source financebenchmark Original model label gpt-5.6-sol Evaluated 2026-07-15T21:25:03.291363+00:00 Observed 2026-10-21T16:30:44.281Z Evidence SHA-256 `f9e7dab8846b092fc0befeca8c5cd02a8187c0f5b6b10c32ab2c7ab60f7af575` Source locator `/rows/2` |  |  |  |  |  |  |  |
| [Longform Creative Writing](https://benchize.com/benchmarks/eq-bench%3Alongform-writing.md) | 81.7% | — | 11 / 93 | — | — | [eq bench · longform-writing](https://eqbench.com/creative_writing_longform.js) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `overall_score_100` \| 81.7 \| percent \| overall \| Higher is better \| \| `chapter1_avg` \| 17.16 \| rubric_score \| overall \| Higher is better \| \| `chapter2_avg` \| 16.41 \| rubric_score \| overall \| Higher is better \| \| `chapter3_avg` \| 16.57 \| rubric_score \| overall \| Higher is better \| \| `chapter4_avg` \| 16.70 \| rubric_score \| overall \| Higher is better \| \| `chapter5_avg` \| 16.47 \| rubric_score \| overall \| Higher is better \| \| `chapter6_avg` \| 16.77 \| rubric_score \| overall \| Higher is better \| \| `chapter7_avg` \| 16.67 \| rubric_score \| overall \| Higher is better \| \| `chapter8_avg` \| 16.95 \| rubric_score \| overall \| Higher is better \| \| `final_judgement_avg` \| 16.32 \| rubric_score \| overall \| Higher is better \| ### Configuration interactiveAdjustments none protocol longform-writing sourceModelVersion gpt-5.6-sol ### Source [Original source](https://eqbench.com/creative_writing_longform.js) Source eq bench Original model label gpt-5.6-sol Source version longform-writing Observed 2026-10-21T16:35:02.575Z Evidence SHA-256 `3ba283ce357ac7620e16db640a961879c30fe3ddc50a27de9a8ed4290784825c` Source locator `/leaderboardDataLongformV3/118` |  |  |  |  |  |  |  |
| [OfficeQA Pro — Oracle PDF + Web Search](https://benchize.com/benchmarks/officeqa-pro%3Aoracle.md) | 75.94% | — | 4 / 12 | — | — | [officeqa pro · sha256:4ea6f6e46bf4afc28634ec4b9abb54837c58c284e71ba077f6b8fbe11aa3be30](https://api.github.com/repos/databricks/officeqa/git/blobs/a9992a78b86a0d400f1e3af8027fe5d3166eef97) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `correctness` \| 75.94 \| percent \| oracle_pdf_web_search \| Higher is better \| ### Configuration absoluteRelativeErrorPercent 0.1 harness Oracle PDF + Web Search oraclePages true webSearch true ### Reported statistics sampleSize 133 ### Source [Original source](https://api.github.com/repos/databricks/officeqa/git/blobs/a9992a78b86a0d400f1e3af8027fe5d3166eef97) Source officeqa pro Original model label GPT-5.6 Sol Source version sha256:4ea6f6e46bf4afc28634ec4b9abb54837c58c284e71ba077f6b8fbe11aa3be30 Observed 2026-10-21T16:34:42.039Z Evidence SHA-256 `cdd236761e2f624c8101365ba5094ad77fc80c32b05567db37384360b230f76a` Source locator `/chart-labels/2` |  |  |  |  |  |  |  |
| [OfficeQA Pro — Agent Harness](https://benchize.com/benchmarks/officeqa-pro%3Aagent.md) | 60.2% | — | 3 / 13 | — | — | [officeqa pro · sha256:07c23a70c189c84ab808067929402d3b636ce81e46520faca981a178e02065ad](https://api.github.com/repos/databricks/officeqa/git/blobs/125bf765bb37397a7a6b41a49ea04e6117eb95b8) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `correctness` \| 60.2 \| percent \| agent_full_tools \| Higher is better \| ### Configuration harness Codex SDK ### Reported statistics sampleSize 133 ### Source [Original source](https://api.github.com/repos/databricks/officeqa/git/blobs/125bf765bb37397a7a6b41a49ea04e6117eb95b8) Source officeqa pro Original model label GPT-5.6 Sol Source version sha256:07c23a70c189c84ab808067929402d3b636ce81e46520faca981a178e02065ad Observed 2026-10-21T16:34:41.697Z Evidence SHA-256 `094af719408a1dea8ccb110965da3cc1b83056de87ba0b95e99bf603955f42b1` Source locator `/chart-labels/6` |  |  |  |  |  |  |  |
| [OfficeQA Pro V2 — Agent Harness](https://benchize.com/benchmarks/officeqa-pro%3Av2-agent.md) | 33.3% | — | 4 / 7 | — | — | [officeqa pro · sha256:d97762a15ad277575c2f567c4e3a318b6bb1d4e4d4d0008cd4f5c7953bae3253](https://api.github.com/repos/databricks/officeqa/git/blobs/cebf9bca23960fa1328f3421f0cb28d236cd86eb) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `correctness` \| 33.3 \| percent \| agent_full_tools \| Higher is better \| ### Configuration harness OpenAI Codex ### Reported statistics sampleSize 90 ### Source [Original source](https://api.github.com/repos/databricks/officeqa/git/blobs/cebf9bca23960fa1328f3421f0cb28d236cd86eb) Source officeqa pro Original model label GPT-5.6 Sol Source version sha256:d97762a15ad277575c2f567c4e3a318b6bb1d4e4d4d0008cd4f5c7953bae3253 Observed 2026-10-21T16:34:42.395Z Evidence SHA-256 `0e566748b11c0bfc76d6076b7d871f45fe43266e4787dfe523c359f3db0b7a10` Source locator `/chart-labels/3` |  |  |  |  |  |  |  |
| [Vals Multimodal Index / swebench](https://benchize.com/benchmarks/vals-ai%3Avals_multimodal_index%3Aswebench.md) | 99.02% | SE ±0.98 pp | 1 / 20 | $1.31 | 237.14source duration | [Vals AI · 1.2](https://www.vals.ai/_astro/benchmark_view_vals_multimodal_index.virVpWMs.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 99.02 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 1.311279 \| USD \| per_test \| Lower is better \| \| `latency` \| 237.142 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens Not reported provider Not reported reasoning Not reported Reasoning effort unknown Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.98 pp sourcePopulation 33 stderr 0.976 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_vals_multimodal_index.virVpWMs.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1.2 Observed 2026-10-21T16:45:51.881Z Evidence SHA-256 `077b22575f6e075b7b78157d000ec8f94d7ead409c7dcbcf04887630ed572a2d` Source locator `/tasks/swebench/openai~1gpt-5.6-sol` |  |  |  |  |  |  |  |
| [DistressBench](https://benchize.com/benchmarks/scale%3Adistressbench.md) | 73.57source score | CI 72.47–74.67 | 10 / 27 | — | — | [scale](https://labs.scale.com/leaderboard/distressbench) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 73.57 \| source_score \| reported \| Higher is better \| ### Configuration Reasoning effort unknown Model configuration gpt-5.6-sol sourceModelVersion gpt-5.6-sol thinkingEnabled Not reported ### Reported statistics Uncertainty Confidence interval: 72.47–74.67 contaminationWarning Not reported rank 12 reportedConfidenceHalfWidth 1.1 ### Source [Original source](https://labs.scale.com/leaderboard/distressbench) Source scale Original model label gpt-5.6-sol Observed 2026-10-21T16:35:27.403Z Evidence SHA-256 `6ca6a76569e51fde037c8e2610bdf7bc39d99b54c69b6b4dc0dba9ec2a4e24da` Source locator `/rows/11` |  |  |  |  |  |  |  |
| [EQ-Bench 4](https://benchize.com/benchmarks/eq-bench%3Aeqbench4.md) | 1,250.3elo | CI 1,239.6–1,263.2 | 9 / 26 | — | — | [eq bench · eqbench4](https://eqbench.com/eqbench4/eqbench4_data.js) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 1250.3 \| elo \| overall \| Higher is better \| ### Configuration protocol eqbench4 ### Reported statistics Uncertainty Confidence interval: 1,239.6–1,263.2 confidenceIntervalHigh 1263.2 confidenceIntervalLow 1239.6 scenarios 120 ### Source [Original source](https://eqbench.com/eqbench4/eqbench4_data.js) Source eq bench Original model label gpt-5.6-sol Source version eqbench4 Observed 2026-10-21T16:35:00.261Z Evidence SHA-256 `188d8ea4a393978063a6c24dff6c92ce185169827038bfa558091212a68c29d8` Source locator `/models/8` |  |  |  |  |  |  |  |
| [OfficeQA Pro — Oracle PDF + Web Search](https://benchize.com/benchmarks/officeqa-pro%3Aoracle.md) | 80.45% | — | 2 / 12 | — | — | [officeqa pro · sha256:4ea6f6e46bf4afc28634ec4b9abb54837c58c284e71ba077f6b8fbe11aa3be30](https://api.github.com/repos/databricks/officeqa/git/blobs/a9992a78b86a0d400f1e3af8027fe5d3166eef97) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `correctness` \| 80.45 \| percent \| oracle_pdf_web_search \| Higher is better \| ### Configuration absoluteRelativeErrorPercent 1 harness Oracle PDF + Web Search oraclePages true webSearch true ### Reported statistics sampleSize 133 ### Source [Original source](https://api.github.com/repos/databricks/officeqa/git/blobs/a9992a78b86a0d400f1e3af8027fe5d3166eef97) Source officeqa pro Original model label GPT-5.6 Sol Source version sha256:4ea6f6e46bf4afc28634ec4b9abb54837c58c284e71ba077f6b8fbe11aa3be30 Observed 2026-10-21T16:34:42.039Z Evidence SHA-256 `cdd236761e2f624c8101365ba5094ad77fc80c32b05567db37384360b230f76a` Source locator `/chart-labels/1` |  |  |  |  |  |  |  |
| [PerceptionBench](https://benchize.com/benchmarks/perceptionbench.md) | 59.7% | — | 1 / 14 | — | — | [Moonshot AI / PerceptionBench · ba032c06e9b6ee3679171ff6ba643b7a0cfebe2e](https://github.com/MoonshotAI/PerceptionBench) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 59.7 \| percent \| overall \| Higher is better \| \| `visual_relation_accuracy` \| 69.7 \| percent \| atomic_capability \| Higher is better \| \| `counting_accuracy` \| 62.4 \| percent \| atomic_capability \| Higher is better \| \| `attribute_accuracy` \| 62.1 \| percent \| atomic_capability \| Higher is better \| \| `depth_3d_accuracy` \| 55.5 \| percent \| atomic_capability \| Higher is better \| \| `localization_accuracy` \| 76.7 \| percent \| atomic_capability \| Higher is better \| \| `comparison_accuracy` \| 67.0 \| percent \| atomic_capability \| Higher is better \| \| `fine_grained_recognition_accuracy` \| 55.9 \| percent \| atomic_capability \| Higher is better \| \| `contextual_integration_accuracy` \| 60.0 \| percent \| atomic_capability \| Higher is better \| \| `ocr_accuracy` \| 54.9 \| percent \| atomic_capability \| Higher is better \| \| `hallucination_accuracy` \| 26.9 \| percent \| atomic_capability \| Higher is better \| ### Configuration judgeModel gpt-oss-120b promptProtocol unified reasoningBudgetPolicy highest_available ### Reported statistics sampleSize 3000 ### Source Score publisher [Moonshot AI / PerceptionBench](https://github.com/MoonshotAI/PerceptionBench) Collected via [perceptionbench](https://api.github.com/repos/MoonshotAI/PerceptionBench/contents/README.md?ref=ba032c06e9b6ee3679171ff6ba643b7a0cfebe2e) Publisher reference Referenced by the collection source; the upstream result has not been independently captured. Benchmark [https://api.github.com/repos/MoonshotAI/PerceptionBench/contents/README.md?ref=ba032c06e9b6ee3679171ff6ba643b7a0cfebe2e](https://api.github.com/repos/MoonshotAI/PerceptionBench/contents/README.md?ref=ba032c06e9b6ee3679171ff6ba643b7a0cfebe2e) [Collected via](https://api.github.com/repos/MoonshotAI/PerceptionBench/contents/README.md?ref=ba032c06e9b6ee3679171ff6ba643b7a0cfebe2e) Source Moonshot AI / PerceptionBench Original model label GPT-5.6-Sol Source version ba032c06e9b6ee3679171ff6ba643b7a0cfebe2e Observed 2026-10-21T16:33:36.858Z Evidence SHA-256 `0863d20bc397e2324ea76099fe703aed419dc7f0dbb359e522f7dac07dda6529` Source locator `/leaderboard/rows/0` |  |  |  |  |  |  |  |
| [OpenVibeEval Accessibility](https://benchize.com/benchmarks/openvibeeval%3Aaccessibility.md) | 76 | — | 11 / 26 | — | — | [openvibeeval](https://openvibeeval.com/leaderboard/) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `adjusted_score` \| 76 \| score \| sample_size_adjusted_accessibility \| Higher is better \| ### Configuration Reasoning effort unknown Model configuration GPT-5.6 Sol thinkingEnabled Not reported ### Reported statistics runCount 8 ### Source [Original source](https://openvibeeval.com/leaderboard/) Source openvibeeval Original model label GPT-5.6 Sol Evaluated 2026-08-11 Observed 2026-10-21T16:32:04.885Z Evidence SHA-256 `9b2e7d6060910e3dc7083a6a7f67377601ce78806b2b6b7693cf8d047dd63fbb` Source locator `/rows/6` |  |  |  |  |  |  |  |
| [Fortress](https://benchize.com/benchmarks/scale%3Afortress.md) | 20.14source score | CI 18.32–21.96 | 20 / 31 | — | — | [scale](https://labs.scale.com/leaderboard/fortress) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 20.14 \| source_score \| reported \| Higher is better \| ### Configuration Reasoning effort unknown Model configuration gpt-5.6-sol sourceModelVersion Not reported thinkingEnabled Not reported ### Reported statistics Uncertainty Confidence interval: 18.32–21.96 contaminationWarning ORS score: 5.34 rank 29 reportedConfidenceHalfWidth 1.82 ### Source [Original source](https://labs.scale.com/leaderboard/fortress) Source scale Original model label gpt-5.6-sol Observed 2026-10-21T16:35:37.552Z Evidence SHA-256 `875f1c5b1112c4b84f3d17df72771ebee5c293c542cbb8ab3399e35c4f82ffa5` Source locator `/rows/28` |  |  |  |  |  |  |  |
| [Creative Writing v3](https://benchize.com/benchmarks/eq-bench%3Acreative-writing-v3.md) | 1,971.6elo | — | 10 / 90 | — | — | [eq bench · creative-writing-v3](https://eqbench.com/creative_writing.js) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo_score` \| 1971.6 \| elo \| overall \| Higher is better \| \| `creative_writing_score` \| 16.78 \| rubric_score \| overall \| Higher is better \| ### Configuration interactiveAdjustments none protocol creative-writing-v3 sourceModelVersion gpt-5.6-sol ### Source [Original source](https://eqbench.com/creative_writing.js) Source eq bench Original model label gpt-5.6-sol Source version creative-writing-v3 Observed 2026-10-21T16:35:01.421Z Evidence SHA-256 `722ddb132e8d3a5e5c39b8d445f8475f3f7e24893a007260c6f3e3cce5c1ee18` Source locator `/leaderboardDataCreativeWritingV3/9` |  |  |  |  |  |  |  |
| [MCP Atlas](https://benchize.com/benchmarks/scale%3Amcp_atlas.md) | 81.8source score | CI 79.4–84.2 | 7 / 22 | — | — | [scale](https://labs.scale.com/leaderboard/mcp_atlas) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 81.8 \| source_score \| reported \| Higher is better \| ### Configuration Reasoning effort unknown Model configuration gpt-5.6 (sol) sourceModelVersion Not reported thinkingEnabled Not reported ### Reported statistics Uncertainty Confidence interval: 79.4–84.2 contaminationWarning Not reported rank 11 reportedConfidenceHalfWidth 2.4 ### Source [Original source](https://labs.scale.com/leaderboard/mcp_atlas) Source scale Original model label gpt-5.6 (sol) Observed 2026-10-21T16:35:30.627Z Evidence SHA-256 `1467b1d078bf39a76fb663f006002e7c7d08224ca7c3de883ab628a2efccebb8` Source locator `/rows/10` |  |  |  |  |  |  |  |
| [TubeLab Scriptwriting](https://benchize.com/benchmarks/tubelab%3Ascriptwriting.md) | 75.3% | — | 13 / 16 | 1.02ratio | — | [tubelab](https://tubelab.net/_next/static/chunks/pages/benchmark/scriptwriting-7ad7196ff3093ad4.js) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `quality` \| 75.3 \| percent \| source_reported \| Higher is better \| \| `craft` \| 75 \| percent \| source_reported \| Higher is better \| \| `relative_cost_per_script` \| 1.02 \| ratio \| source_reported \| Lower is better \| \| `script_time` \| 4.1 \| minutes \| source_reported \| Lower is better \| \| `hook` \| 7.1 \| score_out_of_10 \| craft_rubric \| Higher is better \| \| `retention` \| 7.5 \| score_out_of_10 \| craft_rubric \| Higher is better \| \| `storytelling` \| 6.9 \| score_out_of_10 \| craft_rubric \| Higher is better \| \| `voiceMatch` \| 6.7 \| score_out_of_10 \| craft_rubric \| Higher is better \| \| `pacing` \| 8 \| score_out_of_10 \| craft_rubric \| Higher is better \| \| `clarity` \| 8.9 \| score_out_of_10 \| craft_rubric \| Higher is better \| ### Configuration judgingProtocol blind_model_judges Reasoning effort unknown taskCount 12 ### Reported statistics confidence {"high":80.3,"low":69.8} headToHead {"losses":4,"ties":3,"winPercent":52,"wins":4} rank 18 ### Source [Original source](https://tubelab.net/_next/static/chunks/pages/benchmark/scriptwriting-7ad7196ff3093ad4.js) Source tubelab Original model label GPT-5.6 Sol Observed 2026-10-21T16:34:03.856Z Evidence SHA-256 `72f9d867f388256af8fc6dca12e8c7b6f1ddcbb97f0712da339b73102686761f` Source locator `/rows/17` |  |  |  |  |  |  |  |
| [Long-Horizon Terminal-Bench](https://benchize.com/benchmarks/lhtb%3Aoverall.md) | 45.1% | — | 4 / 12 | $21.14 | — | [lhtb](https://zli12321.github.io/LHTB/script.js) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_reward` \| 0.451 \| score_fraction \| reported \| Higher is better \| \| `solved_count` \| 7 \| tasks \| reward_gte_0_95 \| Higher is better \| \| `cost_per_task` \| 21.14 \| USD \| per_task \| Lower is better \| ### Configuration harness official_common_harness Reasoning effort unknown reportOrigin paper ### Reported statistics sampleSize 46 sourceThresholdCounts Not reported ### Source [Original source](https://zli12321.github.io/LHTB/script.js) Source lhtb Original model label GPT-5.6-sol Observed 2026-10-21T16:31:32.766Z Evidence SHA-256 `8b9c27664cc6298fa234c607ca27c953ec91b2eb9d116b8530cfaaa6722fa39e` Source locator `/rows/4` |  |  |  |  |  |  |  |
| [OfficeQA Pro — Oracle PDF + Web Search](https://benchize.com/benchmarks/officeqa-pro%3Aoracle.md) | 71.43% | — | 7 / 12 | — | — | [officeqa pro · sha256:4ea6f6e46bf4afc28634ec4b9abb54837c58c284e71ba077f6b8fbe11aa3be30](https://api.github.com/repos/databricks/officeqa/git/blobs/a9992a78b86a0d400f1e3af8027fe5d3166eef97) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `correctness` \| 71.43 \| percent \| oracle_pdf_web_search \| Higher is better \| ### Configuration absoluteRelativeErrorPercent 0 harness Oracle PDF + Web Search oraclePages true webSearch true ### Reported statistics sampleSize 133 ### Source [Original source](https://api.github.com/repos/databricks/officeqa/git/blobs/a9992a78b86a0d400f1e3af8027fe5d3166eef97) Source officeqa pro Original model label GPT-5.6 Sol Source version sha256:4ea6f6e46bf4afc28634ec4b9abb54837c58c284e71ba077f6b8fbe11aa3be30 Observed 2026-10-21T16:34:42.039Z Evidence SHA-256 `cdd236761e2f624c8101365ba5094ad77fc80c32b05567db37384360b230f76a` Source locator `/chart-labels/3` |  |  |  |  |  |  |  |
| [Humanity's Last Exam (Diamond)](https://benchize.com/benchmarks/scale%3Ahle-diamond.md) | 31.2source score | CI 28.3–34.1 | 9 / 12 | — | — | [scale](https://labs.scale.com/leaderboard/hle-diamond) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 31.2 \| source_score \| reported \| Higher is better \| ### Configuration Reasoning effort unknown Model configuration gpt-5.6-sol sourceModelVersion Not reported thinkingEnabled Not reported ### Reported statistics Uncertainty Confidence interval: 28.3–34.1 contaminationWarning Potential contamination warning: This model was evaluated after the public release of HLE, allowing model builder access to the prompts and solutions. rank 10 reportedConfidenceHalfWidth 2.9 ### Source [Original source](https://labs.scale.com/leaderboard/hle-diamond) Source scale Original model label gpt-5.6-sol Observed 2026-10-21T16:35:27.820Z Evidence SHA-256 `c60d42f5aacdf787d9ccc8b70817766d86707776a7f8b44ef0337cb9ae60bf20` Source locator `/rows/9` |  |  |  |  |  |  |  |
| [FrontierSWE v2 abs](https://benchize.com/benchmarks/frontierswe%3Av2%3Aabs.md) | 32.2source score | — | 8 / 15 | — | — | [frontierswe](https://www.frontierswe.com/) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `overall` \| 32.20246705882353 \| source_score \| mean \| Higher is better \| \| `overall_best` \| 44.173785294117664 \| source_score \| best \| Higher is better \| \| `overall_worst` \| 22.200797058823532 \| source_score \| worst \| Higher is better \| \| `implementation` \| 40.38867142857142 \| source_score \| mean \| Higher is better \| \| `performance` \| 22.00731 \| source_score \| mean \| Higher is better \| \| `research` \| 28.195966666666667 \| source_score \| mean \| Higher is better \| ### Configuration aggregation mean harness proximus normalization abs Reasoning effort unknown ### Source [Original source](https://www.frontierswe.com/) Source frontierswe Original model label GPT-5.6 Sol Observed 2026-10-21T16:31:27.602Z Evidence SHA-256 `818e027068cf61ff1aadd8281b6e49e9c6795221015210601b5e34d0d223e5b5` Source locator `/rows/7` |  |  |  |  |  |  |  |
| [Vending-Bench 2](https://benchize.com/benchmarks/vendingbench%3Av2.md) | — | — | — | $9,619.37 | — | [vendingbench](https://andonlabs.com/_app/immutable/chunks/Cjn0_qj9.js) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `final_balance` \| 9619.367999999999 \| USD \| one_simulated_year \| Higher is better \| \| `geometric_mean_balance` \| 9246.594496711794 \| USD \| positive_final_balances \| Higher is better \| ### Configuration Reasoning effort unknown Model configuration GPT-5.6 Sol thinkingEnabled Not reported ### Reported statistics confidenceHalfWidth95 2622.0851399148105 positiveBalanceRuns 5 runCount 5 standardDeviation 2991.4084773681448 standardError 1337.7985407728625 ### Source [Original source](https://andonlabs.com/_app/immutable/chunks/Cjn0_qj9.js) Source vendingbench Original model label GPT-5.6 Sol Observed 2026-10-21T16:36:40.592Z Evidence SHA-256 `1a0b043147050298c405bcb743d73e425d532464202231cd18c27f836fa5f223` Source locator `/rows/33` |  |  |  |  |  |  |  |
| [AutomationBench](https://benchize.com/benchmarks/zapier%3Aautomationbench.md) | 3.81% | — | 92 / 113 | $0.41 | — | [zapier](https://framerusercontent.com/sites/4WTSl4BNjd1q9QFEFibC6h/lOvLnhItj8S8-1vyjH_s33Jn-WmUXPmiJ5Diajl0Q38.CMutaHYl.mjs) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 3.81 \| percent \| reported \| Higher is better \| \| `cost` \| 0.41 \| USD \| per_task \| Lower is better \| ### Configuration benchmarkVersion 1.0.6 costFootnote false Fallback policy Not reported Reasoning effort unknown Model configuration GPT-5.6 Sol thinkingEnabled Not reported ### Reported statistics rank 104 ### Source [Original source](https://framerusercontent.com/sites/4WTSl4BNjd1q9QFEFibC6h/lOvLnhItj8S8-1vyjH_s33Jn-WmUXPmiJ5Diajl0Q38.CMutaHYl.mjs) Source zapier Original model label GPT-5.6 Sol Observed 2026-10-21T16:34:56.783Z Evidence SHA-256 `43978e38f018789fa59c11de5328abe9e5905bfa9a5a4d601fa3aa4d9c153b0d` Source locator `/rows/103` |  |  |  |  |  |  |  |
| [HiL-Bench (Human-in-Loop Benchmark)](https://benchize.com/benchmarks/scale%3Ahil.md) | 32.33source score | CI 26.84–37.82 | 18 / 22 | — | — | [scale](https://labs.scale.com/leaderboard/hil) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 32.33 \| source_score \| reported \| Higher is better \| ### Configuration Reasoning effort unknown Model configuration GPT 5.6 Sol sourceModelVersion Not reported thinkingEnabled Not reported ### Reported statistics Uncertainty Confidence interval: 26.84–37.82 contaminationWarning Not reported rank 23 reportedConfidenceHalfWidth 5.49 ### Source [Original source](https://labs.scale.com/leaderboard/hil) Source scale Original model label GPT 5.6 Sol Observed 2026-10-21T16:35:30.082Z Evidence SHA-256 `043a333e27453edada150667c7f4439b2aab463f37928c2153c6aa79f33dd1b2` Source locator `/rows/22` |  |  |  |  |  |  |  |
| [OfficeQA Pro — Oracle PDF + Web Search](https://benchize.com/benchmarks/officeqa-pro%3Aoracle.md) | 82.71% | — | 1 / 12 | — | — | [officeqa pro · sha256:4ea6f6e46bf4afc28634ec4b9abb54837c58c284e71ba077f6b8fbe11aa3be30](https://api.github.com/repos/databricks/officeqa/git/blobs/a9992a78b86a0d400f1e3af8027fe5d3166eef97) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `correctness` \| 82.71 \| percent \| oracle_pdf_web_search \| Higher is better \| ### Configuration absoluteRelativeErrorPercent 5 harness Oracle PDF + Web Search oraclePages true webSearch true ### Reported statistics sampleSize 133 ### Source [Original source](https://api.github.com/repos/databricks/officeqa/git/blobs/a9992a78b86a0d400f1e3af8027fe5d3166eef97) Source officeqa pro Original model label GPT-5.6 Sol Source version sha256:4ea6f6e46bf4afc28634ec4b9abb54837c58c284e71ba077f6b8fbe11aa3be30 Observed 2026-10-21T16:34:42.039Z Evidence SHA-256 `cdd236761e2f624c8101365ba5094ad77fc80c32b05567db37384360b230f76a` Source locator `/chart-labels/0` |  |  |  |  |  |  |  |
| [NC Bench](https://benchize.com/benchmarks/nc-bench%3Aoverall.md) | 90.76% | — | 51 / 144 | — | — | [nc bench](https://www.nc-bench.com/models) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 90.76 \| percent \| reported \| Higher is better \| \| `tooling` \| 100 \| percent \| category \| Higher is better \| \| `creative_writing` \| 91.04 \| percent \| category \| Higher is better \| \| `language` \| 94.6 \| percent \| category \| Higher is better \| \| `utility` \| 80.44 \| percent \| category \| Higher is better \| \| `reasoning` \| 91.25 \| percent \| category \| Higher is better \| \| `text_editing` \| 98.43 \| percent \| category \| Higher is better \| \| `rule_following` \| 74.47 \| percent \| category \| Higher is better \| \| `hallucination` \| 95.87 \| percent \| category \| Higher is better \| ### Configuration Reasoning effort unknown Model configuration GPT-5.6 Sol thinkingEnabled Not reported ### Source [Original source](https://www.nc-bench.com/models) Source nc bench Original model label GPT-5.6 Sol Observed 2026-10-21T16:31:48.370Z Evidence SHA-256 `ec261022458543624b08a136d01f5a2f0666cd52ffb49c64d6ca983e8543d1b5` Source locator `/rows/63` |  |  |  |  |  |  |  |

---
Cite as: GPT-5.6 Sol — Benchize, https://benchize.com/models/gpt-5-6-sol (retrieved 2026-10-21)