# GPT-5.6 SolMedium

> Source: Benchize (https://benchize.com) — https://benchize.com/models/gpt-5-6-sol-medium. When citing or reusing this content, credit "Benchize" and link to https://benchize.com/models/gpt-5-6-sol-medium.

OpenAI

Canonical URL: https://benchize.com/models/gpt-5-6-sol-medium
Last updated: Thu, 22 Oct 2026 05:30:58 GMT

Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations.

OpenAI

## Benchmarks

| Benchmark | Score | ± | Rank | Cost | Latency | Source |  |
| --- | --- | --- | --- | --- | --- | --- | --- |
| [DesignArena Agentic presentation generation](https://benchize.com/benchmarks/designarena%3Aagentic-slides.md) | 1,241elo | SE ±10.41 | 7 / 19 | — | — | [designarena · public](https://www.designarena.ai/api/leaderboard#board=agentic-slides) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 1241 \| elo \| agentic-slides \| Higher is better \| ### Configuration arenaType agents category agon_slides inputModality Not reported Reasoning effort medium sourceModelVersion gpt-5.6-sol thinkingEnabled true variationName public ### Reported statistics Uncertainty Standard error: ±10.41 averageGenerationTimeMs Not reported battles 1215 losses 515 standardError 10.4069 winRate 57.6 wins 700 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=agentic-slides) Source designarena Original model label GPT-5.6 Sol (Medium) Source version public Observed 2026-10-21T16:38:03.963Z Evidence SHA-256 `b732c5aba2e357cf6034f23084d5f95f8e8882f62b8bf3ee340f0cd5cd773724` Source locator `/data/8` |  |  |  |  |  |  |  |
| [DesignArena Mobile application development](https://benchize.com/benchmarks/designarena%3Amobileapps.md) | 1,106elo | SE ±23.47 | 27 / 33 | — | — | [designarena · public](https://www.designarena.ai/api/leaderboard#board=mobileapps) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 1106 \| elo \| mobileapps \| Higher is better \| ### Configuration arenaType agents category mobileapps inputModality Not reported Reasoning effort medium sourceModelVersion gpt-5.6-sol thinkingEnabled true variationName public ### Reported statistics Uncertainty Standard error: ±23.47 averageGenerationTimeMs Not reported battles 228 losses 131 standardError 23.47 winRate 42.5 wins 97 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=mobileapps) Source designarena Original model label GPT-5.6 Sol (Medium) Source version public Observed 2026-10-21T16:38:02.538Z Evidence SHA-256 `40af33d0e93e729486da375cbe954633e2458af0dd6ca6d9fbdcda90da650f7d` Source locator `/data/40` |  |  |  |  |  |  |  |
| [DeepSWE](https://benchize.com/benchmarks/deepswe%3Av1.1.md) | 61.06% | Range 59.48–62.65% | 32 / 70 | $1.86 | 423.38s | [deepswe](https://deepswe.datacurve.ai/artifacts/v1.1/leaderboard-live.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `pass_at_1` \| 0.6106194690265486 \| score_fraction \| scored_rollout_attempts \| Higher is better \| \| `pass_at_4` \| 0.8053097345132744 \| score_fraction \| tasks_with_one_passing_rollout \| Higher is better \| \| `cost_per_attempt` \| 1.8620318075221238 \| USD \| scored_attempt \| Lower is better \| \| `duration` \| 423.3752944181416 \| seconds \| scored_attempt \| Lower is better \| ### Configuration harness mini-swe-agent Reasoning effort medium sourceConfiguration mini_swe_agent_gpt_5_6_sol_medium ### Reported statistics Uncertainty Reported interval: 59.48–62.65% interval [0.5947858925334765,0.6264530455196208] intervalMethod 95% run-to-run: SE across repeated whole-benchmark passes (1.96 * std(runs)/sqrt(R)) runCount 4 sampleSize 452 taskCount 113 ### Source [Original source](https://deepswe.datacurve.ai/artifacts/v1.1/leaderboard-live.json) Source deepswe Original model label gpt-5-6-sol Observed 2026-10-22T03:50:05.889Z Evidence SHA-256 `a7c15d66288fd249c020b9931c017b92d1a3b90e480b3ff34974b752bd030019` Source locator `/rows/31` |  |  |  |  |  |  |  |
| [DesignArena Overall frontend coding](https://benchize.com/benchmarks/designarena%3Acode.md) | 1,316elo | SE ±2.28 | 15 / 116 | — | — | [designarena · public](https://www.designarena.ai/api/leaderboard#board=code) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 1316 \| elo \| code \| Higher is better \| ### Configuration arenaType models category allcategories inputModality text Reasoning effort medium sourceModelVersion gpt-5.6-sol thinkingEnabled true variationName public ### Reported statistics Uncertainty Standard error: ±2.28 averageGenerationTimeMs 139649 battles 28260 losses 12306 standardError 2.2786 winRate 56.5 wins 15954 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=code) Source designarena Original model label GPT-5.6 Sol (Medium) Source version public Observed 2026-10-21T16:37:57.301Z Evidence SHA-256 `0c897b58670f5e352bd123db999a40c0d1781a443964c502b90774a76a3a7758` Source locator `/data/16` |  |  |  |  |  |  |  |
| [DesignArena Image to web application](https://benchize.com/benchmarks/designarena%3Aimage-to-webapp.md) | 1,181elo | SE ±13.02 | 15 / 24 | — | — | [designarena · public](https://www.designarena.ai/api/leaderboard#board=image-to-webapp) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 1181 \| elo \| image-to-webapp \| Higher is better \| ### Configuration arenaType agents category agon_webapps inputModality image Reasoning effort medium sourceModelVersion gpt-5.6-sol thinkingEnabled true variationName public ### Reported statistics Uncertainty Standard error: ±13.02 averageGenerationTimeMs Not reported battles 782 losses 371 standardError 13.0151 winRate 52.6 wins 411 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=image-to-webapp) Source designarena Original model label GPT-5.6 Sol (Medium) Source version public Observed 2026-10-21T16:37:59.412Z Evidence SHA-256 `cc4e49fc057d3b786184ff44b697422e2420a174e8a98a80a77aa65021921ab4` Source locator `/data/17` |  |  |  |  |  |  |  |
| [DesignArena Agentic game development](https://benchize.com/benchmarks/designarena%3Aagentic-game-dev.md) | 1,200elo | SE ±10.52 | 8 / 17 | — | — | [designarena · public](https://www.designarena.ai/api/leaderboard#board=agentic-game-dev) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 1200 \| elo \| agentic-game-dev \| Higher is better \| ### Configuration arenaType agents category agentic_gamedev inputModality Not reported Reasoning effort medium sourceModelVersion gpt-5.6-sol thinkingEnabled true variationName public ### Reported statistics Uncertainty Standard error: ±10.52 averageGenerationTimeMs Not reported battles 1152 losses 548 standardError 10.5222 winRate 52.4 wins 604 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=agentic-game-dev) Source designarena Original model label GPT-5.6 Sol (Medium) Source version public Observed 2026-10-21T16:38:01.564Z Evidence SHA-256 `2bb291527289cec897df421c3c59427ce53230a312bf61790ba7ac6ca436bb4b` Source locator `/data/11` |  |  |  |  |  |  |  |
| [DesignArena Data visualization generation](https://benchize.com/benchmarks/designarena%3Adata-viz.md) | 1,293elo | — | 17 / 99 | — | — | [designarena · public](https://www.designarena.ai/api/leaderboard#board=data-viz) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 1293 \| elo \| data-viz \| Higher is better \| ### Configuration arenaType models category dataviz inputModality Not reported Reasoning effort medium sourceModelVersion gpt-5.6-sol thinkingEnabled true variationName public ### Reported statistics averageGenerationTimeMs 114956 battles 2948 losses 1392 standardError Not reported winRate 52.8 wins 1556 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=data-viz) Source designarena Original model label GPT-5.6 Sol (Medium) Source version public Observed 2026-10-21T16:37:58.264Z Evidence SHA-256 `a895f6f1a25fa8eb01f821c2097ddec4f884de7bd22f1b8a22e82e6679b71849` Source locator `/data/18` |  |  |  |  |  |  |  |
| [DesignArena Full-stack application development](https://benchize.com/benchmarks/designarena%3Afullstack.md) | 1,159elo | SE ±9.17 | 20 / 31 | — | — | [designarena · public](https://www.designarena.ai/api/leaderboard#board=fullstack) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 1159 \| elo \| fullstack \| Higher is better \| ### Configuration arenaType agents category fullstack inputModality Not reported Reasoning effort medium sourceModelVersion gpt-5.6-sol thinkingEnabled true variationName public ### Reported statistics Uncertainty Standard error: ±9.17 averageGenerationTimeMs Not reported battles 1614 losses 810 standardError 9.1668 winRate 49.8 wins 804 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=fullstack) Source designarena Original model label GPT-5.6 Sol (Medium) Source version public Observed 2026-10-21T16:38:00.857Z Evidence SHA-256 `aa171459dd44cfad57fba8da746c40b27832b57dc731b1198bdb71c73ddd0f97` Source locator `/data/27` |  |  |  |  |  |  |  |
| [DesignArena Website generation](https://benchize.com/benchmarks/designarena%3Awebsite.md) | 1,309elo | — | 14 / 123 | — | — | [designarena · public](https://www.designarena.ai/api/leaderboard#board=website) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 1309 \| elo \| website \| Higher is better \| ### Configuration arenaType models category website inputModality text Reasoning effort medium sourceModelVersion gpt-5.6-sol thinkingEnabled true variationName public ### Reported statistics averageGenerationTimeMs 158202 battles 13428 losses 5898 standardError Not reported winRate 56.1 wins 7530 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=website) Source designarena Original model label GPT-5.6 Sol (Medium) Source version public Observed 2026-10-21T16:37:57.757Z Evidence SHA-256 `51873e97776a3c5ae706b24cc2c60384793dd18398df970e213a8e7c276d8ac0` Source locator `/data/15` |  |  |  |  |  |  |  |
| [DesignArena SVG generation](https://benchize.com/benchmarks/designarena%3Asvgs.md) | 1,299elo | — | 9 / 77 | — | — | [designarena · public](https://www.designarena.ai/api/leaderboard#board=svgs) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 1299 \| elo \| svgs \| Higher is better \| ### Configuration arenaType models category svg inputModality Not reported Reasoning effort medium sourceModelVersion gpt-5.6-sol thinkingEnabled true variationName public ### Reported statistics averageGenerationTimeMs 45717 battles 1863 losses 751 standardError Not reported winRate 59.7 wins 1112 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=svgs) Source designarena Original model label GPT-5.6 Sol (Medium) Source version public Observed 2026-10-21T16:38:03.249Z Evidence SHA-256 `8cbc34a474a66ef5c64f3ffe557df9b55bf7e13368c07c0214223e3ed8f3f21e` Source locator `/data/12` |  |  |  |  |  |  |  |
| [DesignArena Image to HTML](https://benchize.com/benchmarks/designarena%3Aimage-to-html.md) | 1,229elo | — | 11 / 35 | — | — | [designarena · public](https://www.designarena.ai/api/leaderboard#board=image-to-html) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 1229 \| elo \| image-to-html \| Higher is better \| ### Configuration arenaType models category website inputModality image Reasoning effort medium sourceModelVersion gpt-5.6-sol thinkingEnabled true variationName public ### Reported statistics averageGenerationTimeMs 144604 battles 3315 losses 1506 standardError Not reported winRate 54.6 wins 1809 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=image-to-html) Source designarena Original model label GPT-5.6 Sol (Medium) Source version public Observed 2026-10-21T16:37:58.959Z Evidence SHA-256 `94f97ebbdd53a8c56f138b620e59b3a9b35c66c3954dcaaa1b2ed4c71518b404` Source locator `/data/11` |  |  |  |  |  |  |  |
| [FrontierCode 1.1 main](https://benchize.com/benchmarks/frontiercode%3Av1_1%3Amain.md) | 39.93% | — | 71 / 125 | $2.69 | — | [frontiercode](https://cognition.com/data/frontiercode-leaderboard/data.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.3993 \| score_fraction \| blocking_criteria_adjusted \| Higher is better \| \| `correct` \| 0.4453 \| score_fraction \| raw_rubric \| Higher is better \| \| `cost` \| 2.6897 \| USD \| per_rollout \| Lower is better \| ### Configuration harness codex Reasoning effort medium sourceVersion v1_1 subset main ### Reported statistics flaggedRate 0.002 sampleSize 100 ### Source [Original source](https://cognition.com/data/frontiercode-leaderboard/data.json) Source frontiercode Original model label GPT-5.6 Sol Observed 2026-10-21T16:31:00.878Z Evidence SHA-256 `ff0040778b7bdf69c705ad7474f771fb5e53cfaf5cf8573b3a4614153543d75f` Source locator `/v1_1/data/GPT-5.6%20Sol/medium/main` |  |  |  |  |  |  |  |
| [NC Bench](https://benchize.com/benchmarks/nc-bench%3Aoverall.md) | 95.15% | — | 6 / 144 | — | — | [nc bench](https://www.nc-bench.com/models) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 95.15 \| percent \| reported \| Higher is better \| \| `tooling` \| 100 \| percent \| category \| Higher is better \| \| `creative_writing` \| 91.03 \| percent \| category \| Higher is better \| \| `language` \| 99.93 \| percent \| category \| Higher is better \| \| `utility` \| 97.51 \| percent \| category \| Higher is better \| \| `reasoning` \| 96.86 \| percent \| category \| Higher is better \| \| `text_editing` \| 98.26 \| percent \| category \| Higher is better \| \| `rule_following` \| 85.88 \| percent \| category \| Higher is better \| \| `hallucination` \| 91.72 \| percent \| category \| Higher is better \| ### Configuration Reasoning effort medium Model configuration GPT-5.6 Sol (Reasoning, Medium) thinkingEnabled true ### Source [Original source](https://www.nc-bench.com/models) Source nc bench Original model label GPT-5.6 Sol (Reasoning, Medium) Observed 2026-10-21T16:31:48.370Z Evidence SHA-256 `ec261022458543624b08a136d01f5a2f0666cd52ffb49c64d6ca983e8543d1b5` Source locator `/rows/7` |  |  |  |  |  |  |  |
| [DesignArena Agentic web applications](https://benchize.com/benchmarks/designarena%3Awebapps.md) | 1,190elo | SE ±7.73 | 26 / 39 | — | — | [designarena · public](https://www.designarena.ai/api/leaderboard#board=webapps) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 1190 \| elo \| webapps \| Higher is better \| ### Configuration arenaType agents category agon_webapps inputModality text Reasoning effort medium sourceModelVersion gpt-5.6-sol thinkingEnabled true variationName public ### Reported statistics Uncertainty Standard error: ±7.73 averageGenerationTimeMs Not reported battles 2265 losses 1096 standardError 7.7273 winRate 51.6 wins 1169 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=webapps) Source designarena Original model label GPT-5.6 Sol (Medium) Source version public Observed 2026-10-21T16:38:00.309Z Evidence SHA-256 `f955787274cf4ac627ada7cd33eaae2e08ef7297db92d3391340fcaa0b44a35f` Source locator `/data/31` |  |  |  |  |  |  |  |
| [DesignArena Agentic HTML slide generation](https://benchize.com/benchmarks/designarena%3Aagentic-html-slides.md) | 1,182elo | — | 6 / 13 | — | — | [designarena · public](https://www.designarena.ai/api/leaderboard#board=agentic-html-slides) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 1182 \| elo \| agentic-html-slides \| Higher is better \| ### Configuration arenaType agents category agon_slides_html inputModality Not reported Reasoning effort medium sourceModelVersion gpt-5.6-sol thinkingEnabled true variationName public ### Reported statistics averageGenerationTimeMs Not reported battles 1228 losses 609 standardError Not reported winRate 50.4 wins 619 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=agentic-html-slides) Source designarena Original model label GPT-5.6 Sol (Medium) Source version public Observed 2026-10-21T16:38:04.391Z Evidence SHA-256 `02fccc0ebb2758ba116665bc1fcb2f049b9b2f1251c0f0bb29caed69ffaf0cb0` Source locator `/data/10` |  |  |  |  |  |  |  |
| [SWE-rebench](https://benchize.com/benchmarks/swe-rebench%3Aresolved.md) | 62.3% | — | 2 / 8 | $0.85 | — | [swe rebench](https://swe-rebench.com/) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `resolved` \| 62.3 \| percent \| reported \| Higher is better \| \| `pass_at_5` \| 79.3 \| percent \| reported \| Higher is better \| \| `cost_per_problem` \| 0.85 \| USD \| per_problem \| Lower is better \| ### Configuration Reasoning effort medium Model configuration GPT-5.6 Sol [medium] submissionType model thinkingEnabled true ### Source [Original source](https://swe-rebench.com/) Source swe rebench Original model label GPT-5.6 Sol [medium] Observed 2026-10-21T16:32:30.269Z Evidence SHA-256 `fbb1b659562843da266aa20ec2295253d727ccd9b9469c78ab32df6fad1fffed` Source locator `/rows/4` |  |  |  |  |  |  |  |
| [FrontierCode 1.1 extended](https://benchize.com/benchmarks/frontiercode%3Av1_1%3Aextended.md) | 54.68% | — | 69 / 125 | $2.3 | — | [frontiercode](https://cognition.com/data/frontiercode-leaderboard/data.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.5468 \| score_fraction \| blocking_criteria_adjusted \| Higher is better \| \| `correct` \| 0.6031 \| score_fraction \| raw_rubric \| Higher is better \| \| `cost` \| 2.3007 \| USD \| per_rollout \| Lower is better \| ### Configuration harness codex Reasoning effort medium sourceVersion v1_1 subset extended ### Reported statistics flaggedRate 0.0013 sampleSize 150 ### Source [Original source](https://cognition.com/data/frontiercode-leaderboard/data.json) Source frontiercode Original model label GPT-5.6 Sol Observed 2026-10-21T16:31:00.878Z Evidence SHA-256 `ff0040778b7bdf69c705ad7474f771fb5e53cfaf5cf8573b3a4614153543d75f` Source locator `/v1_1/data/GPT-5.6%20Sol/medium/extended` |  |  |  |  |  |  |  |
| [DesignArena UI component generation](https://benchize.com/benchmarks/designarena%3Aui-components.md) | 1,326elo | — | 14 / 112 | — | — | [designarena · public](https://www.designarena.ai/api/leaderboard#board=ui-components) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 1326 \| elo \| ui-components \| Higher is better \| ### Configuration arenaType models category uicomponent inputModality Not reported Reasoning effort medium sourceModelVersion gpt-5.6-sol thinkingEnabled true variationName public ### Reported statistics averageGenerationTimeMs 109943 battles 1941 losses 812 standardError Not reported winRate 58.2 wins 1129 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=ui-components) Source designarena Original model label GPT-5.6 Sol (Medium) Source version public Observed 2026-10-21T16:37:57.993Z Evidence SHA-256 `46482ec1b4012638eace65493daea4750e2088098018fd9d5fc46126fc1f8557` Source locator `/data/15` |  |  |  |  |  |  |  |
| [AutomationBench](https://benchize.com/benchmarks/zapier%3Aautomationbench.md) | 19.63% | — | 41 / 113 | $0.57 | — | [zapier](https://framerusercontent.com/sites/4WTSl4BNjd1q9QFEFibC6h/lOvLnhItj8S8-1vyjH_s33Jn-WmUXPmiJ5Diajl0Q38.CMutaHYl.mjs) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 19.63 \| percent \| reported \| Higher is better \| \| `cost` \| 0.57 \| USD \| per_task \| Lower is better \| ### Configuration benchmarkVersion 1.0.6 costFootnote false Fallback policy Not reported Reasoning effort medium Model configuration GPT-5.6 Sol (Medium) thinkingEnabled true ### Reported statistics rank 41 ### Source [Original source](https://framerusercontent.com/sites/4WTSl4BNjd1q9QFEFibC6h/lOvLnhItj8S8-1vyjH_s33Jn-WmUXPmiJ5Diajl0Q38.CMutaHYl.mjs) Source zapier Original model label GPT-5.6 Sol (Medium) Observed 2026-10-21T16:34:56.783Z Evidence SHA-256 `43978e38f018789fa59c11de5328abe9e5905bfa9a5a4d601fa3aa4d9c153b0d` Source locator `/rows/40` |  |  |  |  |  |  |  |
| [DesignArena Browser game generation](https://benchize.com/benchmarks/designarena%3Agame-dev.md) | 1,325elo | — | 15 / 117 | — | — | [designarena · public](https://www.designarena.ai/api/leaderboard#board=game-dev) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 1325 \| elo \| game-dev \| Higher is better \| ### Configuration arenaType models category gamedev inputModality Not reported Reasoning effort medium sourceModelVersion gpt-5.6-sol thinkingEnabled true variationName public ### Reported statistics averageGenerationTimeMs 135771 battles 5416 losses 2261 standardError Not reported winRate 58.3 wins 3155 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=game-dev) Source designarena Original model label GPT-5.6 Sol (Medium) Source version public Observed 2026-10-21T16:38:01.100Z Evidence SHA-256 `53db6a89112ce8cdf644568c666d4b8309aece764cfcedb291ffd52ae3934e30` Source locator `/data/16` |  |  |  |  |  |  |  |
| [ARC-AGI-2](https://benchize.com/benchmarks/arc-prize%3Av2_Semi_Private.md) | 67.08% | — | 64 / 243 | 0.47usd per task | — | [arc prize · v2](https://arcprize.org/media/data/leaderboard/v2.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.6708 \| score_fraction \| v2_Semi_Private \| Higher is better \| \| `cost_per_task` \| 0.47 \| usd_per_task \| v2_Semi_Private \| Lower is better \| ### Configuration evaluationSplit v2_Semi_Private harness Not reported modelGroup openai-gpt-5-6-sol modelType CoT Reasoning effort medium sourceModelVersion openai-gpt-5-6-sol-medium thinkingEnabled true ### Source [Original source](https://arcprize.org/media/data/leaderboard/v2.json) Source arc prize Original model label GPT-5.6 Sol (Medium) Source version v2 Observed 2026-10-22T05:20:04.306Z Evidence SHA-256 `4351eb696e78113b0459e9bb5f0258318b905efef34f473dcea51ce641b0d94d` Source locator `/evaluations/156` |  |  |  |  |  |  |  |
| [ARC-AGI-1](https://benchize.com/benchmarks/arc-prize%3Av1_Semi_Private.md) | 92.5% | — | 52 / 245 | 0.22usd per task | — | [arc prize · v1](https://arcprize.org/media/data/leaderboard/v1.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.925 \| score_fraction \| v1_Semi_Private \| Higher is better \| \| `cost_per_task` \| 0.22 \| usd_per_task \| v1_Semi_Private \| Lower is better \| ### Configuration evaluationSplit v1_Semi_Private harness Not reported modelGroup openai-gpt-5-6-sol modelType CoT Reasoning effort medium sourceModelVersion openai-gpt-5-6-sol-medium thinkingEnabled true ### Source [Original source](https://arcprize.org/media/data/leaderboard/v1.json) Source arc prize Original model label GPT-5.6 Sol (Medium) Source version v1 Observed 2026-10-22T05:20:04.066Z Evidence SHA-256 `2bf68d22dafba37047d07ad833ebc0e8199c9aa2f9eeaed50c75c1b704462836` Source locator `/evaluations/155` |  |  |  |  |  |  |  |
| [DesignArena Native Android development](https://benchize.com/benchmarks/designarena%3Aandroid.md) | 1,156elo | — | 17 / 23 | — | — | [designarena · public](https://www.designarena.ai/api/leaderboard#board=android) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 1156 \| elo \| android \| Higher is better \| ### Configuration arenaType agents category nativeapps inputModality Not reported Reasoning effort medium sourceModelVersion gpt-5.6-sol thinkingEnabled true variationName public ### Reported statistics averageGenerationTimeMs Not reported battles 361 losses 186 standardError Not reported winRate 48.5 wins 175 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=android) Source designarena Original model label GPT-5.6 Sol (Medium) Source version public Observed 2026-10-21T16:38:03.000Z Evidence SHA-256 `d9d0cd4bea54b696c28f907a98ba42ebf8dd4da9da201b6c70c95f76de35f525` Source locator `/data/23` |  |  |  |  |  |  |  |
| [DesignArena Godot game development](https://benchize.com/benchmarks/designarena%3Agodot-game-dev.md) | 1,234elo | SE ±10 | 8 / 14 | — | — | [designarena · public](https://www.designarena.ai/api/leaderboard#board=godot-game-dev) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 1234 \| elo \| godot-game-dev \| Higher is better \| ### Configuration arenaType agents category agon_godot inputModality Not reported Reasoning effort medium sourceModelVersion gpt-5.6-sol thinkingEnabled true variationName public ### Reported statistics Uncertainty Standard error: ±10 averageGenerationTimeMs Not reported battles 1643 losses 626 standardError 9.9985 winRate 61.9 wins 1017 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=godot-game-dev) Source designarena Original model label GPT-5.6 Sol (Medium) Source version public Observed 2026-10-21T16:38:02.075Z Evidence SHA-256 `0aad65341ae5287f97ba93448674c557edad76a4e41056ec30cc32bf05d3a7e3` Source locator `/data/9` |  |  |  |  |  |  |  |
| [DesignArena 3D design generation](https://benchize.com/benchmarks/designarena%3A3d-design.md) | 1,314elo | — | 19 / 110 | — | — | [designarena · public](https://www.designarena.ai/api/leaderboard#board=3d-design) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 1314 \| elo \| 3d-design \| Higher is better \| ### Configuration arenaType models category 3d inputModality Not reported Reasoning effort medium sourceModelVersion gpt-5.6-sol thinkingEnabled true variationName public ### Reported statistics averageGenerationTimeMs 113408 battles 6372 losses 2684 standardError Not reported winRate 57.9 wins 3688 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=3d-design) Source designarena Original model label GPT-5.6 Sol (Medium) Source version public Observed 2026-10-21T16:37:58.515Z Evidence SHA-256 `bcc0267f7bc7e9ec112306b3a35413cf78bbccbfaa838356232d5d5ed0b83d0f` Source locator `/data/23` |  |  |  |  |  |  |  |
| [DesignArena ASCII art generation](https://benchize.com/benchmarks/designarena%3Aascii.md) | 1,259elo | — | 16 / 65 | — | — | [designarena · public](https://www.designarena.ai/api/leaderboard#board=ascii) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 1259 \| elo \| ascii \| Higher is better \| ### Configuration arenaType models category ascii inputModality Not reported Reasoning effort medium sourceModelVersion gpt-5.6-sol thinkingEnabled true variationName public ### Reported statistics averageGenerationTimeMs 42808 battles 332 losses 142 standardError Not reported winRate 57.2 wins 190 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=ascii) Source designarena Original model label GPT-5.6 Sol (Medium) Source version public Observed 2026-10-21T16:38:03.513Z Evidence SHA-256 `0603b8c65b44ee887f5b566feb469465f59635137a6ac5c6d94c23bcf3776311` Source locator `/data/17` |  |  |  |  |  |  |  |
| [ARC-AGI-3](https://benchize.com/benchmarks/arc-prize%3Av3_Semi_Private.md) | 1.07% | — | 30 / 65 | 12,971.17usd | — | [arc prize · v3](https://arcprize.org/media/data/leaderboard/v3.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.0107 \| score_fraction \| v3_Semi_Private \| Higher is better \| \| `total_cost` \| 12971.17 \| usd \| v3_Semi_Private \| Lower is better \| ### Configuration evaluationSplit v3_Semi_Private harness standard modelGroup openai-gpt-5-6-sol modelType CoT Reasoning effort medium sourceModelVersion openai-gpt-5-6-sol-medium thinkingEnabled true ### Source [Original source](https://arcprize.org/media/data/leaderboard/v3.json) Source arc prize Original model label GPT-5.6 Sol (Medium) Source version v3 Observed 2026-10-22T05:20:04.578Z Evidence SHA-256 `3ce335487296bb2dcf4ba9546c5a2a02b1907db5b08887cd9ff4429fed824916` Source locator `/evaluations/8` |  |  |  |  |  |  |  |

---
Cite as: GPT-5.6 SolMedium — Benchize, https://benchize.com/models/gpt-5-6-sol-medium (retrieved 2026-10-22)