# GPT-6 SolMedium

> Source: Benchize (https://benchize.com) — https://benchize.com/models/gpt-6-sol-medium. When citing or reusing this content, credit "Benchize" and link to https://benchize.com/models/gpt-6-sol-medium.

OpenAI

Canonical URL: https://benchize.com/models/gpt-6-sol-medium
Last updated: Wed, 21 Oct 2026 18:52:20 GMT

Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations.

OpenAI

## Benchmarks

| Benchmark | Score | ± | Rank | Cost | Source |  |
| --- | --- | --- | --- | --- | --- | --- |
| [ARC-AGI-3](https://benchize.com/benchmarks/arc-prize%3Av3_Semi_Private.md) | 0.42% | — | 34 / 53 | 4,863.8usd | [arc prize · v3](https://arcprize.org/media/data/leaderboard/v3.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.00418612306617149 \| score_fraction \| v3_Semi_Private \| Higher is better \| \| `total_cost` \| 4863.795116 \| usd \| v3_Semi_Private \| Lower is better \| ### Configuration evaluationSplit v3_Semi_Private harness standard modelGroup openai-gpt-6-sol modelType CoT Reasoning effort medium sourceModelVersion openai-gpt-6-sol-medium thinkingEnabled true ### Source [Original source](https://arcprize.org/media/data/leaderboard/v3.json) Source arc prize Original model label GPT-6 Sol (Medium) Source version v3 Observed 2026-10-21T16:34:21.112Z Evidence SHA-256 `1aaee2199f8c6d9b5a589aab2fd2480a729e9132f8cf8fbf7b49f81dbd5b2c49` Source locator `/evaluations/60` |  |  |  |  |  |  |
| [ARC-AGI-1](https://benchize.com/benchmarks/arc-prize%3Av1_Semi_Private.md) | 83.67% | — | 89 / 213 | 0.07usd per task | [arc prize · v1](https://arcprize.org/media/data/leaderboard/v1.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.8366666666666666 \| score_fraction \| v1_Semi_Private \| Higher is better \| \| `cost_per_task` \| 0.06730014000000002 \| usd_per_task \| v1_Semi_Private \| Lower is better \| ### Configuration evaluationSplit v1_Semi_Private harness Not reported modelGroup openai-gpt-6-sol modelType CoT Reasoning effort medium sourceModelVersion openai-gpt-6-sol-medium thinkingEnabled true ### Source [Original source](https://arcprize.org/media/data/leaderboard/v1.json) Source arc prize Original model label GPT-6 Sol (Medium) Source version v1 Observed 2026-10-21T16:34:20.378Z Evidence SHA-256 `302d8267c0522bf450ec1deeac4d060e2cf2fb444ba0a4269014d9535de0bd1f` Source locator `/evaluations/247` |  |  |  |  |  |  |
| [ToneBench Scriptwriting](https://benchize.com/benchmarks/tonebench%3Ascripts.md) | 2,203.8 | Range 2,164.4–2,249.9 | 14 / 126 | — | [tonebench](https://benchmark.towardsai.com/data/leaderboard.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 2203.8 \| rating \| reported \| Higher is better \| \| `overall` \| 82.51 \| percent \| reported \| Higher is better \| \| `anti_slop_numbers` \| 81.06 \| source_score \| rubric \| Higher is better \| \| `continuity_emotion` \| 81.86 \| source_score \| rubric \| Higher is better \| \| `cue_quality` \| 78.19 \| source_score \| rubric \| Higher is better \| \| `hook_strength` \| 82.65 \| source_score \| rubric \| Higher is better \| \| `length_adherence` \| 88.11 \| source_score \| rubric \| Higher is better \| \| `slop` \| 89.01 \| source_score \| rubric \| Higher is better \| \| `slop_score` \| 96.97 \| source_score \| rubric \| Higher is better \| \| `substance_accuracy` \| 86.19 \| source_score \| rubric \| Higher is better \| \| `tone_voice` \| 80.14 \| source_score \| rubric \| Higher is better \| \| `writing_quality` \| 80.58 \| source_score \| rubric \| Higher is better \| \| `youtube_best_practices` \| 79.35 \| source_score \| rubric \| Higher is better \| ### Configuration provider codex Reasoning effort unknown scoreScope 10_task_current sourceConfiguration gpt-6-sol thinkingEnabled true ### Reported statistics Uncertainty Reported interval: 2,164.4–2,249.9 interval [2164.4,2249.9] rank 14 runCount 5 ### Source [Original source](https://benchmark.towardsai.com/data/leaderboard.json) Source tonebench Original model label GPT-6 Sol (medium) Evaluated 2026-10-11 Observed 2026-10-21T16:32:48.862Z Evidence SHA-256 `4264338337f418d3ded7ace250cad64fe12cacbd4b79a312bfaf0ae9268a01c3` Source locator `/rows/13` |  |  |  |  |  |  |
| [NC Bench](https://benchize.com/benchmarks/nc-bench%3Aoverall.md) | 92.63% | — | 29 / 144 | — | [nc bench](https://www.nc-bench.com/models) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 92.63 \| percent \| reported \| Higher is better \| \| `tooling` \| 99.95 \| percent \| category \| Higher is better \| \| `creative_writing` \| 91.4 \| percent \| category \| Higher is better \| \| `language` \| 100 \| percent \| category \| Higher is better \| \| `utility` \| 91.07 \| percent \| category \| Higher is better \| \| `reasoning` \| 96.65 \| percent \| category \| Higher is better \| \| `text_editing` \| 98.37 \| percent \| category \| Higher is better \| \| `rule_following` \| 69.71 \| percent \| category \| Higher is better \| \| `hallucination` \| 93.91 \| percent \| category \| Higher is better \| ### Configuration Reasoning effort medium Model configuration GPT-6 Sol (Reasoning, Medium) thinkingEnabled true ### Source [Original source](https://www.nc-bench.com/models) Source nc bench Original model label GPT-6 Sol (Reasoning, Medium) Observed 2026-10-21T16:31:48.370Z Evidence SHA-256 `ec261022458543624b08a136d01f5a2f0666cd52ffb49c64d6ca983e8543d1b5` Source locator `/rows/36` |  |  |  |  |  |  |
| [ARC-AGI-2](https://benchize.com/benchmarks/arc-prize%3Av2_Semi_Private.md) | 57.78% | — | 75 / 212 | 0.15usd per task | [arc prize · v2](https://arcprize.org/media/data/leaderboard/v2.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.5777777777777778 \| score_fraction \| v2_Semi_Private \| Higher is better \| \| `cost_per_task` \| 0.14762708333333335 \| usd_per_task \| v2_Semi_Private \| Lower is better \| ### Configuration evaluationSplit v2_Semi_Private harness Not reported modelGroup openai-gpt-6-sol modelType CoT Reasoning effort medium sourceModelVersion openai-gpt-6-sol-medium thinkingEnabled true ### Source [Original source](https://arcprize.org/media/data/leaderboard/v2.json) Source arc prize Original model label GPT-6 Sol (Medium) Source version v2 Observed 2026-10-21T16:34:20.750Z Evidence SHA-256 `bca68e12cc9a01954ae21b641844c1ecbabe146cb24b87f0f8e9b1db27433c29` Source locator `/evaluations/250` |  |  |  |  |  |  |
| [FrontierCode 1.1 extended](https://benchize.com/benchmarks/frontiercode%3Av1_1%3Aextended.md) | 57.11% | — | 49 / 125 | $0.66 | [frontiercode](https://cognition.com/data/frontiercode-leaderboard/data.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.5711 \| score_fraction \| blocking_criteria_adjusted \| Higher is better \| \| `correct` \| 0.6267 \| score_fraction \| raw_rubric \| Higher is better \| \| `cost` \| 0.6581 \| USD \| per_rollout \| Lower is better \| ### Configuration harness codex Reasoning effort medium sourceVersion v1_1 subset extended ### Reported statistics flaggedRate 0.0013 sampleSize 150 ### Source [Original source](https://cognition.com/data/frontiercode-leaderboard/data.json) Source frontiercode Original model label GPT-6 Sol Observed 2026-10-21T16:31:00.878Z Evidence SHA-256 `ff0040778b7bdf69c705ad7474f771fb5e53cfaf5cf8573b3a4614153543d75f` Source locator `/v1_1/data/GPT-6%20Sol/medium/extended` |  |  |  |  |  |  |
| [AutomationBench](https://benchize.com/benchmarks/zapier%3Aautomationbench.md) | 26.9% | — | 24 / 113 | $0.21 | [zapier](https://framerusercontent.com/sites/4WTSl4BNjd1q9QFEFibC6h/lOvLnhItj8S8-1vyjH_s33Jn-WmUXPmiJ5Diajl0Q38.CMutaHYl.mjs) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 26.9 \| percent \| reported \| Higher is better \| \| `cost` \| 0.21 \| USD \| per_task \| Lower is better \| ### Configuration benchmarkVersion 1.0.6 costFootnote false Fallback policy Not reported Reasoning effort medium Model configuration GPT-6 Sol (Medium) thinkingEnabled true ### Reported statistics rank 24 ### Source [Original source](https://framerusercontent.com/sites/4WTSl4BNjd1q9QFEFibC6h/lOvLnhItj8S8-1vyjH_s33Jn-WmUXPmiJ5Diajl0Q38.CMutaHYl.mjs) Source zapier Original model label GPT-6 Sol (Medium) Observed 2026-10-21T16:34:56.783Z Evidence SHA-256 `43978e38f018789fa59c11de5328abe9e5905bfa9a5a4d601fa3aa4d9c153b0d` Source locator `/rows/23` |  |  |  |  |  |  |
| [FrontierCode 1.1 main](https://benchize.com/benchmarks/frontiercode%3Av1_1%3Amain.md) | 45.92% | — | 42 / 125 | $0.77 | [frontiercode](https://cognition.com/data/frontiercode-leaderboard/data.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.4592 \| score_fraction \| blocking_criteria_adjusted \| Higher is better \| \| `correct` \| 0.508 \| score_fraction \| raw_rubric \| Higher is better \| \| `cost` \| 0.7659 \| USD \| per_rollout \| Lower is better \| ### Configuration harness codex Reasoning effort medium sourceVersion v1_1 subset main ### Reported statistics flaggedRate 0 sampleSize 100 ### Source [Original source](https://cognition.com/data/frontiercode-leaderboard/data.json) Source frontiercode Original model label GPT-6 Sol Observed 2026-10-21T16:31:00.878Z Evidence SHA-256 `ff0040778b7bdf69c705ad7474f771fb5e53cfaf5cf8573b3a4614153543d75f` Source locator `/v1_1/data/GPT-6%20Sol/medium/main` |  |  |  |  |  |  |

---
Cite as: GPT-6 SolMedium — Benchize, https://benchize.com/models/gpt-6-sol-medium (retrieved 2026-10-21)