# GPT-6 SolExtra high

> Source: Benchize (https://benchize.com) — https://benchize.com/models/gpt-6-sol-xhigh. When citing or reusing this content, credit "Benchize" and link to https://benchize.com/models/gpt-6-sol-xhigh.

OpenAI

Canonical URL: https://benchize.com/models/gpt-6-sol-xhigh
Last updated: Thu, 22 Oct 2026 04:30:12 GMT

Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations.

OpenAI

## Benchmarks

| Benchmark | Score | ± | Rank | Cost | Source |  |
| --- | --- | --- | --- | --- | --- | --- |
| [ARC-AGI-2](https://benchize.com/benchmarks/arc-prize%3Av2_Semi_Private.md) | 78.06% | — | 40 / 212 | 0.28usd per task | [arc prize · v2](https://arcprize.org/media/data/leaderboard/v2.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.7805555555555556 \| score_fraction \| v2_Semi_Private \| Higher is better \| \| `cost_per_task` \| 0.27722933333333344 \| usd_per_task \| v2_Semi_Private \| Lower is better \| ### Configuration evaluationSplit v2_Semi_Private harness Not reported modelGroup openai-gpt-6-sol modelType CoT Reasoning effort xhigh sourceModelVersion openai-gpt-6-sol-xhigh thinkingEnabled true ### Source [Original source](https://arcprize.org/media/data/leaderboard/v2.json) Source arc prize Original model label GPT-6 Sol (XHigh) Source version v2 Observed 2026-10-21T16:34:20.750Z Evidence SHA-256 `bca68e12cc9a01954ae21b641844c1ecbabe146cb24b87f0f8e9b1db27433c29` Source locator `/evaluations/248` |  |  |  |  |  |  |
| [ARC-AGI-1](https://benchize.com/benchmarks/arc-prize%3Av1_Semi_Private.md) | 92.67% | — | 46 / 213 | 0.1usd per task | [arc prize · v1](https://arcprize.org/media/data/leaderboard/v1.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.9266666666666665 \| score_fraction \| v1_Semi_Private \| Higher is better \| \| `cost_per_task` \| 0.10230234000000003 \| usd_per_task \| v1_Semi_Private \| Lower is better \| ### Configuration evaluationSplit v1_Semi_Private harness Not reported modelGroup openai-gpt-6-sol modelType CoT Reasoning effort xhigh sourceModelVersion openai-gpt-6-sol-xhigh thinkingEnabled true ### Source [Original source](https://arcprize.org/media/data/leaderboard/v1.json) Source arc prize Original model label GPT-6 Sol (XHigh) Source version v1 Observed 2026-10-21T16:34:20.378Z Evidence SHA-256 `302d8267c0522bf450ec1deeac4d060e2cf2fb444ba0a4269014d9535de0bd1f` Source locator `/evaluations/245` |  |  |  |  |  |  |
| [ARC-AGI-3](https://benchize.com/benchmarks/arc-prize%3Av3_Semi_Private.md) | 1.8% | — | 22 / 53 | 5,105.62usd | [arc prize · v3](https://arcprize.org/media/data/leaderboard/v3.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.017976269602783517 \| score_fraction \| v3_Semi_Private \| Higher is better \| \| `total_cost` \| 5105.623836 \| usd \| v3_Semi_Private \| Lower is better \| ### Configuration evaluationSplit v3_Semi_Private harness standard modelGroup openai-gpt-6-sol modelType CoT Reasoning effort xhigh sourceModelVersion openai-gpt-6-sol-xhigh thinkingEnabled true ### Source [Original source](https://arcprize.org/media/data/leaderboard/v3.json) Source arc prize Original model label GPT-6 Sol (XHigh) Source version v3 Observed 2026-10-21T16:34:21.112Z Evidence SHA-256 `1aaee2199f8c6d9b5a589aab2fd2480a729e9132f8cf8fbf7b49f81dbd5b2c49` Source locator `/evaluations/58` |  |  |  |  |  |  |
| [FrontierCode 1.1 extended](https://benchize.com/benchmarks/frontiercode%3Av1_1%3Aextended.md) | 59.13% | — | 39 / 125 | $1.11 | [frontiercode](https://cognition.com/data/frontiercode-leaderboard/data.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.5913 \| score_fraction \| blocking_criteria_adjusted \| Higher is better \| \| `correct` \| 0.6476 \| score_fraction \| raw_rubric \| Higher is better \| \| `cost` \| 1.1054 \| USD \| per_rollout \| Lower is better \| ### Configuration harness codex Reasoning effort xhigh sourceVersion v1_1 subset extended ### Reported statistics flaggedRate 0.0013 sampleSize 150 ### Source [Original source](https://cognition.com/data/frontiercode-leaderboard/data.json) Source frontiercode Original model label GPT-6 Sol Observed 2026-10-21T16:31:00.878Z Evidence SHA-256 `ff0040778b7bdf69c705ad7474f771fb5e53cfaf5cf8573b3a4614153543d75f` Source locator `/v1_1/data/GPT-6%20Sol/xhigh/extended` |  |  |  |  |  |  |
| [FrontierCode 1.1 main](https://benchize.com/benchmarks/frontiercode%3Av1_1%3Amain.md) | 48.45% | — | 24 / 125 | $1.33 | [frontiercode](https://cognition.com/data/frontiercode-leaderboard/data.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.4845 \| score_fraction \| blocking_criteria_adjusted \| Higher is better \| \| `correct` \| 0.5353 \| score_fraction \| raw_rubric \| Higher is better \| \| `cost` \| 1.325 \| USD \| per_rollout \| Lower is better \| ### Configuration harness codex Reasoning effort xhigh sourceVersion v1_1 subset main ### Reported statistics flaggedRate 0.002 sampleSize 100 ### Source [Original source](https://cognition.com/data/frontiercode-leaderboard/data.json) Source frontiercode Original model label GPT-6 Sol Observed 2026-10-21T16:31:00.878Z Evidence SHA-256 `ff0040778b7bdf69c705ad7474f771fb5e53cfaf5cf8573b3a4614153543d75f` Source locator `/v1_1/data/GPT-6%20Sol/xhigh/main` |  |  |  |  |  |  |
| [TapTap Maker heldout](https://benchize.com/benchmarks/taptap-maker%3Aheldout.md) | 59.85% | Range 57.95–60.8% | 12 / 26 | — | [taptap maker](https://maker.taptap.cn/leaderboard/data/editions/2026-10-18-v6-voxel.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `l2_pass_rate` \| 0.5985 \| score_fraction \| reported \| Higher is better \| ### Configuration datasetVersion 0.2.3 edition 2026-10-18-v6-voxel harness codex Reasoning effort xhigh reasoningMode Not reported ### Reported statistics Uncertainty Reported interval: 57.95–60.8% interval [0.5795,0.608] intervalMethod bootstrap-case rank 14 rankInterval [12,18] ### Source [Original source](https://maker.taptap.cn/leaderboard/data/editions/2026-10-18-v6-voxel.json) Source taptap maker Original model label gpt-6-sol Observed 2026-10-21T16:33:19.620Z Evidence SHA-256 `ad2d7f1adeae0548a4edc0b5e75d11449b443449ff76533d04bc1fb1b6d7035e` Source locator `/heldout/13` |  |  |  |  |  |  |
| [AutomationBench](https://benchize.com/benchmarks/zapier%3Aautomationbench.md) | 33.2% | — | 11 / 113 | $0.27 | [zapier](https://framerusercontent.com/sites/4WTSl4BNjd1q9QFEFibC6h/lOvLnhItj8S8-1vyjH_s33Jn-WmUXPmiJ5Diajl0Q38.CMutaHYl.mjs) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 33.2 \| percent \| reported \| Higher is better \| \| `cost` \| 0.27 \| USD \| per_task \| Lower is better \| ### Configuration benchmarkVersion 1.0.6 costFootnote false Fallback policy Not reported Reasoning effort xhigh Model configuration GPT-6 Sol (XHigh) thinkingEnabled true ### Reported statistics rank 11 ### Source [Original source](https://framerusercontent.com/sites/4WTSl4BNjd1q9QFEFibC6h/lOvLnhItj8S8-1vyjH_s33Jn-WmUXPmiJ5Diajl0Q38.CMutaHYl.mjs) Source zapier Original model label GPT-6 Sol (XHigh) Observed 2026-10-21T16:34:56.783Z Evidence SHA-256 `43978e38f018789fa59c11de5328abe9e5905bfa9a5a4d601fa3aa4d9c153b0d` Source locator `/rows/10` |  |  |  |  |  |  |
| [WeirdML v3](https://benchize.com/benchmarks/weirdml%3Av3.md) | 0.2source score | Range 0.18–0.21 | 7 / 25 | — | [weirdml · b0120fe](https://htihle.github.io/assets/data/weirdml_v3.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.19731756666666667 \| source_score \| reported \| Higher is better \| \| `mean_final_best` \| 0.2756275515151515 \| source_score \| reported \| Higher is better \| ### Configuration budget {"kind":"equivalent_tokens","limit":50000000,"start":500000} harness codex_cli Reasoning effort xhigh sourceConfiguration gpt-6-sol-xhigh-openrouter thinkingEnabled true ### Reported statistics Uncertainty Reported interval: 0.18–0.21 interval [0.18457978225590307,0.2104417912765551] intervalMethod {"assumptions":"Independent fresh runs; approximately normal scores; shared variance prior. Pool fitted within analysis mode, including incomplete models; pool estimation uncertainty is not propagated.","confidence":0.95,"draws":10000,"fixed_tasks":true,"method":"partially_pooled_variance","pool":{"degrees_of_freedom":1533,"fallback":false,"prior_df":4,"variance":0.0026383113392869583},"seed":20260915,"unit":"run"} runCount 76 taskCount 11 ### Source [Original source](https://htihle.github.io/assets/data/weirdml_v3.json) Source weirdml Original model label GPT-6 Sol (xhigh) Source version b0120fe Observed 2026-10-21T16:33:04.394Z Evidence SHA-256 `82c3a8de423b23ca0af9761429299a2f21edb0b819e947fdc863f8b5ea4a49b8` Source locator `/rows/6` |  |  |  |  |  |  |
| [TapTap Maker public](https://benchize.com/benchmarks/taptap-maker%3Apublic.md) | 76.78% | Range 75.39–78.17% | 11 / 26 | $1.01 | [taptap maker](https://maker.taptap.cn/leaderboard/data/editions/2026-10-18-v6-voxel.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `l2_pass_rate` \| 0.7678 \| score_fraction \| reported \| Higher is better \| \| `cost_per_case` \| 1.0064 \| USD \| per_case \| Lower is better \| ### Configuration datasetVersion 0.2.3 edition 2026-10-18-v6-voxel harness codex Reasoning effort xhigh reasoningMode model-managed ### Reported statistics Uncertainty Reported interval: 75.39–78.17% interval [0.7539,0.7817] intervalMethod bootstrap-case rank 12 rankInterval [11,21] ### Source [Original source](https://maker.taptap.cn/leaderboard/data/editions/2026-10-18-v6-voxel.json) Source taptap maker Original model label gpt-6-sol Observed 2026-10-21T16:33:19.620Z Evidence SHA-256 `ad2d7f1adeae0548a4edc0b5e75d11449b443449ff76533d04bc1fb1b6d7035e` Source locator `/public/11` |  |  |  |  |  |  |

---
Cite as: GPT-6 SolExtra high — Benchize, https://benchize.com/models/gpt-6-sol-xhigh (retrieved 2026-10-22)