# GPT-5.6 SolLow > Source: Benchize (https://benchize.com) — https://benchize.com/models/gpt-5-6-sol-low. When citing or reusing this content, credit "Benchize" and link to https://benchize.com/models/gpt-5-6-sol-low. OpenAI Canonical URL: https://benchize.com/models/gpt-5-6-sol-low Last updated: Thu, 22 Oct 2026 06:30:09 GMT Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations. OpenAI ## Benchmarks | Benchmark | Score | ± | Rank | Cost | Latency | Source | | | --- | --- | --- | --- | --- | --- | --- | --- | | [Mystery Game Puzzles](https://benchize.com/benchmarks/epoch-ai%3Amystery_game_puzzles.md) | 26% | SE ±4.41 pp | 33 / 72 | — | — | [epoch ai · Mystery Game Puzzles](https://epoch.ai/data/benchmark_data.zip#file=mystery_game_puzzles.csv) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.26 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.26 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion Mystery Game Puzzles reasoningBudget Not reported Reasoning effort low sourceModelVersion gpt-5.6-sol_low ### Reported statistics Uncertainty Standard error: ±4.41 pp standardError 0.04408440022768081 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=mystery_game_puzzles.csv) Source epoch ai Original model label gpt-5.6-sol Source version Mystery Game Puzzles Evaluated 2026-08-27T19:17:45.000Z Observed 2026-10-22T03:00:05.281Z Evidence SHA-256 `f66941ed5e9520190b66af57d2b6fd62a9582077dd25ab8764ce651bc0eca00a` Source locator `/rows/35` | | | | | | | | | [BullshitBench v2](https://benchize.com/benchmarks/bullshitbench%3Av2.md) | 48% | — | 69 / 191 | — | — | [bullshitbench · v2](https://api.github.com/repos/petergpt/bullshit-benchmark/contents/data/v2/latest/leaderboard.csv?ref=3c655234d15967738f95da696e3f938d4862dcf7) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `green_rate` \| 0.48 \| score_fraction \| all_attempts \| Higher is better \| \| `red_rate` \| 0.14 \| score_fraction \| all_attempts \| Lower is better \| \| `refusal_rate` \| 0.0 \| score_fraction \| all_attempts \| Lower is better \| \| `avg_score` \| 1.3 \| score \| judge_grade_0_to_2 \| Higher is better \| ### Configuration Reasoning effort low suite v2 thinkingEnabled true ### Reported statistics acceptedCount 14 answeredCount 100 clearCount 48 errorCount 0 partialCount 38 rank 78 refusalCount 0 sampleSize 100 ### Source [Original source](https://api.github.com/repos/petergpt/bullshit-benchmark/contents/data/v2/latest/leaderboard.csv?ref=3c655234d15967738f95da696e3f938d4862dcf7) Source bullshitbench Original model label openai/gpt-5.6-sol Source version v2 Observed 2026-10-22T03:10:12.603Z Evidence SHA-256 `98b485e08764d1c97144bc4f7b28ced1a96d50850947c775870dfda0e5d749b5` Source locator `/rows/77` | | | | | | | | | [ARC-AGI-2](https://benchize.com/benchmarks/arc-prize%3Av2_Semi_Private.md) | 42.5% | — | 105 / 243 | 0.32usd per task | — | [arc prize · v2](https://arcprize.org/media/data/leaderboard/v2.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.425 \| score_fraction \| v2_Semi_Private \| Higher is better \| \| `cost_per_task` \| 0.32 \| usd_per_task \| v2_Semi_Private \| Lower is better \| ### Configuration evaluationSplit v2_Semi_Private harness Not reported modelGroup openai-gpt-5-6-sol modelType CoT Reasoning effort low sourceModelVersion openai-gpt-5-6-sol-low thinkingEnabled true ### Source [Original source](https://arcprize.org/media/data/leaderboard/v2.json) Source arc prize Original model label GPT-5.6 Sol (Low) Source version v2 Observed 2026-10-22T05:20:04.306Z Evidence SHA-256 `4351eb696e78113b0459e9bb5f0258318b905efef34f473dcea51ce641b0d94d` Source locator `/evaluations/155` | | | | | | | | | [OTIS Mock AIME 2024–2025](https://benchize.com/benchmarks/epoch-ai%3Aotis_mock_aime_2024_2025.md) | 95.56% | SE ±3.11 pp | 29 / 124 | — | — | [epoch ai · OTIS Mock AIME 2024-2025](https://epoch.ai/data/benchmark_data.zip#file=otis_mock_aime_2024_2025.csv) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.9555555555555556 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.9555555555555556 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion OTIS Mock AIME 2024-2025 reasoningBudget Not reported Reasoning effort low sourceModelVersion gpt-5.6-sol_low ### Reported statistics Uncertainty Standard error: ±3.11 pp standardError 0.031067790907534736 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=otis_mock_aime_2024_2025.csv) Source epoch ai Original model label gpt-5.6-sol Source version OTIS Mock AIME 2024-2025 Evaluated 2026-08-07T00:42:21.000Z Observed 2026-10-22T03:00:05.281Z Evidence SHA-256 `b7c9da8c0587c82f1e0d814ceb496c24308380b997a16203b6e5d39eb07f4f50` Source locator `/rows/86` | | | | | | | | | [ARC-AGI-1](https://benchize.com/benchmarks/arc-prize%3Av1_Semi_Private.md) | 74.5% | — | 125 / 245 | 0.17usd per task | — | [arc prize · v1](https://arcprize.org/media/data/leaderboard/v1.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.745 \| score_fraction \| v1_Semi_Private \| Higher is better \| \| `cost_per_task` \| 0.17 \| usd_per_task \| v1_Semi_Private \| Lower is better \| ### Configuration evaluationSplit v1_Semi_Private harness Not reported modelGroup openai-gpt-5-6-sol modelType CoT Reasoning effort low sourceModelVersion openai-gpt-5-6-sol-low thinkingEnabled true ### Source [Original source](https://arcprize.org/media/data/leaderboard/v1.json) Source arc prize Original model label GPT-5.6 Sol (Low) Source version v1 Observed 2026-10-22T05:20:04.066Z Evidence SHA-256 `2bf68d22dafba37047d07ad833ebc0e8199c9aa2f9eeaed50c75c1b704462836` Source locator `/evaluations/154` | | | | | | | | | [ARC-AGI-3](https://benchize.com/benchmarks/arc-prize%3Av3_Semi_Private.md) | 0.33% | — | 45 / 65 | 12,805.6usd | — | [arc prize · v3](https://arcprize.org/media/data/leaderboard/v3.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.0033 \| score_fraction \| v3_Semi_Private \| Higher is better \| \| `total_cost` \| 12805.6 \| usd \| v3_Semi_Private \| Lower is better \| ### Configuration evaluationSplit v3_Semi_Private harness standard modelGroup openai-gpt-5-6-sol modelType CoT Reasoning effort low sourceModelVersion openai-gpt-5-6-sol-low thinkingEnabled true ### Source [Original source](https://arcprize.org/media/data/leaderboard/v3.json) Source arc prize Original model label GPT-5.6 Sol (Low) Source version v3 Observed 2026-10-22T05:20:04.578Z Evidence SHA-256 `3ce335487296bb2dcf4ba9546c5a2a02b1907db5b08887cd9ff4429fed824916` Source locator `/evaluations/7` | | | | | | | | | [AutomationBench](https://benchize.com/benchmarks/zapier%3Aautomationbench.md) | 11.72% | — | 61 / 113 | $0.42 | — | [zapier](https://framerusercontent.com/sites/4WTSl4BNjd1q9QFEFibC6h/lOvLnhItj8S8-1vyjH_s33Jn-WmUXPmiJ5Diajl0Q38.CMutaHYl.mjs) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 11.72 \| percent \| reported \| Higher is better \| \| `cost` \| 0.42 \| USD \| per_task \| Lower is better \| ### Configuration benchmarkVersion 1.0.6 costFootnote false Fallback policy Not reported Reasoning effort low Model configuration GPT-5.6 Sol (Low) thinkingEnabled true ### Reported statistics rank 69 ### Source [Original source](https://framerusercontent.com/sites/4WTSl4BNjd1q9QFEFibC6h/lOvLnhItj8S8-1vyjH_s33Jn-WmUXPmiJ5Diajl0Q38.CMutaHYl.mjs) Source zapier Original model label GPT-5.6 Sol (Low) Observed 2026-10-21T16:34:56.783Z Evidence SHA-256 `43978e38f018789fa59c11de5328abe9e5905bfa9a5a4d601fa3aa4d9c153b0d` Source locator `/rows/68` | | | | | | | | | [Chess Puzzles](https://benchize.com/benchmarks/epoch-ai%3Achess_puzzles.md) | 31% | SE ±4.65 pp | 37 / 64 | — | — | [epoch ai · Chess Puzzles](https://epoch.ai/data/benchmark_data.zip#file=chess_puzzles.csv) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.31 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.31 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion Chess Puzzles reasoningBudget Not reported Reasoning effort low sourceModelVersion gpt-5.6-sol_low ### Reported statistics Uncertainty Standard error: ±4.65 pp standardError 0.04648231987117317 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=chess_puzzles.csv) Source epoch ai Original model label gpt-5.6-sol Source version Chess Puzzles Evaluated 2026-10-13T13:49:48.000Z Observed 2026-10-22T03:00:05.281Z Evidence SHA-256 `a5b99d6d35252907b04e9a802873a9754ecc0248be92a1ebbd2ef0450e4bb015` Source locator `/rows/78` | | | | | | | | | [DeepSWE](https://benchize.com/benchmarks/deepswe%3Av1.1.md) | 45.35% | Range 42.97–47.74% | 54 / 70 | $1.07 | 262.25s | [deepswe](https://deepswe.datacurve.ai/artifacts/v1.1/leaderboard-live.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `pass_at_1` \| 0.45353982300884954 \| score_fraction \| scored_rollout_attempts \| Higher is better \| \| `pass_at_4` \| 0.7168141592920354 \| score_fraction \| tasks_with_one_passing_rollout \| Higher is better \| \| `cost_per_attempt` \| 1.0742664646017699 \| USD \| scored_attempt \| Lower is better \| \| `duration` \| 262.2510164579646 \| seconds \| scored_attempt \| Lower is better \| ### Configuration harness mini-swe-agent Reasoning effort low sourceConfiguration mini_swe_agent_gpt_5_6_sol_low ### Reported statistics Uncertainty Reported interval: 42.97–47.74% interval [0.42965787629426033,0.47742176972343875] intervalMethod 95% run-to-run: SE across repeated whole-benchmark passes (1.96 * std(runs)/sqrt(R)) runCount 4 sampleSize 452 taskCount 113 ### Source [Original source](https://deepswe.datacurve.ai/artifacts/v1.1/leaderboard-live.json) Source deepswe Original model label gpt-5-6-sol Observed 2026-10-22T03:50:05.889Z Evidence SHA-256 `a7c15d66288fd249c020b9931c017b92d1a3b90e480b3ff34974b752bd030019` Source locator `/rows/53` | | | | | | | | | [GPQA Diamond](https://benchize.com/benchmarks/gpqa-diamond.md) | 89.9% | SE ±2.15 pp | 30 / 126 | — | — | [epoch ai · GPQA diamond](https://epoch.ai/data/benchmark_data.zip#file=gpqa_diamond.csv) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.898989898989899 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.898989898989899 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion GPQA diamond reasoningBudget Not reported Reasoning effort low sourceModelVersion gpt-5.6-sol_low ### Reported statistics Uncertainty Standard error: ±2.15 pp standardError 0.021469735576055356 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=gpqa_diamond.csv) Source epoch ai Original model label gpt-5.6-sol Source version GPQA diamond Evaluated 2026-08-07T00:46:32.000Z Observed 2026-10-22T03:00:05.281Z Evidence SHA-256 `9ef0b938bdd8406b029d595983ee8ad3a80bd9d64b82605b91b5ce39ba650c39` Source locator `/rows/78` | | | | | | | | | [FrontierCode 1.1 main](https://benchize.com/benchmarks/frontiercode%3Av1_1%3Amain.md) | 35.44% | — | 88 / 125 | $1.89 | — | [frontiercode](https://cognition.com/data/frontiercode-leaderboard/data.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.3544 \| score_fraction \| blocking_criteria_adjusted \| Higher is better \| \| `correct` \| 0.3974 \| score_fraction \| raw_rubric \| Higher is better \| \| `cost` \| 1.8904 \| USD \| per_rollout \| Lower is better \| ### Configuration harness codex Reasoning effort low sourceVersion v1_1 subset main ### Reported statistics flaggedRate 0.001 sampleSize 100 ### Source [Original source](https://cognition.com/data/frontiercode-leaderboard/data.json) Source frontiercode Original model label GPT-5.6 Sol Observed 2026-10-22T05:40:03.220Z Evidence SHA-256 `ff0040778b7bdf69c705ad7474f771fb5e53cfaf5cf8573b3a4614153543d75f` Source locator `/v1_1/data/GPT-5.6%20Sol/low/main` | | | | | | | | | [FrontierCode 1.1 extended](https://benchize.com/benchmarks/frontiercode%3Av1_1%3Aextended.md) | 49.99% | — | 91 / 125 | $1.67 | — | [frontiercode](https://cognition.com/data/frontiercode-leaderboard/data.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.4999 \| score_fraction \| blocking_criteria_adjusted \| Higher is better \| \| `correct` \| 0.5536 \| score_fraction \| raw_rubric \| Higher is better \| \| `cost` \| 1.6667 \| USD \| per_rollout \| Lower is better \| ### Configuration harness codex Reasoning effort low sourceVersion v1_1 subset extended ### Reported statistics flaggedRate 0.0007 sampleSize 150 ### Source [Original source](https://cognition.com/data/frontiercode-leaderboard/data.json) Source frontiercode Original model label GPT-5.6 Sol Observed 2026-10-22T05:40:03.220Z Evidence SHA-256 `ff0040778b7bdf69c705ad7474f771fb5e53cfaf5cf8573b3a4614153543d75f` Source locator `/v1_1/data/GPT-5.6%20Sol/low/extended` | | | | | | | | | [ToneBench Scriptwriting](https://benchize.com/benchmarks/tonebench%3Ascripts.md) | 2,193.6 | Range 2,160–2,227.1 | 17 / 126 | — | — | [tonebench](https://benchmark.towardsai.com/data/leaderboard.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 2193.6 \| rating \| reported \| Higher is better \| \| `overall` \| 82.35 \| percent \| reported \| Higher is better \| \| `anti_slop_numbers` \| 75.29 \| source_score \| rubric \| Higher is better \| \| `continuity_emotion` \| 81.65 \| source_score \| rubric \| Higher is better \| \| `cue_quality` \| 79.91 \| source_score \| rubric \| Higher is better \| \| `hook_strength` \| 83.7 \| source_score \| rubric \| Higher is better \| \| `length_adherence` \| 89.71 \| source_score \| rubric \| Higher is better \| \| `slop` \| 85.41 \| source_score \| rubric \| Higher is better \| \| `slop_score` \| 95.53 \| source_score \| rubric \| Higher is better \| \| `substance_accuracy` \| 87.11 \| source_score \| rubric \| Higher is better \| \| `tone_voice` \| 78.59 \| source_score \| rubric \| Higher is better \| \| `writing_quality` \| 79.33 \| source_score \| rubric \| Higher is better \| \| `youtube_best_practices` \| 79.93 \| source_score \| rubric \| Higher is better \| ### Configuration provider codex Reasoning effort unknown scoreScope 10_task_current sourceConfiguration gpt-5-6 thinkingEnabled true ### Reported statistics Uncertainty Reported interval: 2,160–2,227.1 interval [2160,2227.1] rank 17 runCount 5 ### Source [Original source](https://benchmark.towardsai.com/data/leaderboard.json) Source tonebench Original model label GPT-5.6 Sol (low) Evaluated 2026-10-11 Observed 2026-10-22T04:40:14.102Z Evidence SHA-256 `4264338337f418d3ded7ace250cad64fe12cacbd4b79a312bfaf0ae9268a01c3` Source locator `/rows/16` | | | | | | | | --- Cite as: GPT-5.6 SolLow — Benchize, https://benchize.com/models/gpt-5-6-sol-low (retrieved 2026-10-22)