# GPT-6 SolNon-thinking

> Source: Benchize (https://benchize.com) — https://benchize.com/models/gpt-6-sol-off. When citing or reusing this content, credit "Benchize" and link to https://benchize.com/models/gpt-6-sol-off.

OpenAI

Canonical URL: https://benchize.com/models/gpt-6-sol-off
Last updated: Thu, 22 Oct 2026 06:20:09 GMT

Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations.

OpenAI

## Benchmarks

| Benchmark | Score | Rank | Cost | Source |  |
| --- | --- | --- | --- | --- | --- |
| [AutomationBench](https://benchize.com/benchmarks/zapier%3Aautomationbench.md) | 9.1% | 72 / 113 | $0.25 | [zapier](https://framerusercontent.com/sites/4WTSl4BNjd1q9QFEFibC6h/lOvLnhItj8S8-1vyjH_s33Jn-WmUXPmiJ5Diajl0Q38.CMutaHYl.mjs) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 9.1 \| percent \| reported \| Higher is better \| \| `cost` \| 0.25 \| USD \| per_task \| Lower is better \| ### Configuration benchmarkVersion 1.0.6 costFootnote false Fallback policy Not reported Reasoning effort none Model configuration GPT-6 Sol (None) thinkingEnabled false ### Reported statistics rank 81 ### Source [Original source](https://framerusercontent.com/sites/4WTSl4BNjd1q9QFEFibC6h/lOvLnhItj8S8-1vyjH_s33Jn-WmUXPmiJ5Diajl0Q38.CMutaHYl.mjs) Source zapier Original model label GPT-6 Sol (None) Observed 2026-10-21T16:34:56.783Z Evidence SHA-256 `43978e38f018789fa59c11de5328abe9e5905bfa9a5a4d601fa3aa4d9c153b0d` Source locator `/rows/80` |  |  |  |  |  |
| [ARC-AGI-2](https://benchize.com/benchmarks/arc-prize%3Av2_Semi_Private.md) | 1.67% | 204 / 243 | 0.07usd per task | [arc prize · v2](https://arcprize.org/media/data/leaderboard/v2.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.016666666666666666 \| score_fraction \| v2_Semi_Private \| Higher is better \| \| `cost_per_task` \| 0.0740642 \| usd_per_task \| v2_Semi_Private \| Lower is better \| ### Configuration evaluationSplit v2_Semi_Private harness Not reported modelGroup openai-gpt-6-sol modelType CoT sourceModelVersion openai-gpt-6-sol-none thinkingEnabled false ### Source [Original source](https://arcprize.org/media/data/leaderboard/v2.json) Source arc prize Original model label GPT-6 Sol (None) Source version v2 Observed 2026-10-22T05:20:04.306Z Evidence SHA-256 `4351eb696e78113b0459e9bb5f0258318b905efef34f473dcea51ce641b0d94d` Source locator `/evaluations/251` |  |  |  |  |  |
| [BullshitBench v2](https://benchize.com/benchmarks/bullshitbench%3Av2.md) | 59% | 47 / 191 | — | [bullshitbench · v2](https://api.github.com/repos/petergpt/bullshit-benchmark/contents/data/v2/latest/leaderboard.csv?ref=3c655234d15967738f95da696e3f938d4862dcf7) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `green_rate` \| 0.59 \| score_fraction \| all_attempts \| Higher is better \| \| `red_rate` \| 0.14 \| score_fraction \| all_attempts \| Lower is better \| \| `refusal_rate` \| 0.0 \| score_fraction \| all_attempts \| Lower is better \| \| `avg_score` \| 1.4067 \| score \| judge_grade_0_to_2 \| Higher is better \| ### Configuration Reasoning effort none suite v2 thinkingEnabled false ### Reported statistics acceptedCount 14 answeredCount 100 clearCount 59 errorCount 0 partialCount 27 rank 65 refusalCount 0 sampleSize 100 ### Source [Original source](https://api.github.com/repos/petergpt/bullshit-benchmark/contents/data/v2/latest/leaderboard.csv?ref=3c655234d15967738f95da696e3f938d4862dcf7) Source bullshitbench Original model label openai/gpt-6-sol Source version v2 Observed 2026-10-22T03:10:12.603Z Evidence SHA-256 `98b485e08764d1c97144bc4f7b28ced1a96d50850947c775870dfda0e5d749b5` Source locator `/rows/64` |  |  |  |  |  |
| [ARC-AGI-3](https://benchize.com/benchmarks/arc-prize%3Av3_Semi_Private.md) | 0.28% | 48 / 65 | 4,655.55usd | [arc prize · v3](https://arcprize.org/media/data/leaderboard/v3.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.0028377423506430063 \| score_fraction \| v3_Semi_Private \| Higher is better \| \| `total_cost` \| 4655.549962 \| usd \| v3_Semi_Private \| Lower is better \| ### Configuration evaluationSplit v3_Semi_Private harness standard modelGroup openai-gpt-6-sol modelType CoT sourceModelVersion openai-gpt-6-sol-none thinkingEnabled false ### Source [Original source](https://arcprize.org/media/data/leaderboard/v3.json) Source arc prize Original model label GPT-6 Sol (None) Source version v3 Observed 2026-10-22T05:20:04.578Z Evidence SHA-256 `3ce335487296bb2dcf4ba9546c5a2a02b1907db5b08887cd9ff4429fed824916` Source locator `/evaluations/62` |  |  |  |  |  |
| [ARC-AGI-1](https://benchize.com/benchmarks/arc-prize%3Av1_Semi_Private.md) | 29.33% | 198 / 245 | 0.04usd per task | [arc prize · v1](https://arcprize.org/media/data/leaderboard/v1.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.29333333333333333 \| score_fraction \| v1_Semi_Private \| Higher is better \| \| `cost_per_task` \| 0.04286973999999999 \| usd_per_task \| v1_Semi_Private \| Lower is better \| ### Configuration evaluationSplit v1_Semi_Private harness Not reported modelGroup openai-gpt-6-sol modelType CoT sourceModelVersion openai-gpt-6-sol-none thinkingEnabled false ### Source [Original source](https://arcprize.org/media/data/leaderboard/v1.json) Source arc prize Original model label GPT-6 Sol (None) Source version v1 Observed 2026-10-22T05:20:04.066Z Evidence SHA-256 `2bf68d22dafba37047d07ad833ebc0e8199c9aa2f9eeaed50c75c1b704462836` Source locator `/evaluations/249` |  |  |  |  |  |

---
Cite as: GPT-6 SolNon-thinking — Benchize, https://benchize.com/models/gpt-6-sol-off (retrieved 2026-10-22)