# O3High > Source: Benchize (https://benchize.com) — https://benchize.com/models/o3-high. When citing or reusing this content, credit "Benchize" and link to https://benchize.com/models/o3-high. OpenAI Canonical URL: https://benchize.com/models/o3-high Last updated: Thu, 22 Oct 2026 07:32:33 GMT Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations. OpenAI ## Benchmarks | Benchmark | Score | ± | Rank | Cost | Source | | | --- | --- | --- | --- | --- | --- | --- | | [BRUMO 2025](https://benchize.com/benchmarks/matharena%3Abrumo--brumo_2025.md) | 95.83% | 95% CI 92.25–99.41% | 5 / 26 | 0.08usd per problem | [matharena · brumo--brumo_2025](https://matharena.ai/competition_tables/brumo--brumo_2025) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 95.83 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.081 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition brumo--brumo_2025 predicted false Reasoning effort high sourceModelName o3 (high) sourceModelVersion openai/o3 thinkingEnabled true ### Reported statistics Uncertainty 95% confidence interval: 92.25–99.41% confidenceInterval95 3.58 problems 30 ### Source [Original source](https://matharena.ai/competition_tables/brumo--brumo_2025) Source matharena Original model label o3 (high) Source version brumo--brumo_2025 Observed 2026-10-22T05:30:12.351Z Evidence SHA-256 `d1d1c126b1feff70b2bcc20a7adbf380d94c2aaab0704704cb01593d4e1958ff` Source locator `/table/rows/11` | | | | | | | | [HMMT Feb 2025](https://benchize.com/benchmarks/matharena%3Ahmmt--hmmt_feb_2025.md) | 77.5% | 95% CI 70.03–84.97% | 13 / 35 | 0.12usd per problem | [matharena · hmmt--hmmt_feb_2025](https://matharena.ai/competition_tables/hmmt--hmmt_feb_2025) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 77.50 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.12 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition hmmt--hmmt_feb_2025 predicted false Reasoning effort high sourceModelName o3 (high) sourceModelVersion openai/o3 thinkingEnabled true ### Reported statistics Uncertainty 95% confidence interval: 70.03–84.97% confidenceInterval95 7.47 problems 30 ### Source [Original source](https://matharena.ai/competition_tables/hmmt--hmmt_feb_2025) Source matharena Original model label o3 (high) Source version hmmt--hmmt_feb_2025 Observed 2026-10-22T05:30:12.126Z Evidence SHA-256 `8554225c26eb7a3c2649943ee7cf6b404ec1f7441b20fbdcfccbf35b9a864864` Source locator `/table/rows/25` | | | | | | | | [ARC-AGI-2](https://benchize.com/benchmarks/arc-prize%3Av2_Semi_Private.md) | 6.53% | — | 156 / 243 | 0.83usd per task | [arc prize · v2](https://arcprize.org/media/data/leaderboard/v2.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.0653 \| score_fraction \| v2_Semi_Private \| Higher is better \| \| `cost_per_task` \| 0.8339 \| usd_per_task \| v2_Semi_Private \| Lower is better \| ### Configuration evaluationSplit v2_Semi_Private harness Not reported modelGroup o3 modelType CoT Reasoning effort high sourceModelVersion o3-2025-04-16-high thinkingEnabled true ### Source [Original source](https://arcprize.org/media/data/leaderboard/v2.json) Source arc prize Original model label o3 (High) Source version v2 Observed 2026-10-22T05:20:04.306Z Evidence SHA-256 `4351eb696e78113b0459e9bb5f0258318b905efef34f473dcea51ce641b0d94d` Source locator `/evaluations/26` | | | | | | | | [SMT 2025](https://benchize.com/benchmarks/matharena%3Asmt--smt_2025.md) | 87.74% | 95% CI 83.32–92.16% | 11 / 26 | 0.07usd per problem | [matharena · smt--smt_2025](https://matharena.ai/competition_tables/smt--smt_2025) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 87.74 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.071 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition smt--smt_2025 predicted false Reasoning effort high sourceModelName o3 (high) sourceModelVersion openai/o3 thinkingEnabled true ### Reported statistics Uncertainty 95% confidence interval: 83.32–92.16% confidenceInterval95 4.42 problems 53 ### Source [Original source](https://matharena.ai/competition_tables/smt--smt_2025) Source matharena Original model label o3 (high) Source version smt--smt_2025 Observed 2026-10-22T05:30:12.647Z Evidence SHA-256 `1b4f6f8bafc1688e4557a024513f68befa31aff48fd0623fb4892a61263433b0` Source locator `/table/rows/16` | | | | | | | | [ARC-AGI-1](https://benchize.com/benchmarks/arc-prize%3Av1_Semi_Private.md) | 60.83% | — | 147 / 245 | 0.5usd per task | [arc prize · v1](https://arcprize.org/media/data/leaderboard/v1.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.6083 \| score_fraction \| v1_Semi_Private \| Higher is better \| \| `cost_per_task` \| 0.5002 \| usd_per_task \| v1_Semi_Private \| Lower is better \| ### Configuration evaluationSplit v1_Semi_Private harness Not reported modelGroup o3 modelType CoT Reasoning effort high sourceModelVersion o3-2025-04-16-high thinkingEnabled true ### Source [Original source](https://arcprize.org/media/data/leaderboard/v1.json) Source arc prize Original model label o3 (High) Source version v1 Observed 2026-10-22T05:20:04.066Z Evidence SHA-256 `2bf68d22dafba37047d07ad833ebc0e8199c9aa2f9eeaed50c75c1b704462836` Source locator `/evaluations/24` | | | | | | | | [IMO 2025](https://benchize.com/benchmarks/matharena%3Aimo--imo_2025.md) | 16.67% | 95% CI 1.76–31.58% | 3 / 4 | 9.31usd per problem | [matharena · imo--imo_2025](https://matharena.ai/competition_tables/imo--imo_2025) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 16.67 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 9.31 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition imo--imo_2025 predicted false Reasoning effort high sourceModelName o3 (high) sourceModelVersion openai/o3 thinkingEnabled true ### Reported statistics Uncertainty 95% confidence interval: 1.76–31.58% confidenceInterval95 14.91 problems 6 ### Source [Original source](https://matharena.ai/competition_tables/imo--imo_2025) Source matharena Original model label o3 (high) Source version imo--imo_2025 Observed 2026-10-22T05:30:14.566Z Evidence SHA-256 `1d8d25002237e5658d7597e8559337724a90305229240d1517221f7b3aa09aac` Source locator `/table/rows/3` | | | | | | | | [SimpleBench](https://benchize.com/benchmarks/simplebench%3Aavg-at-5.md) | 53.1% | — | 32 / 62 | — | [simplebench](https://simple-bench.com/static/js/leaderboard-data.js) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 53.1 \| percent \| average_at_5 \| Higher is better \| ### Configuration Reasoning effort high Model configuration o3 (high) thinkingEnabled true ### Reported statistics rank 51st ### Source [Original source](https://simple-bench.com/static/js/leaderboard-data.js) Source simplebench Original model label o3 (high) Observed 2026-10-22T03:40:04.693Z Evidence SHA-256 `b2d0285ad3e4e15750ed20d39897e7558d1c05e8962e90c861b06f93c8019dc9` Source locator `/rows/52` | | | | | | | | [CMIMC 2025](https://benchize.com/benchmarks/matharena%3Acmimc--cmimc_2025.md) | 82.5% | 95% CI 76.61–88.39% | 11 / 22 | 0.1usd per problem | [matharena · cmimc--cmimc_2025](https://matharena.ai/competition_tables/cmimc--cmimc_2025) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 82.50 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.10 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition cmimc--cmimc_2025 predicted false Reasoning effort high sourceModelName o3 (high) sourceModelVersion openai/o3 thinkingEnabled true ### Reported statistics Uncertainty 95% confidence interval: 76.61–88.39% confidenceInterval95 5.89 problems 40 ### Source [Original source](https://matharena.ai/competition_tables/cmimc--cmimc_2025) Source matharena Original model label o3 (high) Source version cmimc--cmimc_2025 Observed 2026-10-22T05:30:12.870Z Evidence SHA-256 `d5d48c1f54a744d7ff2244bae3258963afdb1ab36fb20464ea9cf47138a1555e` Source locator `/table/rows/19` | | | | | | | | [AIME 2025](https://benchize.com/benchmarks/aime-2025.md) | 89.17% | 95% CI 83.61–94.73% | 12 / 36 | 0.1usd per problem | [matharena · aime--aime_2025](https://matharena.ai/competition_tables/aime--aime_2025) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 89.17 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.10 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition aime--aime_2025 predicted false Reasoning effort high sourceModelName o3 (high) sourceModelVersion openai/o3 thinkingEnabled true ### Reported statistics Uncertainty 95% confidence interval: 83.61–94.73% confidenceInterval95 5.56 problems 30 ### Source [Original source](https://matharena.ai/competition_tables/aime--aime_2025) Source matharena Original model label o3 (high) Source version aime--aime_2025 Observed 2026-10-22T05:30:11.892Z Evidence SHA-256 `fab0abcecc4032852ef2cbd2a84d34ffc42202be358b2994bfaba44ae7a0cd9a` Source locator `/table/rows/23` | | | | | | | --- Cite as: O3High — Benchize, https://benchize.com/models/o3-high (retrieved 2026-10-22)