# O4 MiniLow > Source: Benchize (https://benchize.com) — https://benchize.com/models/o4-mini-low. When citing or reusing this content, credit "Benchize" and link to https://benchize.com/models/o4-mini-low. OpenAI Canonical URL: https://benchize.com/models/o4-mini-low Last updated: Thu, 22 Oct 2026 07:32:33 GMT Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations. OpenAI ## Benchmarks | Benchmark | Score | ± | Rank | Cost | Source | | | --- | --- | --- | --- | --- | --- | --- | | [CMIMC 2025](https://benchize.com/benchmarks/matharena%3Acmimc--cmimc_2025.md) | 48.12% | 95% CI 40.38–55.86% | 21 / 22 | 0.01usd per problem | [matharena · cmimc--cmimc_2025](https://matharena.ai/competition_tables/cmimc--cmimc_2025) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 48.12 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.012 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition cmimc--cmimc_2025 predicted false Reasoning effort low sourceModelName o4-mini (low) sourceModelVersion openai/o4-mini--low thinkingEnabled true ### Reported statistics Uncertainty 95% confidence interval: 40.38–55.86% confidenceInterval95 7.74 problems 40 ### Source [Original source](https://matharena.ai/competition_tables/cmimc--cmimc_2025) Source matharena Original model label o4-mini (low) Source version cmimc--cmimc_2025 Observed 2026-10-22T05:30:12.870Z Evidence SHA-256 `d5d48c1f54a744d7ff2244bae3258963afdb1ab36fb20464ea9cf47138a1555e` Source locator `/table/rows/34` | | | | | | | | [ARC-AGI-1](https://benchize.com/benchmarks/arc-prize%3Av1_Semi_Private.md) | 21.33% | — | 211 / 245 | 0.04usd per task | [arc prize · v1](https://arcprize.org/media/data/leaderboard/v1.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.2133 \| score_fraction \| v1_Semi_Private \| Higher is better \| \| `cost_per_task` \| 0.0406 \| usd_per_task \| v1_Semi_Private \| Lower is better \| ### Configuration evaluationSplit v1_Semi_Private harness Not reported modelGroup o4-mini modelType CoT Reasoning effort low sourceModelVersion o4-mini-2025-04-16-low thinkingEnabled true ### Source [Original source](https://arcprize.org/media/data/leaderboard/v1.json) Source arc prize Original model label o4-mini (Low) Source version v1 Observed 2026-10-22T05:20:04.066Z Evidence SHA-256 `2bf68d22dafba37047d07ad833ebc0e8199c9aa2f9eeaed50c75c1b704462836` Source locator `/evaluations/25` | | | | | | | | [HMMT Feb 2025](https://benchize.com/benchmarks/matharena%3Ahmmt--hmmt_feb_2025.md) | 47.5% | 95% CI 38.57–56.43% | 29 / 35 | 0.01usd per problem | [matharena · hmmt--hmmt_feb_2025](https://matharena.ai/competition_tables/hmmt--hmmt_feb_2025) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 47.50 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.012 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition hmmt--hmmt_feb_2025 predicted false Reasoning effort low sourceModelName o4-mini (low) sourceModelVersion openai/o4-mini--low thinkingEnabled true ### Reported statistics Uncertainty 95% confidence interval: 38.57–56.43% confidenceInterval95 8.93 problems 30 ### Source [Original source](https://matharena.ai/competition_tables/hmmt--hmmt_feb_2025) Source matharena Original model label o4-mini (low) Source version hmmt--hmmt_feb_2025 Observed 2026-10-22T05:30:12.126Z Evidence SHA-256 `8554225c26eb7a3c2649943ee7cf6b404ec1f7441b20fbdcfccbf35b9a864864` Source locator `/table/rows/43` | | | | | | | | [AIME 2025](https://benchize.com/benchmarks/aime-2025.md) | 61.67% | 95% CI 52.97–70.37% | 30 / 36 | 0.01usd per problem | [matharena · aime--aime_2025](https://matharena.ai/competition_tables/aime--aime_2025) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 61.67 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.012 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition aime--aime_2025 predicted false Reasoning effort low sourceModelName o4-mini (low) sourceModelVersion openai/o4-mini--low thinkingEnabled true ### Reported statistics Uncertainty 95% confidence interval: 52.97–70.37% confidenceInterval95 8.70 problems 30 ### Source [Original source](https://matharena.ai/competition_tables/aime--aime_2025) Source matharena Original model label o4-mini (low) Source version aime--aime_2025 Observed 2026-10-22T05:30:11.892Z Evidence SHA-256 `fab0abcecc4032852ef2cbd2a84d34ffc42202be358b2994bfaba44ae7a0cd9a` Source locator `/table/rows/45` | | | | | | | | [ARC-AGI-2](https://benchize.com/benchmarks/arc-prize%3Av2_Semi_Private.md) | 1.67% | — | 201 / 243 | 0.05usd per task | [arc prize · v2](https://arcprize.org/media/data/leaderboard/v2.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.0167 \| score_fraction \| v2_Semi_Private \| Higher is better \| \| `cost_per_task` \| 0.05 \| usd_per_task \| v2_Semi_Private \| Lower is better \| ### Configuration evaluationSplit v2_Semi_Private harness Not reported modelGroup o4-mini modelType CoT Reasoning effort low sourceModelVersion o4-mini-2025-04-16-low thinkingEnabled true ### Source [Original source](https://arcprize.org/media/data/leaderboard/v2.json) Source arc prize Original model label o4-mini (Low) Source version v2 Observed 2026-10-22T05:20:04.306Z Evidence SHA-256 `4351eb696e78113b0459e9bb5f0258318b905efef34f473dcea51ce641b0d94d` Source locator `/evaluations/27` | | | | | | | | [BRUMO 2025](https://benchize.com/benchmarks/matharena%3Abrumo--brumo_2025.md) | 66.67% | 95% CI 58.24–75.1% | 25 / 26 | 0.008usd per problem | [matharena · brumo--brumo_2025](https://matharena.ai/competition_tables/brumo--brumo_2025) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 66.67 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.008 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition brumo--brumo_2025 predicted false Reasoning effort low sourceModelName o4-mini (low) sourceModelVersion openai/o4-mini--low thinkingEnabled true ### Reported statistics Uncertainty 95% confidence interval: 58.24–75.1% confidenceInterval95 8.43 problems 30 ### Source [Original source](https://matharena.ai/competition_tables/brumo--brumo_2025) Source matharena Original model label o4-mini (low) Source version brumo--brumo_2025 Observed 2026-10-22T05:30:12.351Z Evidence SHA-256 `d1d1c126b1feff70b2bcc20a7adbf380d94c2aaab0704704cb01593d4e1958ff` Source locator `/table/rows/42` | | | | | | | | [SMT 2025](https://benchize.com/benchmarks/matharena%3Asmt--smt_2025.md) | 68.87% | 95% CI 62.64–75.1% | 23 / 26 | 0.009usd per problem | [matharena · smt--smt_2025](https://matharena.ai/competition_tables/smt--smt_2025) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 68.87 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.009 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition smt--smt_2025 predicted false Reasoning effort low sourceModelName o4-mini (low) sourceModelVersion openai/o4-mini--low thinkingEnabled true ### Reported statistics Uncertainty 95% confidence interval: 62.64–75.1% confidenceInterval95 6.23 problems 53 ### Source [Original source](https://matharena.ai/competition_tables/smt--smt_2025) Source matharena Original model label o4-mini (low) Source version smt--smt_2025 Observed 2026-10-22T05:30:12.647Z Evidence SHA-256 `1b4f6f8bafc1688e4557a024513f68befa31aff48fd0623fb4892a61263433b0` Source locator `/table/rows/36` | | | | | | | | [BullshitBench v2](https://benchize.com/benchmarks/bullshitbench%3Av2.md) | 8% | — | 171 / 191 | — | [bullshitbench · v2](https://api.github.com/repos/petergpt/bullshit-benchmark/contents/data/v2/latest/leaderboard.csv?ref=3c655234d15967738f95da696e3f938d4862dcf7) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `green_rate` \| 0.08 \| score_fraction \| all_attempts \| Higher is better \| \| `red_rate` \| 0.79 \| score_fraction \| all_attempts \| Lower is better \| \| `refusal_rate` \| 0.0 \| score_fraction \| all_attempts \| Lower is better \| \| `avg_score` \| 0.2767 \| score \| judge_grade_0_to_2 \| Higher is better \| ### Configuration Reasoning effort low suite v2 thinkingEnabled true ### Reported statistics acceptedCount 79 answeredCount 100 clearCount 8 errorCount 0 partialCount 13 rank 224 refusalCount 0 sampleSize 100 ### Source [Original source](https://api.github.com/repos/petergpt/bullshit-benchmark/contents/data/v2/latest/leaderboard.csv?ref=3c655234d15967738f95da696e3f938d4862dcf7) Source bullshitbench Original model label openai/o4-mini Source version v2 Observed 2026-10-22T03:10:12.603Z Evidence SHA-256 `98b485e08764d1c97144bc4f7b28ced1a96d50850947c775870dfda0e5d749b5` Source locator `/rows/223` | | | | | | | --- Cite as: O4 MiniLow — Benchize, https://benchize.com/models/o4-mini-low (retrieved 2026-10-22)