# BRUMO 2025 > Source: Benchize (https://benchize.com) — https://benchize.com/benchmarks/matharena%3Abrumo--brumo_2025. When citing or reusing this content, credit "Benchize" and link to https://benchize.com/benchmarks/matharena%3Abrumo--brumo_2025. BRUMO 2025: Solving final-answer mathematics competition problems. This competition contains 30 problems. MathArena reports normalized performance across repeated attempts and a 95% confidence interval. Canonical URL: https://benchize.com/benchmarks/matharena%3Abrumo--brumo_2025 Last updated: Wed, 21 Oct 2026 18:52:20 GMT Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations. Conquered BRUMO 2025: Solving final-answer mathematics competition problems. This competition contains 30 problems. MathArena reports normalized performance across repeated attempts and a 95% confidence interval. Mathematics · Models tested: 25 · Score publishers: [matharena](https://matharena.ai/?comp=brumo--brumo_2025) ## Model results | # | Model | Score | ± | Cost | | | --- | --- | --- | --- | --- | --- | | 1 | [Step 3.5 Flash](https://benchize.com/models/step-3-5-flash.md) | 100% | 95% CI 100–100% | 0.008usd per problem | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 100.00 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.008 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition brumo--brumo_2025 predicted false sourceModelName Step 3.5 Flash sourceModelVersion stepfun/3.5-flash ### Reported statistics Uncertainty 95% confidence interval: 100–100% confidenceInterval95 0.00 problems 30 ### Source [Original source](https://matharena.ai/competition_tables/brumo--brumo_2025) Source matharena Original model label Step 3.5 Flash Source version brumo--brumo_2025 Observed 2026-10-21T16:52:35.992Z Evidence SHA-256 `d1d1c126b1feff70b2bcc20a7adbf380d94c2aaab0704704cb01593d4e1958ff` Source locator `/table/rows/0` | | | | | | | 1 | [Gemini 3 Flash](https://benchize.com/models/gemini-3-flash.md) | 100% | 95% CI 100–100% | 0.05usd per problem | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 100.00 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.046 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition brumo--brumo_2025 predicted false sourceModelName Gemini 3 Flash sourceModelVersion gemini/gemini-3-flash ### Reported statistics Uncertainty 95% confidence interval: 100–100% confidenceInterval95 0.00 problems 30 ### Source [Original source](https://matharena.ai/competition_tables/brumo--brumo_2025) Source matharena Original model label Gemini 3 Flash Source version brumo--brumo_2025 Observed 2026-10-21T16:52:35.992Z Evidence SHA-256 `d1d1c126b1feff70b2bcc20a7adbf380d94c2aaab0704704cb01593d4e1958ff` Source locator `/table/rows/1` | | | | | | | 3 | [GLM-5](https://benchize.com/models/glm-5.md) | 99.17% | 95% CI 97.54–100.8% | 0.07usd per problem | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 99.17 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.065 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition brumo--brumo_2025 predicted false sourceModelName GLM 5 sourceModelVersion glm/glm-5 ### Reported statistics Uncertainty 95% confidence interval: 97.54–100.8% confidenceInterval95 1.63 problems 30 ### Source [Original source](https://matharena.ai/competition_tables/brumo--brumo_2025) Source matharena Original model label GLM 5 Source version brumo--brumo_2025 Observed 2026-10-21T16:52:35.992Z Evidence SHA-256 `d1d1c126b1feff70b2bcc20a7adbf380d94c2aaab0704704cb01593d4e1958ff` Source locator `/table/rows/3` | | | | | | | 4 | [GPT-5.2](https://benchize.com/models/gpt-5-2-high.md)High | 98.33% | 95% CI 96.04–100.62% | 0.08usd per problem | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 98.33 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.084 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition brumo--brumo_2025 predicted false Reasoning effort high sourceModelName GPT-5.2 (high) sourceModelVersion openai/gpt-52-high thinkingEnabled true ### Reported statistics Uncertainty 95% confidence interval: 96.04–100.62% confidenceInterval95 2.29 problems 30 ### Source [Original source](https://matharena.ai/competition_tables/brumo--brumo_2025) Source matharena Original model label GPT-5.2 (high) Source version brumo--brumo_2025 Observed 2026-10-21T16:52:35.992Z Evidence SHA-256 `d1d1c126b1feff70b2bcc20a7adbf380d94c2aaab0704704cb01593d4e1958ff` Source locator `/table/rows/5` | | | | | | | 5 | [O3](https://benchize.com/models/o3-high.md)High | 95.83% | 95% CI 92.25–99.41% | 0.08usd per problem | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 95.83 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.081 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition brumo--brumo_2025 predicted false Reasoning effort high sourceModelName o3 (high) sourceModelVersion openai/o3 thinkingEnabled true ### Reported statistics Uncertainty 95% confidence interval: 92.25–99.41% confidenceInterval95 3.58 problems 30 ### Source [Original source](https://matharena.ai/competition_tables/brumo--brumo_2025) Source matharena Original model label o3 (high) Source version brumo--brumo_2025 Observed 2026-10-21T16:52:35.992Z Evidence SHA-256 `d1d1c126b1feff70b2bcc20a7adbf380d94c2aaab0704704cb01593d4e1958ff` Source locator `/table/rows/11` | | | | | | | 6 | [GLM-4.6](https://benchize.com/models/glm-4-6.md) | 94.17% | 95% CI 89.98–98.36% | 0.03usd per problem | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 94.17 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.030 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition brumo--brumo_2025 predicted false sourceModelName GLM 4.6 sourceModelVersion glm/glm-46 ### Reported statistics Uncertainty 95% confidence interval: 89.98–98.36% confidenceInterval95 4.19 problems 30 ### Source [Original source](https://matharena.ai/competition_tables/brumo--brumo_2025) Source matharena Original model label GLM 4.6 Source version brumo--brumo_2025 Observed 2026-10-21T16:52:35.992Z Evidence SHA-256 `d1d1c126b1feff70b2bcc20a7adbf380d94c2aaab0704704cb01593d4e1958ff` Source locator `/table/rows/13` | | | | | | | 7 | [GPT-5.1](https://benchize.com/models/gpt-5-1-high.md)High | 93.33% | 95% CI 88.87–97.79% | 0.17usd per problem | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 93.33 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.17 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition brumo--brumo_2025 predicted false Reasoning effort high sourceModelName GPT-5.1 (high) sourceModelVersion openai/gpt-51 thinkingEnabled true ### Reported statistics Uncertainty 95% confidence interval: 88.87–97.79% confidenceInterval95 4.46 problems 30 ### Source [Original source](https://matharena.ai/competition_tables/brumo--brumo_2025) Source matharena Original model label GPT-5.1 (high) Source version brumo--brumo_2025 Observed 2026-10-21T16:52:35.992Z Evidence SHA-256 `d1d1c126b1feff70b2bcc20a7adbf380d94c2aaab0704704cb01593d4e1958ff` Source locator `/table/rows/15` | | | | | | | 8 | [gpt-oss-120b](https://benchize.com/models/gpt-oss-120b-high.md)High | 92.5% | 95% CI 87.79–97.21% | 0.01usd per problem | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 92.50 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.011 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition brumo--brumo_2025 predicted false Reasoning effort high sourceModelName GPT OSS 120B (high) sourceModelVersion openai/oss-120b thinkingEnabled true ### Reported statistics Uncertainty 95% confidence interval: 87.79–97.21% confidenceInterval95 4.71 problems 30 ### Source [Original source](https://matharena.ai/competition_tables/brumo--brumo_2025) Source matharena Original model label GPT OSS 120B (high) Source version brumo--brumo_2025 Observed 2026-10-21T16:52:35.992Z Evidence SHA-256 `d1d1c126b1feff70b2bcc20a7adbf380d94c2aaab0704704cb01593d4e1958ff` Source locator `/table/rows/16` | | | | | | | 8 | [GLM-4.5](https://benchize.com/models/glm-4-5.md) | 92.5% | 95% CI 87.79–97.21% | 0.04usd per problem | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 92.50 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.043 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition brumo--brumo_2025 predicted false sourceModelName GLM 4.5 sourceModelVersion glm/glm-45 ### Reported statistics Uncertainty 95% confidence interval: 87.79–97.21% confidenceInterval95 4.71 problems 30 ### Source [Original source](https://matharena.ai/competition_tables/brumo--brumo_2025) Source matharena Original model label GLM 4.5 Source version brumo--brumo_2025 Observed 2026-10-21T16:52:35.992Z Evidence SHA-256 `d1d1c126b1feff70b2bcc20a7adbf380d94c2aaab0704704cb01593d4e1958ff` Source locator `/table/rows/18` | | | | | | | 8 | [R1 0528](https://benchize.com/models/deepseek-r1-0528.md) | 92.5% | 95% CI 87.79–97.21% | 0.04usd per problem | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 92.50 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.041 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition brumo--brumo_2025 predicted false sourceModelName DeepSeek-R1-0528 sourceModelVersion deepseek/deepseek_r1_0528 ### Reported statistics Uncertainty 95% confidence interval: 87.79–97.21% confidenceInterval95 4.71 problems 30 ### Source [Original source](https://matharena.ai/competition_tables/brumo--brumo_2025) Source matharena Original model label DeepSeek-R1-0528 Source version brumo--brumo_2025 Observed 2026-10-21T16:52:35.992Z Evidence SHA-256 `d1d1c126b1feff70b2bcc20a7adbf380d94c2aaab0704704cb01593d4e1958ff` Source locator `/table/rows/17` | | | | | | | 11 | [GPT-5](https://benchize.com/models/gpt-5-high.md)High | 91.67% | 95% CI 86.72–96.62% | 0.11usd per problem | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 91.67 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.11 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition brumo--brumo_2025 predicted false Reasoning effort high sourceModelName GPT-5 (high) sourceModelVersion openai/gpt-5 thinkingEnabled true ### Reported statistics Uncertainty 95% confidence interval: 86.72–96.62% confidenceInterval95 4.95 problems 30 ### Source [Original source](https://matharena.ai/competition_tables/brumo--brumo_2025) Source matharena Original model label GPT-5 (high) Source version brumo--brumo_2025 Observed 2026-10-21T16:52:35.992Z Evidence SHA-256 `d1d1c126b1feff70b2bcc20a7adbf380d94c2aaab0704704cb01593d4e1958ff` Source locator `/table/rows/19` | | | | | | | 12 | [GPT-5 Mini](https://benchize.com/models/gpt-5-mini-high.md)High | 90% | 95% CI 84.63–95.37% | 0.03usd per problem | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 90.00 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.027 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition brumo--brumo_2025 predicted false Reasoning effort high sourceModelName GPT-5-mini (high) sourceModelVersion openai/gpt-5-mini thinkingEnabled true ### Reported statistics Uncertainty 95% confidence interval: 84.63–95.37% confidenceInterval95 5.37 problems 30 ### Source [Original source](https://matharena.ai/competition_tables/brumo--brumo_2025) Source matharena Original model label GPT-5-mini (high) Source version brumo--brumo_2025 Observed 2026-10-21T16:52:35.992Z Evidence SHA-256 `d1d1c126b1feff70b2bcc20a7adbf380d94c2aaab0704704cb01593d4e1958ff` Source locator `/table/rows/22` | | | | | | | 12 | [GLM-4.5 Air](https://benchize.com/models/glm-4-5-air.md) | 90% | 95% CI 84.63–95.37% | 0.02usd per problem | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 90.00 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.022 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition brumo--brumo_2025 predicted false sourceModelName GLM 4.5 Air sourceModelVersion glm/glm-45-air ### Reported statistics Uncertainty 95% confidence interval: 84.63–95.37% confidenceInterval95 5.37 problems 30 ### Source [Original source](https://matharena.ai/competition_tables/brumo--brumo_2025) Source matharena Original model label GLM 4.5 Air Source version brumo--brumo_2025 Observed 2026-10-21T16:52:35.992Z Evidence SHA-256 `d1d1c126b1feff70b2bcc20a7adbf380d94c2aaab0704704cb01593d4e1958ff` Source locator `/table/rows/21` | | | | | | | 12 | [Gemini 2.5 Pro](https://benchize.com/models/gemini-2-5-pro.md) | 90% | 95% CI 84.63–95.37% | 0.18usd per problem | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 90.00 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.18 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition brumo--brumo_2025 predicted false sourceModelName Gemini 2.5 Pro sourceModelVersion gemini/gemini-pro-2.5 ### Reported statistics Uncertainty 95% confidence interval: 84.63–95.37% confidenceInterval95 5.37 problems 30 ### Source [Original source](https://matharena.ai/competition_tables/brumo--brumo_2025) Source matharena Original model label Gemini 2.5 Pro Source version brumo--brumo_2025 Observed 2026-10-21T16:52:35.992Z Evidence SHA-256 `d1d1c126b1feff70b2bcc20a7adbf380d94c2aaab0704704cb01593d4e1958ff` Source locator `/table/rows/24` | | | | | | | 15 | [gpt-oss-20b](https://benchize.com/models/gpt-oss-20b-high.md)High | 86.67% | 95% CI 80.59–92.75% | 0.007usd per problem | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 86.67 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.007 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition brumo--brumo_2025 predicted false Reasoning effort high sourceModelName GPT OSS 20B (high) sourceModelVersion openai/oss-20b thinkingEnabled true ### Reported statistics Uncertainty 95% confidence interval: 80.59–92.75% confidenceInterval95 6.08 problems 30 ### Source [Original source](https://matharena.ai/competition_tables/brumo--brumo_2025) Source matharena Original model label GPT OSS 20B (high) Source version brumo--brumo_2025 Observed 2026-10-21T16:52:35.992Z Evidence SHA-256 `d1d1c126b1feff70b2bcc20a7adbf380d94c2aaab0704704cb01593d4e1958ff` Source locator `/table/rows/27` | | | | | | | 15 | [Qwen3 235B A22B](https://benchize.com/models/qwen3-235b-a22b.md) | 86.67% | 95% CI 80.59–92.75% | 0.007usd per problem | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 86.67 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.007 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition brumo--brumo_2025 predicted false sourceModelName Qwen3-235B-A22B sourceModelVersion qwen/qwen3_235b_a22b ### Reported statistics Uncertainty 95% confidence interval: 80.59–92.75% confidenceInterval95 6.08 problems 30 ### Source [Original source](https://matharena.ai/competition_tables/brumo--brumo_2025) Source matharena Original model label Qwen3-235B-A22B Source version brumo--brumo_2025 Observed 2026-10-21T16:52:35.992Z Evidence SHA-256 `d1d1c126b1feff70b2bcc20a7adbf380d94c2aaab0704704cb01593d4e1958ff` Source locator `/table/rows/28` | | | | | | | 17 | [Grok 3 Mini](https://benchize.com/models/grok-3-mini-high.md)High | 85% | 95% CI 78.61–91.39% | 0.007usd per problem | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 85.00 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.007 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition brumo--brumo_2025 predicted false Reasoning effort high sourceModelName Grok 3 Mini (high) sourceModelVersion xai/grok-3-mini-high thinkingEnabled true ### Reported statistics Uncertainty 95% confidence interval: 78.61–91.39% confidenceInterval95 6.39 problems 30 ### Source [Original source](https://matharena.ai/competition_tables/brumo--brumo_2025) Source matharena Original model label Grok 3 Mini (high) Source version brumo--brumo_2025 Observed 2026-10-21T16:52:35.992Z Evidence SHA-256 `d1d1c126b1feff70b2bcc20a7adbf380d94c2aaab0704704cb01593d4e1958ff` Source locator `/table/rows/31` | | | | | | | 18 | [O4 Mini](https://benchize.com/models/o4-mini-medium.md)Medium | 84.17% | 95% CI 77.64–90.7% | 0.02usd per problem | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 84.17 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.021 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition brumo--brumo_2025 predicted false Reasoning effort medium sourceModelName o4-mini (medium) sourceModelVersion openai/o4-mini--medium thinkingEnabled true ### Reported statistics Uncertainty 95% confidence interval: 77.64–90.7% confidenceInterval95 6.53 problems 30 ### Source [Original source](https://matharena.ai/competition_tables/brumo--brumo_2025) Source matharena Original model label o4-mini (medium) Source version brumo--brumo_2025 Observed 2026-10-21T16:52:35.992Z Evidence SHA-256 `d1d1c126b1feff70b2bcc20a7adbf380d94c2aaab0704704cb01593d4e1958ff` Source locator `/table/rows/32` | | | | | | | 19 | [Gemini 2.5 Flash](https://benchize.com/models/gemini-2-5-flash-thinking.md)Thinking | 83.33% | 95% CI 76.66–90% | 0.08usd per problem | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 83.33 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.075 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition brumo--brumo_2025 predicted false sourceModelName Gemini 2.5 Flash (Thinking) sourceModelVersion gemini/gemini-flash-2.5 thinkingEnabled true ### Reported statistics Uncertainty 95% confidence interval: 76.66–90% confidenceInterval95 6.67 problems 30 ### Source [Original source](https://matharena.ai/competition_tables/brumo--brumo_2025) Source matharena Original model label Gemini 2.5 Flash (Thinking) Source version brumo--brumo_2025 Observed 2026-10-21T16:52:35.992Z Evidence SHA-256 `d1d1c126b1feff70b2bcc20a7adbf380d94c2aaab0704704cb01593d4e1958ff` Source locator `/table/rows/34` | | | | | | | 20 | [Claude Opus 4](https://benchize.com/models/claude-opus-4.md) | 81.67% | 95% CI 74.75–88.59% | 0.98usd per problem | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 81.67 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.98 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition brumo--brumo_2025 predicted false sourceModelName Claude-Opus-4.0 (Think) sourceModelVersion anthropic/claude-opus-4 ### Reported statistics Uncertainty 95% confidence interval: 74.75–88.59% confidenceInterval95 6.92 problems 30 ### Source [Original source](https://matharena.ai/competition_tables/brumo--brumo_2025) Source matharena Original model label Claude-Opus-4.0 (Think) Source version brumo--brumo_2025 Observed 2026-10-21T16:52:35.992Z Evidence SHA-256 `d1d1c126b1feff70b2bcc20a7adbf380d94c2aaab0704704cb01593d4e1958ff` Source locator `/table/rows/35` | | | | | | | 21 | [GPT-5 Nano](https://benchize.com/models/gpt-5-nano-high.md)High | 80.83% | 95% CI 73.79–87.87% | 0.01usd per problem | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 80.83 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.010 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition brumo--brumo_2025 predicted false Reasoning effort high sourceModelName GPT-5-nano (high) sourceModelVersion openai/gpt-5-nano thinkingEnabled true ### Reported statistics Uncertainty 95% confidence interval: 73.79–87.87% confidenceInterval95 7.04 problems 30 ### Source [Original source](https://matharena.ai/competition_tables/brumo--brumo_2025) Source matharena Original model label GPT-5-nano (high) Source version brumo--brumo_2025 Observed 2026-10-21T16:52:35.992Z Evidence SHA-256 `d1d1c126b1feff70b2bcc20a7adbf380d94c2aaab0704704cb01593d4e1958ff` Source locator `/table/rows/36` | | | | | | | 21 | [DeepSeek R1](https://benchize.com/models/deepseek-r1.md) | 80.83% | 95% CI 73.79–87.87% | 0.02usd per problem | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 80.83 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.020 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition brumo--brumo_2025 predicted false sourceModelName DeepSeek-R1 sourceModelVersion deepseek/deepseek_r1 ### Reported statistics Uncertainty 95% confidence interval: 73.79–87.87% confidenceInterval95 7.04 problems 30 ### Source [Original source](https://matharena.ai/competition_tables/brumo--brumo_2025) Source matharena Original model label DeepSeek-R1 Source version brumo--brumo_2025 Observed 2026-10-21T16:52:35.992Z Evidence SHA-256 `d1d1c126b1feff70b2bcc20a7adbf380d94c2aaab0704704cb01593d4e1958ff` Source locator `/table/rows/37` | | | | | | | 23 | [Qwen3 30B A3B](https://benchize.com/models/qwen3-30b-a3b.md) | 77.5% | 95% CI 70.03–84.97% | 0.004usd per problem | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 77.50 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.004 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition brumo--brumo_2025 predicted false sourceModelName Qwen3-30B-A3B sourceModelVersion qwen/qwen3_30b_a3b ### Reported statistics Uncertainty 95% confidence interval: 70.03–84.97% confidenceInterval95 7.47 problems 30 ### Source [Original source](https://matharena.ai/competition_tables/brumo--brumo_2025) Source matharena Original model label Qwen3-30B-A3B Source version brumo--brumo_2025 Observed 2026-10-21T16:52:35.992Z Evidence SHA-256 `d1d1c126b1feff70b2bcc20a7adbf380d94c2aaab0704704cb01593d4e1958ff` Source locator `/table/rows/38` | | | | | | | 24 | [O4 Mini](https://benchize.com/models/o4-mini-low.md)Low | 66.67% | 95% CI 58.24–75.1% | 0.008usd per problem | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 66.67 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.008 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition brumo--brumo_2025 predicted false Reasoning effort low sourceModelName o4-mini (low) sourceModelVersion openai/o4-mini--low thinkingEnabled true ### Reported statistics Uncertainty 95% confidence interval: 58.24–75.1% confidenceInterval95 8.43 problems 30 ### Source [Original source](https://matharena.ai/competition_tables/brumo--brumo_2025) Source matharena Original model label o4-mini (low) Source version brumo--brumo_2025 Observed 2026-10-21T16:52:35.992Z Evidence SHA-256 `d1d1c126b1feff70b2bcc20a7adbf380d94c2aaab0704704cb01593d4e1958ff` Source locator `/table/rows/42` | | | | | | | 25 | [Grok 3 Mini](https://benchize.com/models/grok-3-mini-low.md)Low | 65.83% | 95% CI 57.34–74.32% | 0.003usd per problem | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 65.83 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.003 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition brumo--brumo_2025 predicted false Reasoning effort low sourceModelName Grok 3 Mini (low) sourceModelVersion xai/grok-3-mini-low thinkingEnabled true ### Reported statistics Uncertainty 95% confidence interval: 57.34–74.32% confidenceInterval95 8.49 problems 30 ### Source [Original source](https://matharena.ai/competition_tables/brumo--brumo_2025) Source matharena Original model label Grok 3 Mini (low) Source version brumo--brumo_2025 Observed 2026-10-21T16:52:35.992Z Evidence SHA-256 `d1d1c126b1feff70b2bcc20a7adbf380d94c2aaab0704704cb01593d4e1958ff` Source locator `/table/rows/43` | | | | | | --- Cite as: BRUMO 2025 — Benchize, https://benchize.com/benchmarks/matharena%3Abrumo--brumo_2025 (retrieved 2026-10-21)