# O4 Mini

> Source: Benchize (https://benchize.com) — https://benchize.com/models/o4-mini. When citing or reusing this content, credit "Benchize" and link to https://benchize.com/models/o4-mini.

OpenAI

Canonical URL: https://benchize.com/models/o4-mini
Last updated: Thu, 22 Oct 2026 07:32:33 GMT

Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations.

OpenAI

## Benchmarks

| Benchmark | Score | ± | Rank | Source |  |
| --- | --- | --- | --- | --- | --- |
| [DesignArena Overall frontend coding](https://benchize.com/benchmarks/designarena%3Acode.md) | 976elo | SE ±8.29 | 109 / 116 | [designarena · public](https://www.designarena.ai/api/leaderboard#board=code) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 976 \| elo \| code \| Higher is better \| ### Configuration arenaType models category allcategories inputModality text sourceModelVersion gpt-o4-mini variationName public ### Reported statistics Uncertainty Standard error: ±8.29 averageGenerationTimeMs 38874 battles 2011 losses 1078 standardError 8.2928 winRate 46.4 wins 933 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=code) Source designarena Original model label o4-mini Source version public Observed 2026-10-21T16:37:57.301Z Evidence SHA-256 `0c897b58670f5e352bd123db999a40c0d1781a443964c502b90774a76a3a7758` Source locator `/data/169` |  |  |  |  |  |
| [Spiral-Bench v1.0](https://benchize.com/benchmarks/eq-bench%3Aspiral-bench-v1.0.md) | 73.3% | CI 73.3–73.3% | 4 / 11 | [eq bench · spiral-bench-v1.0](https://eqbench.com/spiral-bench_v1.0.js) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score_norm` \| 73.3 \| percent \| overall \| Higher is better \| ### Configuration interactiveAdjustments none protocol spiral-bench-v1.0 sourceModelVersion o4-mini ### Reported statistics Uncertainty Confidence interval: 73.3–73.3% confidenceIntervalHigh 73.3 confidenceIntervalLow 73.3 ### Source [Original source](https://eqbench.com/spiral-bench_v1.0.js) Source eq bench Original model label o4-mini Source version spiral-bench-v1.0 Observed 2026-10-22T05:10:07.395Z Evidence SHA-256 `d939ed9ba6d42226765fb4acf3e440127472566e1b5c2894d4ca25baa5ae75d2` Source locator `/leaderboardDataDelusion/11` |  |  |  |  |  |
| [τ-bench telecom (legacy)](https://benchize.com/benchmarks/sierra%3Alegacy%3Atelecom.md) | 50.2% | — | 7 / 10 | [sierra](https://sierra-tau-bench-public.s3.us-west-2.amazonaws.com/submissions/o4-mini_openai_2024-06-20/submission.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `pass_1` \| 50.2 \| percent \| consistent_success_across_k_trials \| Higher is better \| \| `pass_2` \| 42.1 \| percent \| consistent_success_across_k_trials \| Higher is better \| \| `pass_3` \| 36.8 \| percent \| consistent_success_across_k_trials \| Higher is better \| \| `pass_4` \| 32.4 \| percent \| consistent_success_across_k_trials \| Higher is better \| ### Configuration benchmarkVersion 0.1.3 harness tau-bench methodology {"evaluation_date":"2025-06-09","notes":"Original evaluation from tau2-bench paper","tau2_bench_version":"0.1.3","user_simulator":"gpt-4.1-2025-04-14","verification":{"details":"Verified evaluation with full trajectory data available","modified_prompts":false,"omitted_questions":false}} modality text Reasoning effort unknown retrieval Not reported sourceSubmission o4-mini_openai_2024-06-20 ### Source [Original source](https://sierra-tau-bench-public.s3.us-west-2.amazonaws.com/submissions/o4-mini_openai_2024-06-20/submission.json) Source sierra Original model label o4-mini Evaluated 2025-06-09 Observed 2026-10-21T16:55:02.503Z Evidence SHA-256 `9cfd165d23c1500b6413af7ceb48b64a0fb672ce15e6069a12a36fd54e92bade` Source locator `/results/telecom` |  |  |  |  |  |
| [τ-bench retail (legacy)](https://benchize.com/benchmarks/sierra%3Alegacy%3Aretail.md) | 68.3% | — | 13 / 14 | [sierra](https://sierra-tau-bench-public.s3.us-west-2.amazonaws.com/submissions/o4-mini_openai_2024-06-20/submission.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `pass_1` \| 68.3 \| percent \| consistent_success_across_k_trials \| Higher is better \| \| `pass_2` \| 58.7 \| percent \| consistent_success_across_k_trials \| Higher is better \| \| `pass_3` \| 52.1 \| percent \| consistent_success_across_k_trials \| Higher is better \| \| `pass_4` \| 46.8 \| percent \| consistent_success_across_k_trials \| Higher is better \| ### Configuration benchmarkVersion 0.1.3 harness tau-bench methodology {"evaluation_date":"2025-06-09","notes":"Original evaluation from tau2-bench paper","tau2_bench_version":"0.1.3","user_simulator":"gpt-4.1-2025-04-14","verification":{"details":"Verified evaluation with full trajectory data available","modified_prompts":false,"omitted_questions":false}} modality text Reasoning effort unknown retrieval Not reported sourceSubmission o4-mini_openai_2024-06-20 ### Source [Original source](https://sierra-tau-bench-public.s3.us-west-2.amazonaws.com/submissions/o4-mini_openai_2024-06-20/submission.json) Source sierra Original model label o4-mini Evaluated 2025-06-09 Observed 2026-10-21T16:55:02.503Z Evidence SHA-256 `9cfd165d23c1500b6413af7ceb48b64a0fb672ce15e6069a12a36fd54e92bade` Source locator `/results/retail` |  |  |  |  |  |
| [SWE-bench Verified](https://benchize.com/benchmarks/swe-bench%3Averified.md) | 45% | — | 46 / 63 | [SWE-bench](https://www.swebench.com/) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `resolved` \| 45 \| percent \| verified \| Higher is better \| ### Configuration agent mini-SWE-agent agentOrganization SWE-agent models ["o4-mini-20250416"] Reasoning effort Not reported sourceSubmission 20250726_mini-v1.0.0_o4-mini-2025-04-16 subset Verified system ["System: Attempts - 1"] ### Reported statistics instanceCalls 23.278 instanceCost 0.2099733328 sourceWarning Not reported ### Source [Original source](https://www.swebench.com/) Source SWE-bench Original model label o4-mini Observed 2026-10-22T02:30:05.773Z Evidence SHA-256 `c862011a4ee1d1a7199fad6ca0905fa5c64f58216f7217ac1eddf37f28788433` Source locator `/leaderboard-data/2/results/122` |  |  |  |  |  |
| [DesignArena UI component generation](https://benchize.com/benchmarks/designarena%3Aui-components.md) | 983elo | — | 101 / 112 | [designarena · public](https://www.designarena.ai/api/leaderboard#board=ui-components) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 983 \| elo \| ui-components \| Higher is better \| ### Configuration arenaType models category uicomponent inputModality Not reported sourceModelVersion gpt-o4-mini variationName public ### Reported statistics averageGenerationTimeMs 46035 battles 147 losses 78 standardError Not reported winRate 46.9 wins 69 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=ui-components) Source designarena Original model label o4-mini Source version public Observed 2026-10-21T16:37:57.993Z Evidence SHA-256 `46482ec1b4012638eace65493daea4750e2088098018fd9d5fc46126fc1f8557` Source locator `/data/156` |  |  |  |  |  |
| [DesignArena Website generation](https://benchize.com/benchmarks/designarena%3Awebsite.md) | 985elo | — | 112 / 123 | [designarena · public](https://www.designarena.ai/api/leaderboard#board=website) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 985 \| elo \| website \| Higher is better \| ### Configuration arenaType models category website inputModality text sourceModelVersion gpt-o4-mini variationName public ### Reported statistics averageGenerationTimeMs 40558 battles 1328 losses 702 standardError Not reported winRate 47.1 wins 626 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=website) Source designarena Original model label o4-mini Source version public Observed 2026-10-21T16:37:57.757Z Evidence SHA-256 `51873e97776a3c5ae706b24cc2c60384793dd18398df970e213a8e7c276d8ac0` Source locator `/data/175` |  |  |  |  |  |
| [Spiral-Bench v1.2](https://benchize.com/benchmarks/eq-bench%3Aspiral-bench-v1.2.md) | 53.6% | CI 53.6–53.6% | 6 / 16 | [eq bench · spiral-bench-v1.2](https://eqbench.com/spiral-bench.js) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score_norm` \| 53.6 \| percent \| overall \| Higher is better \| ### Configuration interactiveAdjustments none protocol spiral-bench-v1.2 sourceModelVersion o4-mini ### Reported statistics Uncertainty Confidence interval: 53.6–53.6% confidenceIntervalHigh 53.6 confidenceIntervalLow 53.6 ### Source [Original source](https://eqbench.com/spiral-bench.js) Source eq bench Original model label o4-mini Source version spiral-bench-v1.2 Observed 2026-10-22T05:10:07.179Z Evidence SHA-256 `2f0402654b01e7363c0d02bbc708afd7849e669dc5da63d9f85c995ed8f0a97f` Source locator `/leaderboardDataDelusion/17` |  |  |  |  |  |
| [DesignArena Data visualization generation](https://benchize.com/benchmarks/designarena%3Adata-viz.md) | 991elo | — | 95 / 99 | [designarena · public](https://www.designarena.ai/api/leaderboard#board=data-viz) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 991 \| elo \| data-viz \| Higher is better \| ### Configuration arenaType models category dataviz inputModality Not reported sourceModelVersion gpt-o4-mini variationName public ### Reported statistics averageGenerationTimeMs 29181 battles 100 losses 50 standardError Not reported winRate 50 wins 50 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=data-viz) Source designarena Original model label o4-mini Source version public Observed 2026-10-21T16:37:58.264Z Evidence SHA-256 `a895f6f1a25fa8eb01f821c2097ddec4f884de7bd22f1b8a22e82e6679b71849` Source locator `/data/143` |  |  |  |  |  |
| [PRBench Finance](https://benchize.com/benchmarks/scale%3Aprbench-finance.md) | 39.22source score | CI 38.7–39.73 | 17 / 22 | [scale](https://labs.scale.com/leaderboard/prbench-finance) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 39.21552546 \| source_score \| reported \| Higher is better \| ### Configuration Reasoning effort unknown Model configuration o4-mini sourceModelVersion Not reported thinkingEnabled Not reported ### Reported statistics Uncertainty Confidence interval: 38.7–39.73 contaminationWarning Not reported rank 27 reportedConfidenceHalfWidth 0.5144083467 ### Source [Original source](https://labs.scale.com/leaderboard/prbench-finance) Source scale Original model label o4-mini Observed 2026-10-22T03:30:10.417Z Evidence SHA-256 `52572a2526d41cba3e52146e6063412a3850897b7608a0745f62baae712ab29b` Source locator `/rows/26` |  |  |  |  |  |
| [EQ-Bench 3](https://benchize.com/benchmarks/eq-bench%3Aeqbench3.md) | 1,232.8elo | CI 1,208.3–1,257.3 | 29 / 50 | [eq bench · eqbench3](https://eqbench.com/eqbench3.js) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo_norm` \| 1232.8 \| elo \| overall \| Higher is better \| \| `rubric_0_100` \| 59.4 \| percent \| overall \| Higher is better \| ### Configuration interactiveAdjustments none protocol eqbench3 sourceModelVersion o4-mini ### Reported statistics Uncertainty Confidence interval: 1,208.3–1,257.3 confidenceIntervalHigh 1257.3 confidenceIntervalLow 1208.3 ### Source [Original source](https://eqbench.com/eqbench3.js) Source eq bench Original model label o4-mini Source version eqbench3 Observed 2026-10-22T05:10:04.922Z Evidence SHA-256 `3672ff093e739f07ff664a2e6013bc38a6977a146e4092b4cef80ba1780542b2` Source locator `/leaderboardDataEQBench3/39` |  |  |  |  |  |
| [DesignArena Browser game generation](https://benchize.com/benchmarks/designarena%3Agame-dev.md) | 1,003elo | — | 103 / 117 | [designarena · public](https://www.designarena.ai/api/leaderboard#board=game-dev) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 1003 \| elo \| game-dev \| Higher is better \| ### Configuration arenaType models category gamedev inputModality Not reported sourceModelVersion gpt-o4-mini variationName public ### Reported statistics averageGenerationTimeMs 35801 battles 248 losses 124 standardError Not reported winRate 50 wins 124 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=game-dev) Source designarena Original model label o4-mini Source version public Observed 2026-10-21T16:38:01.100Z Evidence SHA-256 `53db6a89112ce8cdf644568c666d4b8309aece764cfcedb291ffd52ae3934e30` Source locator `/data/156` |  |  |  |  |  |
| [SVGBench Arena](https://benchize.com/benchmarks/svgbench%3Aarena.md) | 1,502 | — | 66 / 191 | [svgbench](https://svgbench.ai/api/leaderboard?shape=2) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1502 \| rating \| reported \| Higher is better \| ### Configuration Reasoning effort unknown sourceModelId model_openai_o4_mini ### Reported statistics coverageCount 27 draws 1 judged 62 losses 27 rank 87 ratingDeviation 28 wins 34 ### Source [Original source](https://svgbench.ai/api/leaderboard?shape=2) Source svgbench Original model label o4 Mini Observed 2026-10-22T04:30:04.538Z Evidence SHA-256 `5c0a9c869593820d57d2c05f6d416e1b44a740b4835e66c66e9ad8b8edc59e2c` Source locator `/rows/84` |  |  |  |  |  |
| [τ-bench airline (legacy)](https://benchize.com/benchmarks/sierra%3Alegacy%3Aairline.md) | 52.1% | — | 12 / 14 | [sierra](https://sierra-tau-bench-public.s3.us-west-2.amazonaws.com/submissions/o4-mini_openai_2024-06-20/submission.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `pass_1` \| 52.1 \| percent \| consistent_success_across_k_trials \| Higher is better \| \| `pass_2` \| 44.2 \| percent \| consistent_success_across_k_trials \| Higher is better \| \| `pass_3` \| 38.9 \| percent \| consistent_success_across_k_trials \| Higher is better \| \| `pass_4` \| 34.7 \| percent \| consistent_success_across_k_trials \| Higher is better \| ### Configuration benchmarkVersion 0.1.3 harness tau-bench methodology {"evaluation_date":"2025-06-09","notes":"Original evaluation from tau2-bench paper","tau2_bench_version":"0.1.3","user_simulator":"gpt-4.1-2025-04-14","verification":{"details":"Verified evaluation with full trajectory data available","modified_prompts":false,"omitted_questions":false}} modality text Reasoning effort unknown retrieval Not reported sourceSubmission o4-mini_openai_2024-06-20 ### Source [Original source](https://sierra-tau-bench-public.s3.us-west-2.amazonaws.com/submissions/o4-mini_openai_2024-06-20/submission.json) Source sierra Original model label o4-mini Evaluated 2025-06-09 Observed 2026-10-21T16:55:02.503Z Evidence SHA-256 `9cfd165d23c1500b6413af7ceb48b64a0fb672ce15e6069a12a36fd54e92bade` Source locator `/results/airline` |  |  |  |  |  |
| [Fortress](https://benchize.com/benchmarks/scale%3Afortress.md) | 21.49source score | CI 18.43–24.55 | 18 / 31 | [scale](https://labs.scale.com/leaderboard/fortress) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 21.49 \| source_score \| reported \| Higher is better \| ### Configuration Reasoning effort unknown Model configuration o4-mini sourceModelVersion Not reported thinkingEnabled Not reported ### Reported statistics Uncertainty Confidence interval: 18.43–24.55 contaminationWarning ORS score: 5.14 rank 33 reportedConfidenceHalfWidth 3.06 ### Source [Original source](https://labs.scale.com/leaderboard/fortress) Source scale Original model label o4-mini Observed 2026-10-22T03:30:12.378Z Evidence SHA-256 `2c005102a7346206e5d31d9249d525620bef39f6d514668ed48398e710616b0f` Source locator `/rows/32` |  |  |  |  |  |
| [DesignArena 3D design generation](https://benchize.com/benchmarks/designarena%3A3d-design.md) | 854elo | — | 108 / 110 | [designarena · public](https://www.designarena.ai/api/leaderboard#board=3d-design) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 854 \| elo \| 3d-design \| Higher is better \| ### Configuration arenaType models category 3d inputModality Not reported sourceModelVersion gpt-o4-mini variationName public ### Reported statistics averageGenerationTimeMs 30587 battles 188 losses 124 standardError Not reported winRate 34 wins 64 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=3d-design) Source designarena Original model label o4-mini Source version public Observed 2026-10-21T16:37:58.515Z Evidence SHA-256 `bcc0267f7bc7e9ec112306b3a35413cf78bbccbfaa838356232d5d5ed0b83d0f` Source locator `/data/164` |  |  |  |  |  |
| [Judgemark v2.1](https://benchize.com/benchmarks/eq-bench%3Ajudgemark-v2.md) | 56.1% | — | 33 / 39 | [eq bench · judgemark-v2](https://eqbench.com/judgemark-v2.js) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `judgemark_score` \| 56.1 \| percent \| overall \| Higher is better \| \| `stability` \| 0.455 \| score_fraction \| overall \| Higher is better \| \| `separability` \| 0.594 \| score_fraction \| overall \| Higher is better \| \| `human_corr` \| 0.533 \| correlation \| overall \| Higher is better \| ### Configuration interactiveAdjustments none protocol judgemark-v2 sourceModelVersion o4-mini ### Source [Original source](https://eqbench.com/judgemark-v2.js) Source eq bench Original model label o4-mini Source version judgemark-v2 Observed 2026-10-22T05:10:06.632Z Evidence SHA-256 `070cc3fbd6f0333dde2b52bec4329ea3fba7eccbf016bbbbef95e0f8b2197781` Source locator `/leaderboardDataV2/20` |  |  |  |  |  |
| [SWE-bench Multimodal](https://benchize.com/benchmarks/swe-bench%3Amultimodal.md) | 33.85% | — | 4 / 14 | [SWE-bench](https://www.swebench.com/) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `resolved` \| 33.85 \| percent \| multimodal \| Higher is better \| ### Configuration agent GUIRepair agentOrganization GUIRepair models ["o4-mini-2025-04-16"] Reasoning effort Not reported sourceSubmission 20250531_GUIRepair_o4mini subset Multimodal system ["System: Attempts - 1"] ### Source [Original source](https://www.swebench.com/) Source SWE-bench Original model label o4-mini Observed 2026-10-22T02:30:05.773Z Evidence SHA-256 `c862011a4ee1d1a7199fad6ca0905fa5c64f58216f7217ac1eddf37f28788433` Source locator `/leaderboard-data/4/results/4` |  |  |  |  |  |
| [PRBench Legal](https://benchize.com/benchmarks/scale%3Aprbench-legal.md) | 38.11source score | CI 37.43–38.8 | 23 / 26 | [scale](https://labs.scale.com/leaderboard/prbench-legal) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 38.11371849 \| source_score \| reported \| Higher is better \| ### Configuration Reasoning effort unknown Model configuration o4-mini sourceModelVersion Not reported thinkingEnabled Not reported ### Reported statistics Uncertainty Confidence interval: 37.43–38.8 contaminationWarning Not reported rank 36 reportedConfidenceHalfWidth 0.6861079648 ### Source [Original source](https://labs.scale.com/leaderboard/prbench-legal) Source scale Original model label o4-mini Observed 2026-10-22T03:30:10.599Z Evidence SHA-256 `c086b601b5cff78b7934cfbcf79f15db48cd423c4e62e56a185b447b03c28f3c` Source locator `/rows/35` |  |  |  |  |  |
| [SWE-bench Verified](https://benchize.com/benchmarks/swe-bench%3Averified.md) | 64.6% | — | 20 / 63 | [SWE-bench](https://www.swebench.com/) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `resolved` \| 64.6 \| percent \| verified \| Higher is better \| ### Configuration agent PatchPilot-v1.1 agentOrganization Not reported models ["o4-mini"] Reasoning effort Not reported sourceSubmission 20250503_patchpilot-v1.1-o4-mini subset Verified system ["System: Attempts - 2+"] ### Source [Original source](https://www.swebench.com/) Source SWE-bench Original model label o4-mini Observed 2026-10-22T02:30:05.773Z Evidence SHA-256 `c862011a4ee1d1a7199fad6ca0905fa5c64f58216f7217ac1eddf37f28788433` Source locator `/leaderboard-data/2/results/64` |  |  |  |  |  |
| [NC Bench](https://benchize.com/benchmarks/nc-bench%3Aoverall.md) | 86.56% | — | 88 / 144 | [nc bench](https://www.nc-bench.com/models) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 86.56 \| percent \| reported \| Higher is better \| \| `tooling` \| 100 \| percent \| category \| Higher is better \| \| `creative_writing` \| 82.04 \| percent \| category \| Higher is better \| \| `language` \| 80 \| percent \| category \| Higher is better \| \| `utility` \| 96.31 \| percent \| category \| Higher is better \| \| `reasoning` \| 80.39 \| percent \| category \| Higher is better \| \| `text_editing` \| 90.61 \| percent \| category \| Higher is better \| \| `rule_following` \| 64.61 \| percent \| category \| Higher is better \| \| `hallucination` \| 98.54 \| percent \| category \| Higher is better \| ### Configuration Reasoning effort unknown Model configuration o4 Mini thinkingEnabled Not reported ### Source [Original source](https://www.nc-bench.com/models) Source nc bench Original model label o4 Mini Observed 2026-10-22T06:10:03.426Z Evidence SHA-256 `ec261022458543624b08a136d01f5a2f0666cd52ffb49c64d6ca983e8543d1b5` Source locator `/rows/113` |  |  |  |  |  |

---
Cite as: O4 Mini — Benchize, https://benchize.com/models/o4-mini (retrieved 2026-10-22)
