# GPT-4.1 Mini

> Source: Benchize (https://benchize.com) — https://benchize.com/models/gpt-4-1-mini. When citing or reusing this content, credit "Benchize" and link to https://benchize.com/models/gpt-4-1-mini.

OpenAI

Canonical URL: https://benchize.com/models/gpt-4-1-mini
Last updated: Thu, 22 Oct 2026 07:32:33 GMT

Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations.

OpenAI

## Benchmarks

| Benchmark | Score | ± | Rank | Cost | Source |  |
| --- | --- | --- | --- | --- | --- | --- |
| [ARC-AGI-2](https://benchize.com/benchmarks/arc-prize%3Av2_Semi_Private.md) | 0% | — | 231 / 243 | 0.01usd per task | [arc prize · v2](https://arcprize.org/media/data/leaderboard/v2.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0 \| score_fraction \| v2_Semi_Private \| Higher is better \| \| `cost_per_task` \| 0.0139 \| usd_per_task \| v2_Semi_Private \| Lower is better \| ### Configuration evaluationSplit v2_Semi_Private harness Not reported modelGroup gpt-4.1 modelType Base LLM sourceModelVersion gpt-4-1-mini-2025-04-14 ### Source [Original source](https://arcprize.org/media/data/leaderboard/v2.json) Source arc prize Original model label GPT-4.1-Mini Source version v2 Observed 2026-10-22T05:20:04.306Z Evidence SHA-256 `4351eb696e78113b0459e9bb5f0258318b905efef34f473dcea51ce641b0d94d` Source locator `/evaluations/18` |  |  |  |  |  |  |
| [EQ-Bench 3](https://benchize.com/benchmarks/eq-bench%3Aeqbench3.md) | 1,099.3elo | CI 1,072.4–1,126.3 | 33 / 50 | — | [eq bench · eqbench3](https://eqbench.com/eqbench3.js) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo_norm` \| 1099.3 \| elo \| overall \| Higher is better \| \| `rubric_0_100` \| 56.2 \| percent \| overall \| Higher is better \| ### Configuration interactiveAdjustments none protocol eqbench3 sourceModelVersion gpt-4.1-mini ### Reported statistics Uncertainty Confidence interval: 1,072.4–1,126.3 confidenceIntervalHigh 1126.3 confidenceIntervalLow 1072.4 ### Source [Original source](https://eqbench.com/eqbench3.js) Source eq bench Original model label gpt-4.1-mini Source version eqbench3 Observed 2026-10-22T05:10:04.922Z Evidence SHA-256 `3672ff093e739f07ff664a2e6013bc38a6977a146e4092b4cef80ba1780542b2` Source locator `/leaderboardDataEQBench3/50` |  |  |  |  |  |  |
| [Judgemark v2.1](https://benchize.com/benchmarks/eq-bench%3Ajudgemark-v2.md) | 57.26% | — | 31 / 39 | — | [eq bench · judgemark-v2](https://eqbench.com/judgemark-v2.js) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `judgemark_score` \| 57.26 \| percent \| overall \| Higher is better \| \| `stability` \| 0.395 \| score_fraction \| overall \| Higher is better \| \| `separability` \| 0.623 \| score_fraction \| overall \| Higher is better \| \| `human_corr` \| 0.548 \| correlation \| overall \| Higher is better \| ### Configuration interactiveAdjustments none protocol judgemark-v2 sourceModelVersion gpt-4.1-mini ### Source [Original source](https://eqbench.com/judgemark-v2.js) Source eq bench Original model label gpt-4.1-mini Source version judgemark-v2 Observed 2026-10-22T05:10:06.632Z Evidence SHA-256 `070cc3fbd6f0333dde2b52bec4329ea3fba7eccbf016bbbbef95e0f8b2197781` Source locator `/leaderboardDataV2/17` |  |  |  |  |  |  |
| [PRBench Finance](https://benchize.com/benchmarks/scale%3Aprbench-finance.md) | 30.45source score | CI 30.02–30.87 | 22 / 22 | — | [scale](https://labs.scale.com/leaderboard/prbench-finance) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 30.44630977 \| source_score \| reported \| Higher is better \| ### Configuration Reasoning effort unknown Model configuration gpt-4.1-mini sourceModelVersion Not reported thinkingEnabled Not reported ### Reported statistics Uncertainty Confidence interval: 30.02–30.87 contaminationWarning Not reported rank 37 reportedConfidenceHalfWidth 0.4235883476 ### Source [Original source](https://labs.scale.com/leaderboard/prbench-finance) Source scale Original model label gpt-4.1-mini Observed 2026-10-22T03:30:10.417Z Evidence SHA-256 `52572a2526d41cba3e52146e6063412a3850897b7608a0745f62baae712ab29b` Source locator `/rows/36` |  |  |  |  |  |  |
| [DesignArena Browser game generation](https://benchize.com/benchmarks/designarena%3Agame-dev.md) | 1,071elo | — | 94 / 117 | — | [designarena · public](https://www.designarena.ai/api/leaderboard#board=game-dev) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 1071 \| elo \| game-dev \| Higher is better \| ### Configuration arenaType models category gamedev inputModality Not reported sourceModelVersion gpt-4.1-mini variationName public ### Reported statistics averageGenerationTimeMs 86601 battles 224 losses 93 standardError Not reported winRate 58.5 wins 131 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=game-dev) Source designarena Original model label GPT-4.1 mini Source version public Observed 2026-10-21T16:38:01.100Z Evidence SHA-256 `53db6a89112ce8cdf644568c666d4b8309aece764cfcedb291ffd52ae3934e30` Source locator `/data/140` |  |  |  |  |  |  |
| [DesignArena Website generation](https://benchize.com/benchmarks/designarena%3Awebsite.md) | 997elo | — | 111 / 123 | — | [designarena · public](https://www.designarena.ai/api/leaderboard#board=website) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 997 \| elo \| website \| Higher is better \| ### Configuration arenaType models category website inputModality text sourceModelVersion gpt-4.1-mini variationName public ### Reported statistics averageGenerationTimeMs 70415 battles 956 losses 499 standardError Not reported winRate 47.8 wins 457 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=website) Source designarena Original model label GPT-4.1 mini Source version public Observed 2026-10-21T16:37:57.757Z Evidence SHA-256 `51873e97776a3c5ae706b24cc2c60384793dd18398df970e213a8e7c276d8ac0` Source locator `/data/172` |  |  |  |  |  |  |
| [SWE-bench Verified](https://benchize.com/benchmarks/swe-bench%3Averified.md) | 23.94% | — | 58 / 63 | — | [SWE-bench](https://www.swebench.com/) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `resolved` \| 23.94 \| percent \| verified \| Higher is better \| ### Configuration agent mini-SWE-agent agentOrganization SWE-agent models ["gpt-4.1-mini-20250414"] Reasoning effort Not reported sourceSubmission 20250720_mini-v0.0.0_gpt-4.1-mini-2025-04-14 subset Verified system ["System: Attempts - 1"] ### Reported statistics instanceCalls 89.196 instanceCost 0.43515415279999997 sourceWarning Not reported ### Source [Original source](https://www.swebench.com/) Source SWE-bench Original model label GPT 4.1 mini Observed 2026-10-22T02:30:05.773Z Evidence SHA-256 `c862011a4ee1d1a7199fad6ca0905fa5c64f58216f7217ac1eddf37f28788433` Source locator `/leaderboard-data/2/results/162` |  |  |  |  |  |  |
| [Creative Writing v3](https://benchize.com/benchmarks/eq-bench%3Acreative-writing-v3.md) | 1,147elo | — | 71 / 90 | — | [eq bench · creative-writing-v3](https://eqbench.com/creative_writing.js) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo_score` \| 1147.0 \| elo \| overall \| Higher is better \| \| `creative_writing_score` \| 13.67 \| rubric_score \| overall \| Higher is better \| ### Configuration interactiveAdjustments none protocol creative-writing-v3 sourceModelVersion gpt-4.1-mini ### Source [Original source](https://eqbench.com/creative_writing.js) Source eq bench Original model label gpt-4.1-mini Source version creative-writing-v3 Observed 2026-10-22T05:10:05.433Z Evidence SHA-256 `722ddb132e8d3a5e5c39b8d445f8475f3f7e24893a007260c6f3e3cce5c1ee18` Source locator `/leaderboardDataCreativeWritingV3/103` |  |  |  |  |  |  |
| [DesignArena 3D design generation](https://benchize.com/benchmarks/designarena%3A3d-design.md) | 837elo | — | 110 / 110 | — | [designarena · public](https://www.designarena.ai/api/leaderboard#board=3d-design) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 837 \| elo \| 3d-design \| Higher is better \| ### Configuration arenaType models category 3d inputModality Not reported sourceModelVersion gpt-4.1-mini variationName public ### Reported statistics averageGenerationTimeMs 61716 battles 151 losses 105 standardError Not reported winRate 30.5 wins 46 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=3d-design) Source designarena Original model label GPT-4.1 mini Source version public Observed 2026-10-21T16:37:58.515Z Evidence SHA-256 `bcc0267f7bc7e9ec112306b3a35413cf78bbccbfaa838356232d5d5ed0b83d0f` Source locator `/data/166` |  |  |  |  |  |  |
| [SVGBench Arena](https://benchize.com/benchmarks/svgbench%3Aarena.md) | 1,414 | — | 99 / 191 | — | [svgbench](https://svgbench.ai/api/leaderboard?shape=2) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1414 \| rating \| reported \| Higher is better \| ### Configuration Reasoning effort unknown sourceModelId model_openai_gpt_4_1_mini ### Reported statistics coverageCount 27 draws 3 judged 91 losses 42 rank 139 ratingDeviation 28 wins 46 ### Source [Original source](https://svgbench.ai/api/leaderboard?shape=2) Source svgbench Original model label GPT-4.1 Mini Observed 2026-10-22T04:30:04.538Z Evidence SHA-256 `5c0a9c869593820d57d2c05f6d416e1b44a740b4835e66c66e9ad8b8edc59e2c` Source locator `/rows/135` |  |  |  |  |  |  |
| [τ-bench airline (legacy)](https://benchize.com/benchmarks/sierra%3Alegacy%3Aairline.md) | 48.7% | — | 14 / 14 | — | [sierra](https://sierra-tau-bench-public.s3.us-west-2.amazonaws.com/submissions/gpt-4-1-mini_openai_2024-06-20/submission.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `pass_1` \| 48.7 \| percent \| consistent_success_across_k_trials \| Higher is better \| \| `pass_2` \| 38.9 \| percent \| consistent_success_across_k_trials \| Higher is better \| \| `pass_3` \| 32.1 \| percent \| consistent_success_across_k_trials \| Higher is better \| \| `pass_4` \| 27.8 \| percent \| consistent_success_across_k_trials \| Higher is better \| ### Configuration benchmarkVersion 0.1.3 harness tau-bench methodology {"evaluation_date":"2025-06-09","notes":"Original evaluation from tau2-bench paper","tau2_bench_version":"0.1.3","user_simulator":"gpt-4.1-2025-04-14","verification":{"details":"Verified evaluation with full trajectory data available","modified_prompts":false,"omitted_questions":false}} modality text Reasoning effort unknown retrieval Not reported sourceSubmission gpt-4-1-mini_openai_2024-06-20 ### Source [Original source](https://sierra-tau-bench-public.s3.us-west-2.amazonaws.com/submissions/gpt-4-1-mini_openai_2024-06-20/submission.json) Source sierra Original model label GPT-4.1-mini Evaluated 2025-06-09 Observed 2026-10-21T16:55:01.756Z Evidence SHA-256 `2a86f83f6bfeff5b02015c9d7471602bcfd5fb732ef66f55f1fac4dcab20dff4` Source locator `/results/airline` |  |  |  |  |  |  |
| [MASK](https://benchize.com/benchmarks/scale%3Amask.md) | 50source score | CI 47.83–52.17 | 16 / 25 | — | [scale](https://labs.scale.com/leaderboard/mask) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 50 \| source_score \| reported \| Higher is better \| ### Configuration Reasoning effort unknown Model configuration GPT-4.1 mini sourceModelVersion gpt-4.1-mini-2025-04-14 thinkingEnabled Not reported ### Reported statistics Uncertainty Confidence interval: 47.83–52.17 contaminationWarning Potential contamination warning: This model was evaluated after the public release of MASK, allowing model builder access to the prompts and solutions. rank 51 reportedConfidenceHalfWidth 2.17 ### Source [Original source](https://labs.scale.com/leaderboard/mask) Source scale Original model label GPT-4.1 mini Observed 2026-10-22T03:30:12.706Z Evidence SHA-256 `fe1699303dff9a092aff10128cfc39d63ddc0680c0d241345fa747c450597b67` Source locator `/rows/50` |  |  |  |  |  |  |
| [NC Bench](https://benchize.com/benchmarks/nc-bench%3Aoverall.md) | 81.4% | — | 121 / 144 | — | [nc bench](https://www.nc-bench.com/models) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 81.4 \| percent \| reported \| Higher is better \| \| `tooling` \| 96.94 \| percent \| category \| Higher is better \| \| `creative_writing` \| 74.52 \| percent \| category \| Higher is better \| \| `language` \| 89.64 \| percent \| category \| Higher is better \| \| `utility` \| 82.3 \| percent \| category \| Higher is better \| \| `reasoning` \| 67.35 \| percent \| category \| Higher is better \| \| `text_editing` \| 95.62 \| percent \| category \| Higher is better \| \| `rule_following` \| 58.59 \| percent \| category \| Higher is better \| \| `hallucination` \| 86.23 \| percent \| category \| Higher is better \| ### Configuration Reasoning effort unknown Model configuration GPT-4.1 Mini thinkingEnabled Not reported ### Source [Original source](https://www.nc-bench.com/models) Source nc bench Original model label GPT-4.1 Mini Observed 2026-10-22T06:10:03.426Z Evidence SHA-256 `ec261022458543624b08a136d01f5a2f0666cd52ffb49c64d6ca983e8543d1b5` Source locator `/rows/158` |  |  |  |  |  |  |
| [VISTA](https://benchize.com/benchmarks/scale%3Avisual_language_understanding.md) | 41.14source score | CI 40.56–41.72 | 9 / 16 | — | [scale](https://labs.scale.com/leaderboard/visual_language_understanding) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 41.14 \| source_score \| reported \| Higher is better \| ### Configuration Reasoning effort unknown Model configuration GPT-4.1 mini sourceModelVersion Not reported thinkingEnabled Not reported ### Reported statistics Uncertainty Confidence interval: 40.56–41.72 contaminationWarning Not reported rank 41 reportedConfidenceHalfWidth 0.58 ### Source [Original source](https://labs.scale.com/leaderboard/visual_language_understanding) Source scale Original model label GPT-4.1 mini Observed 2026-10-22T03:30:13.295Z Evidence SHA-256 `d373f192d42603b3d2b7b0b509c801be37a4fd65b7c73742f980d9f2f0a4e668` Source locator `/rows/40` |  |  |  |  |  |  |
| [DesignArena UI component generation](https://benchize.com/benchmarks/designarena%3Aui-components.md) | 961elo | — | 103 / 112 | — | [designarena · public](https://www.designarena.ai/api/leaderboard#board=ui-components) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 961 \| elo \| ui-components \| Higher is better \| ### Configuration arenaType models category uicomponent inputModality Not reported sourceModelVersion gpt-4.1-mini variationName public ### Reported statistics averageGenerationTimeMs 64589 battles 172 losses 94 standardError Not reported winRate 45.4 wins 78 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=ui-components) Source designarena Original model label GPT-4.1 mini Source version public Observed 2026-10-21T16:37:57.993Z Evidence SHA-256 `46482ec1b4012638eace65493daea4750e2088098018fd9d5fc46126fc1f8557` Source locator `/data/159` |  |  |  |  |  |  |
| [PRBench Legal](https://benchize.com/benchmarks/scale%3Aprbench-legal.md) | 30.38source score | CI 29.82–30.93 | 26 / 26 | — | [scale](https://labs.scale.com/leaderboard/prbench-legal) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 30.37525441 \| source_score \| reported \| Higher is better \| ### Configuration Reasoning effort unknown Model configuration gpt-4.1-mini sourceModelVersion Not reported thinkingEnabled Not reported ### Reported statistics Uncertainty Confidence interval: 29.82–30.93 contaminationWarning Not reported rank 42 reportedConfidenceHalfWidth 0.552024228 ### Source [Original source](https://labs.scale.com/leaderboard/prbench-legal) Source scale Original model label gpt-4.1-mini Observed 2026-10-22T03:30:10.599Z Evidence SHA-256 `c086b601b5cff78b7934cfbcf79f15db48cd423c4e62e56a185b447b03c28f3c` Source locator `/rows/41` |  |  |  |  |  |  |
| [τ-bench telecom (legacy)](https://benchize.com/benchmarks/sierra%3Alegacy%3Atelecom.md) | 48.9% | — | 9 / 10 | — | [sierra](https://sierra-tau-bench-public.s3.us-west-2.amazonaws.com/submissions/gpt-4-1-mini_openai_2024-06-20/submission.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `pass_1` \| 48.9 \| percent \| consistent_success_across_k_trials \| Higher is better \| \| `pass_2` \| 38.7 \| percent \| consistent_success_across_k_trials \| Higher is better \| \| `pass_3` \| 31.2 \| percent \| consistent_success_across_k_trials \| Higher is better \| \| `pass_4` \| 26.1 \| percent \| consistent_success_across_k_trials \| Higher is better \| ### Configuration benchmarkVersion 0.1.3 harness tau-bench methodology {"evaluation_date":"2025-06-09","notes":"Original evaluation from tau2-bench paper","tau2_bench_version":"0.1.3","user_simulator":"gpt-4.1-2025-04-14","verification":{"details":"Verified evaluation with full trajectory data available","modified_prompts":false,"omitted_questions":false}} modality text Reasoning effort unknown retrieval Not reported sourceSubmission gpt-4-1-mini_openai_2024-06-20 ### Source [Original source](https://sierra-tau-bench-public.s3.us-west-2.amazonaws.com/submissions/gpt-4-1-mini_openai_2024-06-20/submission.json) Source sierra Original model label GPT-4.1-mini Evaluated 2025-06-09 Observed 2026-10-21T16:55:01.756Z Evidence SHA-256 `2a86f83f6bfeff5b02015c9d7471602bcfd5fb732ef66f55f1fac4dcab20dff4` Source locator `/results/telecom` |  |  |  |  |  |  |
| [τ-bench retail (legacy)](https://benchize.com/benchmarks/sierra%3Alegacy%3Aretail.md) | 61.4% | — | 14 / 14 | — | [sierra](https://sierra-tau-bench-public.s3.us-west-2.amazonaws.com/submissions/gpt-4-1-mini_openai_2024-06-20/submission.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `pass_1` \| 61.4 \| percent \| consistent_success_across_k_trials \| Higher is better \| \| `pass_2` \| 49.8 \| percent \| consistent_success_across_k_trials \| Higher is better \| \| `pass_3` \| 42.3 \| percent \| consistent_success_across_k_trials \| Higher is better \| \| `pass_4` \| 36.9 \| percent \| consistent_success_across_k_trials \| Higher is better \| ### Configuration benchmarkVersion 0.1.3 harness tau-bench methodology {"evaluation_date":"2025-06-09","notes":"Original evaluation from tau2-bench paper","tau2_bench_version":"0.1.3","user_simulator":"gpt-4.1-2025-04-14","verification":{"details":"Verified evaluation with full trajectory data available","modified_prompts":false,"omitted_questions":false}} modality text Reasoning effort unknown retrieval Not reported sourceSubmission gpt-4-1-mini_openai_2024-06-20 ### Source [Original source](https://sierra-tau-bench-public.s3.us-west-2.amazonaws.com/submissions/gpt-4-1-mini_openai_2024-06-20/submission.json) Source sierra Original model label GPT-4.1-mini Evaluated 2025-06-09 Observed 2026-10-21T16:55:01.756Z Evidence SHA-256 `2a86f83f6bfeff5b02015c9d7471602bcfd5fb732ef66f55f1fac4dcab20dff4` Source locator `/results/retail` |  |  |  |  |  |  |
| [Fortress](https://benchize.com/benchmarks/scale%3Afortress.md) | 59.19source score | CI 55.89–62.49 | 4 / 31 | — | [scale](https://labs.scale.com/leaderboard/fortress) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 59.19 \| source_score \| reported \| Higher is better \| ### Configuration Reasoning effort unknown Model configuration GPT-4.1 mini sourceModelVersion Not reported thinkingEnabled Not reported ### Reported statistics Uncertainty Confidence interval: 55.89–62.49 contaminationWarning ORS score: 1.38 rank 65 reportedConfidenceHalfWidth 3.3 ### Source [Original source](https://labs.scale.com/leaderboard/fortress) Source scale Original model label GPT-4.1 mini Observed 2026-10-22T03:30:12.378Z Evidence SHA-256 `2c005102a7346206e5d31d9249d525620bef39f6d514668ed48398e710616b0f` Source locator `/rows/64` |  |  |  |  |  |  |
| [DesignArena Overall frontend coding](https://benchize.com/benchmarks/designarena%3Acode.md) | 994elo | SE ±9.36 | 108 / 116 | — | [designarena · public](https://www.designarena.ai/api/leaderboard#board=code) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 994 \| elo \| code \| Higher is better \| ### Configuration arenaType models category allcategories inputModality text sourceModelVersion gpt-4.1-mini variationName public ### Reported statistics Uncertainty Standard error: ±9.36 averageGenerationTimeMs 71382 battles 1566 losses 823 standardError 9.3565 winRate 47.5 wins 743 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=code) Source designarena Original model label GPT-4.1 mini Source version public Observed 2026-10-21T16:37:57.301Z Evidence SHA-256 `0c897b58670f5e352bd123db999a40c0d1781a443964c502b90774a76a3a7758` Source locator `/data/167` |  |  |  |  |  |  |
| [ARC-AGI-1](https://benchize.com/benchmarks/arc-prize%3Av1_Semi_Private.md) | 3.5% | — | 241 / 245 | 0.0078usd per task | [arc prize · v1](https://arcprize.org/media/data/leaderboard/v1.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.035 \| score_fraction \| v1_Semi_Private \| Higher is better \| \| `cost_per_task` \| 0.0078 \| usd_per_task \| v1_Semi_Private \| Lower is better \| ### Configuration evaluationSplit v1_Semi_Private harness Not reported modelGroup gpt-4.1 modelType Base LLM sourceModelVersion gpt-4-1-mini-2025-04-14 ### Source [Original source](https://arcprize.org/media/data/leaderboard/v1.json) Source arc prize Original model label GPT-4.1-Mini Source version v1 Observed 2026-10-22T05:20:04.066Z Evidence SHA-256 `2bf68d22dafba37047d07ad833ebc0e8199c9aa2f9eeaed50c75c1b704462836` Source locator `/evaluations/16` |  |  |  |  |  |  |

---
Cite as: GPT-4.1 Mini — Benchize, https://benchize.com/models/gpt-4-1-mini (retrieved 2026-10-22)