# GPT-4o (2024-08-06)

> Source: Benchize (https://benchize.com) — https://benchize.com/models/gpt-4o-2024-08-06. When citing or reusing this content, credit "Benchize" and link to https://benchize.com/models/gpt-4o-2024-08-06.

OpenAI

Canonical URL: https://benchize.com/models/gpt-4o-2024-08-06
Last updated: Thu, 22 Oct 2026 08:20:15 GMT

Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations.

OpenAI

## Benchmarks

| Benchmark | Score | ± | Rank | Source |  |
| --- | --- | --- | --- | --- | --- |
| [OTIS Mock AIME 2024–2025](https://benchize.com/benchmarks/epoch-ai%3Aotis_mock_aime_2024_2025.md) | 6.39% | SE ±2.56 pp | 118 / 124 | [epoch ai · OTIS Mock AIME 2024-2025](https://epoch.ai/data/benchmark_data.zip#file=otis_mock_aime_2024_2025.csv) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.06388888888888888 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.06388888888888888 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion OTIS Mock AIME 2024-2025 reasoningBudget Not reported Reasoning effort Not reported sourceModelVersion gpt-4o-2024-08-06 ### Reported statistics Uncertainty Standard error: ±2.56 pp standardError 0.025630380139261548 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=otis_mock_aime_2024_2025.csv) Source epoch ai Original model label gpt-4o-2024-08-06 Source version OTIS Mock AIME 2024-2025 Evaluated 2025-02-25T14:05:08.205Z Observed 2026-10-22T03:00:05.281Z Evidence SHA-256 `b7c9da8c0587c82f1e0d814ceb496c24308380b997a16203b6e5d39eb07f4f50` Source locator `/rows/280` |  |  |  |  |  |
| [Arena text style control / english](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aenglish.md) | 1,348.18 | — | 146 / 173 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1348.1838808380537 \| rating \| reported \| Higher is better \| ### Configuration category english config text_style_control ### Reported statistics lower 1342.8162897198322 rank 249 upper 1353.5514719562755 variance 7.500024276508195 votes 25286 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/1885/row` |  |  |  |  |  |
| [FrontierMath (2025-02-28 private)](https://benchize.com/benchmarks/epoch-ai%3Afrontiermath.md) | 0.34% | SE ±0.34 pp | 16 / 18 | [epoch ai · FrontierMath-2025-02-28-Private](https://epoch.ai/data/benchmark_data.zip#file=frontiermath.csv) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.0034482758620689655 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.0034482758620689655 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion FrontierMath-2025-02-28-Private reasoningBudget Not reported Reasoning effort Not reported sourceModelVersion gpt-4o-2024-08-06 ### Reported statistics Uncertainty Standard error: ±0.34 pp standardError 0.003448275862068965 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=frontiermath.csv) Source epoch ai Original model label gpt-4o-2024-08-06 Source version FrontierMath-2025-02-28-Private Evaluated 2025-03-07T18:56:32.370Z Observed 2026-10-22T03:00:05.281Z Evidence SHA-256 `f5c92f0f0b9103abb02308fd428c0806e7c21b91e8a14d43edb8af77ce941598` Source locator `/rows/87` |  |  |  |  |  |
| [Arena text style control / industry legal and government](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aindustry_legal_and_government.md) | 1,347.27 | — | 141 / 173 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1347.2733855669212 \| rating \| reported \| Higher is better \| ### Configuration category industry_legal_and_government config text_style_control ### Reported statistics lower 1334.7772573546094 rank 233 upper 1359.769513779233 variance 40.64945834049473 votes 2674 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/5340/row` |  |  |  |  |  |
| [Arena text / multi turn](https://benchize.com/benchmarks/lmarena%3Atext%3Amulti_turn.md) | 1,278.84 | — | 154 / 173 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1278.8353116227543 \| rating \| reported \| Higher is better \| ### Configuration category multi_turn config text ### Reported statistics lower 1270.9422175901045 rank 265 upper 1286.728405655404 variance 16.218040155118555 votes 8201 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/9580/row` |  |  |  |  |  |
| [Arena text / industry software and it services](https://benchize.com/benchmarks/lmarena%3Atext%3Aindustry_software_and_it_services.md) | 1,277.65 | — | 160 / 173 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1277.6476873990632 \| rating \| reported \| Higher is better \| ### Configuration category industry_software_and_it_services config text ### Reported statistics lower 1270.9620017606999 rank 279 upper 1284.3333730374266 variance 11.635785919199789 votes 11864 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/6979/row` |  |  |  |  |  |
| [Arena text style control / industry business and management and financial operations](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aindustry_business_and_management_and_financial_operations.md) | 1,302.11 | — | 157 / 173 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1302.107779904346 \| rating \| reported \| Higher is better \| ### Configuration category industry_business_and_management_and_financial_operations config text_style_control ### Reported statistics lower 1292.9913513555728 rank 271 upper 1311.2242084531192 variance 21.634819833854042 votes 5095 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/4553/row` |  |  |  |  |  |
| [Arena vision / overall (config: vision)](https://benchize.com/benchmarks/benchmark%3Avision%3Aoverall--config-vision.md) | 1,064.56 | — | 91 / 92 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1064.564991850618 \| rating \| reported \| Higher is better \| ### Configuration category overall config vision ### Reported statistics lower 1052.075712483359 rank 138 upper 1077.0542712178772 variance 40.60491245491397 votes 3376 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/137/row` |  |  |  |  |  |
| [SWE-bench Lite](https://benchize.com/benchmarks/swe-bench%3Alite.md) | 39.67% | — | 12 / 22 | [SWE-bench](https://www.swebench.com/) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `resolved` \| 39.67 \| percent \| lite \| Higher is better \| ### Configuration agent OpenCSG Starship Agentic Coder agentOrganization Not reported models ["gpt-4o-2024-08-06"] Reasoning effort Not reported sourceSubmission 20250113_OpenCSG-Starship-Agentic-Coder_gpt4o subset Lite system Not reported ### Source [Original source](https://www.swebench.com/) Source SWE-bench Original model label GPT-4 (0806) Observed 2026-10-22T02:30:05.773Z Evidence SHA-256 `c862011a4ee1d1a7199fad6ca0905fa5c64f58216f7217ac1eddf37f28788433` Source locator `/leaderboard-data/3/results/28` |  |  |  |  |  |
| [Arena vision style control / chinese](https://benchize.com/benchmarks/lmarena%3Avision_style_control%3Achinese.md) | 1,072.49 | — | 81 / 83 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1072.4856433668303 \| rating \| reported \| Higher is better \| ### Configuration category chinese config vision_style_control ### Reported statistics lower 1020.9842732953042 rank 113 upper 1123.9870134383564 variance 690.4645456449332 votes 186 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `38568936995f36625aae49e9ea05557d55c1b1df9b2954f5c50cee523f26fe92` Source locator `/rows/313/row` |  |  |  |  |  |
| [Arena text style control / expert](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aexpert.md) | 1,311.78 | — | 148 / 170 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1311.7776724615671 \| rating \| reported \| Higher is better \| ### Configuration category expert config text_style_control ### Reported statistics lower 1299.0124854224982 rank 254 upper 1324.542859500636 variance 42.41878092369337 votes 2349 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/2724/row` |  |  |  |  |  |
| [Arena text style control / industry entertainment and sports and media](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aindustry_entertainment_and_sports_and_media.md) | 1,324.94 | — | 129 / 173 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1324.9359613442482 \| rating \| reported \| Higher is better \| ### Configuration category industry_entertainment_and_sports_and_media config text_style_control ### Reported statistics lower 1316.6615469038406 rank 206 upper 1333.2103757846558 variance 17.822899457570195 votes 7043 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/4898/row` |  |  |  |  |  |
| [Arena text / industry legal and government](https://benchize.com/benchmarks/lmarena%3Atext%3Aindustry_legal_and_government.md) | 1,275.13 | — | 162 / 173 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1275.133589720009 \| rating \| reported \| Higher is better \| ### Configuration category industry_legal_and_government config text ### Reported statistics lower 1262.6374274109207 rank 275 upper 1287.6297520290975 variance 40.64968017198883 votes 2674 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/5382/row` |  |  |  |  |  |
| [Arena text / overall](https://benchize.com/benchmarks/lmarena%3Atext.md) | 1,282.57 | — | 157 / 173 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1282.5660130828692 \| rating \| reported \| Higher is better \| ### Configuration category overall config text ### Reported statistics lower 1278.37546113426 rank 268 upper 1286.7565650314784 variance 4.571368965194335 votes 45499 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/267/row` |  |  |  |  |  |
| [Arena text style control / spanish](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aspanish.md) | 1,328 | — | 137 / 155 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1327.9973171081679 \| rating \| reported \| Higher is better \| ### Configuration category spanish config text_style_control ### Reported statistics lower 1300.8208832348096 rank 218 upper 1355.1737509815262 variance 192.25991805362185 votes 546 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/10982/row` |  |  |  |  |  |
| [Arena text / expert](https://benchize.com/benchmarks/lmarena%3Atext%3Aexpert.md) | 1,240.54 | — | 155 / 170 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1240.5435706153812 \| rating \| reported \| Higher is better \| ### Configuration category expert config text ### Reported statistics lower 1227.8894703373837 rank 265 upper 1253.1976708933785 variance 41.6837095800703 votes 2349 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/2735/row` |  |  |  |  |  |
| [Arena text / math](https://benchize.com/benchmarks/lmarena%3Atext%3Amath.md) | 1,285.35 | — | 149 / 170 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1285.3451524340794 \| rating \| reported \| Higher is better \| ### Configuration category math config text ### Reported statistics lower 1277.273564782888 rank 249 upper 1293.416740085271 variance 16.959840063857726 votes 6826 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/9161/row` |  |  |  |  |  |
| [Arena text / industry life and physical and social science](https://benchize.com/benchmarks/lmarena%3Atext%3Aindustry_life_and_physical_and_social_science.md) | 1,273.93 | — | 161 / 173 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1273.93380667664 \| rating \| reported \| Higher is better \| ### Configuration category industry_life_and_physical_and_social_science config text ### Reported statistics lower 1265.9050156590731 rank 277 upper 1281.9625976942066 variance 16.780470184010312 votes 7560 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/5774/row` |  |  |  |  |  |
| [Arena text / hard prompts](https://benchize.com/benchmarks/lmarena%3Atext%3Ahard_prompts.md) | 1,263.95 | — | 159 / 173 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1263.9546493016005 \| rating \| reported \| Higher is better \| ### Configuration category hard_prompts config text ### Reported statistics lower 1257.5634073132642 rank 276 upper 1270.3458912899368 variance 10.63345360710947 votes 12655 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/3726/row` |  |  |  |  |  |
| [Arena text style control / russian](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Arussian.md) | 1,325.05 | — | 144 / 172 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1325.0512543175405 \| rating \| reported \| Higher is better \| ### Configuration category russian config text_style_control ### Reported statistics lower 1316.2516440281402 rank 236 upper 1333.8508646069408 variance 20.157222779061552 votes 5517 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/10619/row` |  |  |  |  |  |
| [Arena text style control / exclude ties](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aexclude_ties.md) | 1,286.23 | — | 145 / 173 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1286.2254682948544 \| rating \| reported \| Higher is better \| ### Configuration category exclude_ties config text_style_control ### Reported statistics lower 1279.7024212900171 rank 244 upper 1292.7485152996917 variance 11.076558207027105 votes 28538 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/2297/row` |  |  |  |  |  |
| [GPQA Diamond](https://benchize.com/benchmarks/gpqa-diamond.md) | 49.21% | SE ±2.6 pp | 106 / 126 | [epoch ai · GPQA diamond](https://epoch.ai/data/benchmark_data.zip#file=gpqa_diamond.csv) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.49210858585858586 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.49210858585858586 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion GPQA diamond reasoningBudget Not reported Reasoning effort Not reported sourceModelVersion gpt-4o-2024-08-06 ### Reported statistics Uncertainty Standard error: ±2.6 pp standardError 0.025999270277271707 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=gpqa_diamond.csv) Source epoch ai Original model label gpt-4o-2024-08-06 Source version GPQA diamond Evaluated 2025-01-27T00:00:00.000Z Observed 2026-10-22T03:00:05.281Z Evidence SHA-256 `9ef0b938bdd8406b029d595983ee8ad3a80bd9d64b82605b91b5ce39ba650c39` Source locator `/rows/272` |  |  |  |  |  |
| [Arena text / instruction following](https://benchize.com/benchmarks/lmarena%3Atext%3Ainstruction_following.md) | 1,266.59 | — | 151 / 173 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1266.5905503247373 \| rating \| reported \| Higher is better \| ### Configuration category instruction_following config text ### Reported statistics lower 1260.7969163779317 rank 260 upper 1272.384184271543 variance 8.737876904668582 votes 18305 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/7793/row` |  |  |  |  |  |
| [Arena text style control / coding](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Acoding.md) | 1,359.67 | — | 151 / 173 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1359.6738566449928 \| rating \| reported \| Higher is better \| ### Configuration category coding config text_style_control ### Reported statistics lower 1351.7742871061996 rank 260 upper 1367.5734261837858 variance 16.24466167958378 votes 7318 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/1069/row` |  |  |  |  |  |
| [Arena text / spanish](https://benchize.com/benchmarks/lmarena%3Atext%3Aspanish.md) | 1,268.85 | — | 145 / 155 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1268.848523962703 \| rating \| reported \| Higher is better \| ### Configuration category spanish config text ### Reported statistics lower 1241.7354996465888 rank 232 upper 1295.9615482788167 variance 191.36378180239214 votes 546 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/10996/row` |  |  |  |  |  |
| [Arena text style control / industry software and it services](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aindustry_software_and_it_services.md) | 1,346.57 | — | 153 / 173 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1346.5700623122416 \| rating \| reported \| Higher is better \| ### Configuration category industry_software_and_it_services config text_style_control ### Reported statistics lower 1339.8369650212153 rank 267 upper 1353.3031596032679 variance 11.801401823236072 votes 11864 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/6967/row` |  |  |  |  |  |
| [Arena text / industry entertainment and sports and media](https://benchize.com/benchmarks/lmarena%3Atext%3Aindustry_entertainment_and_sports_and_media.md) | 1,267.39 | — | 146 / 173 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1267.3867850109211 \| rating \| reported \| Higher is better \| ### Configuration category industry_entertainment_and_sports_and_media config text ### Reported statistics lower 1259.1795180400504 rank 248 upper 1275.5940519817918 variance 17.534804946567906 votes 7043 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/4940/row` |  |  |  |  |  |
| [Arena text style control / math](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Amath.md) | 1,308.61 | — | 149 / 170 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1308.6101248716286 \| rating \| reported \| Higher is better \| ### Configuration category math config text_style_control ### Reported statistics lower 1300.5034576868434 rank 244 upper 1316.7167920564139 variance 17.107577072243366 votes 6826 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/9156/row` |  |  |  |  |  |
| [Arena text / german](https://benchize.com/benchmarks/lmarena%3Atext%3Agerman.md) | 1,257.37 | — | 136 / 149 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1257.3671222494822 \| rating \| reported \| Higher is better \| ### Configuration category german config text ### Reported statistics lower 1239.7162582388432 rank 225 upper 1275.0179862601217 variance 81.10278278755116 votes 1202 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/3361/row` |  |  |  |  |  |
| [Arena text / industry medicine and healthcare](https://benchize.com/benchmarks/lmarena%3Atext%3Aindustry_medicine_and_healthcare.md) | 1,251.84 | — | 163 / 173 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1251.8443559398243 \| rating \| reported \| Higher is better \| ### Configuration category industry_medicine_and_healthcare config text ### Reported statistics lower 1237.9925487324813 rank 276 upper 1265.6961631471672 variance 49.94783801293682 votes 2174 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/6588/row` |  |  |  |  |  |
| [Arena text style control / creative writing](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Acreative_writing.md) | 1,326.99 | — | 127 / 173 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1326.990709760295 \| rating \| reported \| Higher is better \| ### Configuration category creative_writing config text_style_control ### Reported statistics lower 1318.4763882865996 rank 207 upper 1335.5050312339906 variance 18.87139067244612 votes 6756 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/1428/row` |  |  |  |  |  |
| [Arena text style control / german](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Agerman.md) | 1,313.19 | — | 127 / 149 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1313.1872733116716 \| rating \| reported \| Higher is better \| ### Configuration category german config text_style_control ### Reported statistics lower 1295.520712571428 rank 204 upper 1330.8538340519149 variance 81.24709464731832 votes 1202 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/3340/row` |  |  |  |  |  |
| [Arena text style control / korean](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Akorean.md) | 1,288.69 | — | 118 / 144 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1288.690867990168 \| rating \| reported \| Higher is better \| ### Configuration category korean config text_style_control ### Reported statistics lower 1263.8283372713968 rank 187 upper 1313.553398708939 variance 160.91424185308338 votes 712 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/8420/row` |  |  |  |  |  |
| [Arena text style control / instruction following](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Ainstruction_following.md) | 1,318.64 | — | 145 / 173 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1318.639210133708 \| rating \| reported \| Higher is better \| ### Configuration category instruction_following config text_style_control ### Reported statistics lower 1312.8089494431827 rank 239 upper 1324.4694708242334 variance 8.848706001056241 votes 18305 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/7772/row` |  |  |  |  |  |
| [Arena text style control / industry mathematical](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aindustry_mathematical.md) | 1,312.99 | — | 149 / 169 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1312.9913856402345 \| rating \| reported \| Higher is better \| ### Configuration category industry_mathematical config text_style_control ### Reported statistics lower 1304.4094397070244 rank 251 upper 1321.5733315734444 variance 19.172350775643817 votes 5805 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/6163/row` |  |  |  |  |  |
| [Arena text / industry writing and literature and language](https://benchize.com/benchmarks/lmarena%3Atext%3Aindustry_writing_and_literature_and_language.md) | 1,289.7 | — | 146 / 173 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1289.7007006965362 \| rating \| reported \| Higher is better \| ### Configuration category industry_writing_and_literature_and_language config text ### Reported statistics lower 1282.8601097732442 rank 244 upper 1296.541291619828 variance 12.181227591909273 votes 12147 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/7361/row` |  |  |  |  |  |
| [Arena text style control / non english](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Anon_english.md) | 1,316.76 | — | 143 / 173 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1316.7643438967125 \| rating \| reported \| Higher is better \| ### Configuration category non_english config text_style_control ### Reported statistics lower 1311.2366296647688 rank 236 upper 1322.2920581286562 variance 7.954172114361284 votes 20213 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/9966/row` |  |  |  |  |  |
| [Arena text / industry mathematical](https://benchize.com/benchmarks/lmarena%3Atext%3Aindustry_mathematical.md) | 1,283.26 | — | 150 / 169 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1283.2611616101863 \| rating \| reported \| Higher is better \| ### Configuration category industry_mathematical config text ### Reported statistics lower 1274.725846204256 rank 255 upper 1291.7964770161161 variance 18.964568534810738 votes 5805 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/6167/row` |  |  |  |  |  |
| [Arena text / chinese](https://benchize.com/benchmarks/lmarena%3Atext%3Achinese.md) | 1,254.25 | — | 156 / 168 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1254.2514502337058 \| rating \| reported \| Higher is better \| ### Configuration category chinese config text ### Reported statistics lower 1243.5562772085268 rank 268 upper 1264.9466232588848 variance 29.776897626055426 votes 3778 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/684/row` |  |  |  |  |  |
| [Arena text style control / industry life and physical and social science](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aindustry_life_and_physical_and_social_science.md) | 1,347.79 | — | 144 / 173 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1347.785474256489 \| rating \| reported \| Higher is better \| ### Configuration category industry_life_and_physical_and_social_science config text_style_control ### Reported statistics lower 1339.7153903531826 rank 245 upper 1355.8555581597952 variance 16.953521369425072 votes 7560 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/5742/row` |  |  |  |  |  |
| [Arena text / exclude ties](https://benchize.com/benchmarks/lmarena%3Atext%3Aexclude_ties.md) | 1,208.99 | — | 157 / 173 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1208.9871537852146 \| rating \| reported \| Higher is better \| ### Configuration category exclude_ties config text ### Reported statistics lower 1202.539385128022 rank 269 upper 1215.434922442407 variance 10.822378319588918 votes 28538 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/2322/row` |  |  |  |  |  |
| [Arena vision style control / english](https://benchize.com/benchmarks/lmarena%3Avision_style_control%3Aenglish.md) | 1,120.75 | — | 89 / 92 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1120.7477380142682 \| rating \| reported \| Higher is better \| ### Configuration category english config vision_style_control ### Reported statistics lower 1104.4618001560011 rank 134 upper 1137.0336758725352 variance 69.04454383176538 votes 1744 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `38568936995f36625aae49e9ea05557d55c1b1df9b2954f5c50cee523f26fe92` Source locator `/rows/723/row` |  |  |  |  |  |
| [MATH Level 5](https://benchize.com/benchmarks/epoch-ai%3Amath_level_5.md) | 53.28% | SE ±1.12 pp | 13 / 21 | [epoch ai · MATH level 5](https://epoch.ai/data/benchmark_data.zip#file=math_level_5.csv) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.5327605740181269 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.5327605740181269 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion MATH level 5 reasoningBudget Not reported Reasoning effort Not reported sourceModelVersion gpt-4o-2024-08-06 ### Reported statistics Uncertainty Standard error: ±1.12 pp standardError 0.01122129021441016 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=math_level_5.csv) Source epoch ai Original model label gpt-4o-2024-08-06 Source version MATH level 5 Evaluated 2025-01-27T00:00:00.000Z Observed 2026-10-22T03:00:05.281Z Evidence SHA-256 `041b4bcb991a81d66152327113ef6d38e64cd8cce93d1e6ec821d1b9e47c1de3` Source locator `/rows/75` |  |  |  |  |  |
| [Arena text style control / industry medicine and healthcare](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aindustry_medicine_and_healthcare.md) | 1,342.38 | — | 147 / 173 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1342.3839672826243 \| rating \| reported \| Higher is better \| ### Configuration category industry_medicine_and_healthcare config text_style_control ### Reported statistics lower 1328.4929078308828 rank 243 upper 1356.2750267343658 variance 50.23131620006465 votes 2174 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/6555/row` |  |  |  |  |  |
| [Arena text / english](https://benchize.com/benchmarks/lmarena%3Atext%3Aenglish.md) | 1,297.44 | — | 157 / 173 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1297.4427217300204 \| rating \| reported \| Higher is better \| ### Configuration category english config text ### Reported statistics lower 1292.1096348042984 rank 272 upper 1302.7758086557421 variance 7.403910203094612 votes 25286 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/1908/row` |  |  |  |  |  |
| [Arena text / hard prompts english](https://benchize.com/benchmarks/lmarena%3Atext%3Ahard_prompts_english.md) | 1,276.91 | — | 159 / 173 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1276.9124665898107 \| rating \| reported \| Higher is better \| ### Configuration category hard_prompts_english config text ### Reported statistics lower 1269.2348790167894 rank 275 upper 1284.5900541628316 variance 15.344522404839037 votes 8010 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/4142/row` |  |  |  |  |  |
| [Arena text style control / overall](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aoverall.md) | 1,335.64 | — | 145 / 173 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1335.64495064839 \| rating \| reported \| Higher is better \| ### Configuration category overall config text_style_control ### Reported statistics lower 1331.431143202417 rank 241 upper 1339.858758094363 variance 4.622247437896473 votes 45499 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/240/row` |  |  |  |  |  |
| [Arena text style control / hard prompts english](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Ahard_prompts_english.md) | 1,337.79 | — | 151 / 173 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1337.7946437993373 \| rating \| reported \| Higher is better \| ### Configuration category hard_prompts_english config text_style_control ### Reported statistics lower 1330.0492393994052 rank 262 upper 1345.5400481992692 variance 15.616798752419395 votes 8010 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/4129/row` |  |  |  |  |  |
| [Arena text style control / industry writing and literature and language](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aindustry_writing_and_literature_and_language.md) | 1,341.35 | — | 130 / 173 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1341.349030512078 \| rating \| reported \| Higher is better \| ### Configuration category industry_writing_and_literature_and_language config text_style_control ### Reported statistics lower 1334.454707717885 rank 207 upper 1348.243353306271 variance 12.373342786983644 votes 12147 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/7324/row` |  |  |  |  |  |
| [Arena vision style control / overall](https://benchize.com/benchmarks/lmarena%3Avision_style_control%3Aoverall.md) | 1,117.92 | — | 90 / 92 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1117.9184450530952 \| rating \| reported \| Higher is better \| ### Configuration category overall config vision_style_control ### Reported statistics lower 1105.6323300615795 rank 134 upper 1130.2045600446106 variance 39.29460880110795 votes 3376 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `38568936995f36625aae49e9ea05557d55c1b1df9b2954f5c50cee523f26fe92` Source locator `/rows/133/row` |  |  |  |  |  |
| [Arena text style control / japanese](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Ajapanese.md) | 1,292.38 | — | 114 / 138 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1292.379163285163 \| rating \| reported \| Higher is better \| ### Configuration category japanese config text_style_control ### Reported statistics lower 1273.1420517989084 rank 177 upper 1311.616274771418 variance 96.33487578755938 votes 1104 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/8127/row` |  |  |  |  |  |
| [Arena text / industry business and management and financial operations](https://benchize.com/benchmarks/lmarena%3Atext%3Aindustry_business_and_management_and_financial_operations.md) | 1,231.73 | — | 164 / 173 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1231.730483686982 \| rating \| reported \| Higher is better \| ### Configuration category industry_business_and_management_and_financial_operations config text ### Reported statistics lower 1222.6053777979591 rank 284 upper 1240.855589576005 variance 21.676025013548237 votes 5095 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/4566/row` |  |  |  |  |  |
| [Arena text / russian](https://benchize.com/benchmarks/lmarena%3Atext%3Arussian.md) | 1,271.8 | — | 155 / 172 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1271.795162364004 \| rating \| reported \| Higher is better \| ### Configuration category russian config text ### Reported statistics lower 1263.0106473567587 rank 257 upper 1280.579677371249 variance 20.088124724078675 votes 5517 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/10640/row` |  |  |  |  |  |
| [Chess Puzzles](https://benchize.com/benchmarks/epoch-ai%3Achess_puzzles.md) | 6% | SE ±2.39 pp | 61 / 64 | [epoch ai · Chess Puzzles](https://epoch.ai/data/benchmark_data.zip#file=chess_puzzles.csv) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.06 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.06 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion Chess Puzzles reasoningBudget Not reported Reasoning effort Not reported sourceModelVersion gpt-4o-2024-08-06 ### Reported statistics Uncertainty Standard error: ±2.39 pp standardError 0.023868325657594204 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=chess_puzzles.csv) Source epoch ai Original model label gpt-4o-2024-08-06 Source version Chess Puzzles Evaluated 2026-10-13T14:12:01.000Z Observed 2026-10-22T03:00:05.281Z Evidence SHA-256 `a5b99d6d35252907b04e9a802873a9754ecc0248be92a1ebbd2ef0450e4bb015` Source locator `/rows/27` |  |  |  |  |  |
| [SVGBench Arena](https://benchize.com/benchmarks/svgbench%3Aarena.md) | 1,291 | — | 141 / 191 | [svgbench](https://svgbench.ai/api/leaderboard?shape=2) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1291 \| rating \| reported \| Higher is better \| ### Configuration Reasoning effort unknown sourceModelId model_openai_gpt_4o_2024_08_06 ### Reported statistics coverageCount 27 draws 0 judged 15 losses 12 rank 226 ratingDeviation 88 wins 3 ### Source [Original source](https://svgbench.ai/api/leaderboard?shape=2) Source svgbench Original model label GPT-4o (2024-08-06) Observed 2026-10-22T04:30:04.538Z Evidence SHA-256 `5c0a9c869593820d57d2c05f6d416e1b44a740b4835e66c66e9ad8b8edc59e2c` Source locator `/rows/215` |  |  |  |  |  |
| [Arena text / japanese](https://benchize.com/benchmarks/lmarena%3Atext%3Ajapanese.md) | 1,234.22 | — | 121 / 138 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1234.2206174616774 \| rating \| reported \| Higher is better \| ### Configuration category japanese config text ### Reported statistics lower 1215.1934672828872 rank 192 upper 1253.2477676404676 variance 94.24347905955604 votes 1104 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/8142/row` |  |  |  |  |  |
| [Arena vision / chinese (config: vision)](https://benchize.com/benchmarks/benchmark%3Avision%3Achinese--config-vision.md) | 1,009.36 | — | 82 / 83 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1009.3611678562212 \| rating \| reported \| Higher is better \| ### Configuration category chinese config vision ### Reported statistics lower 957.1220762629812 rank 115 upper 1061.600259449461 variance 710.3870737299255 votes 186 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/315/row` |  |  |  |  |  |
| [Arena text / korean](https://benchize.com/benchmarks/lmarena%3Atext%3Akorean.md) | 1,218.15 | — | 131 / 144 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1218.1467603032634 \| rating \| reported \| Higher is better \| ### Configuration category korean config text ### Reported statistics lower 1193.3768514206674 rank 210 upper 1242.9166691858593 variance 159.7175486424297 votes 712 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/8443/row` |  |  |  |  |  |
| [Arena text style control / longer query](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Alonger_query.md) | 1,338.97 | — | 142 / 172 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1338.9651758042148 \| rating \| reported \| Higher is better \| ### Configuration category longer_query config text_style_control ### Reported statistics lower 1330.5602219897416 rank 237 upper 1347.3701296186882 variance 18.38969306214337 votes 6160 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/8754/row` |  |  |  |  |  |
| [Arena text / non english](https://benchize.com/benchmarks/lmarena%3Atext%3Anon_english.md) | 1,261.64 | — | 156 / 173 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1261.6420627218884 \| rating \| reported \| Higher is better \| ### Configuration category non_english config text ### Reported statistics lower 1256.1411243643 rank 266 upper 1267.1430010794768 variance 7.877299803651329 votes 20213 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/9996/row` |  |  |  |  |  |
| [SWE-bench Lite](https://benchize.com/benchmarks/swe-bench%3Alite.md) | 21.67% | — | 20 / 22 | [SWE-bench](https://www.swebench.com/) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `resolved` \| 21.67 \| percent \| lite \| Higher is better \| ### Configuration agent Bytedance AutoSE agentOrganization Bytedance models ["gpt-4o-2024-08-06"] Reasoning effort Not reported sourceSubmission 20240828_autose_mixed subset Lite system Not reported ### Source [Original source](https://www.swebench.com/) Source SWE-bench Original model label Multiple Observed 2026-10-22T02:30:05.773Z Evidence SHA-256 `c862011a4ee1d1a7199fad6ca0905fa5c64f58216f7217ac1eddf37f28788433` Source locator `/leaderboard-data/3/results/71` |  |  |  |  |  |
| [Arena text style control / french](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Afrench.md) | 1,328.5 | — | 137 / 152 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1328.50234744842 \| rating \| reported \| Higher is better \| ### Configuration category french config text_style_control ### Reported statistics lower 1299.712385074341 rank 227 upper 1357.2923098224992 variance 215.76749151540093 votes 457 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/3064/row` |  |  |  |  |  |
| [FrontierMath Tiers 1–3 v2 (private)](https://benchize.com/benchmarks/epoch-ai%3Afrontiermath_tiers_1_3_v2.md) | 0.35% | SE ±0.35 pp | 50 / 50 | [epoch ai · FrontierMath-Tiers-1-3-v2-Private](https://epoch.ai/data/benchmark_data.zip#file=frontiermath_tiers_1_3_v2.csv) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.0035087719298245615 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.0035087719298245615 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion FrontierMath-Tiers-1-3-v2-Private reasoningBudget Not reported Reasoning effort Not reported sourceModelVersion gpt-4o-2024-08-06 ### Reported statistics Uncertainty Standard error: ±0.35 pp standardError 0.0035087719298245615 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=frontiermath_tiers_1_3_v2.csv) Source epoch ai Original model label gpt-4o-2024-08-06 Source version FrontierMath-Tiers-1-3-v2-Private Evaluated 2026-08-27T17:54:29.000Z Observed 2026-10-22T03:00:05.281Z Evidence SHA-256 `d3458d4272f99e04212525904a59fffffa7a94e827c62b26e36e3fd3e15fe587` Source locator `/rows/60` |  |  |  |  |  |
| [Arena text / creative writing](https://benchize.com/benchmarks/lmarena%3Atext%3Acreative_writing.md) | 1,274.37 | — | 144 / 173 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1274.3688774106488 \| rating \| reported \| Higher is better \| ### Configuration category creative_writing config text ### Reported statistics lower 1265.9159151808246 rank 243 upper 1282.8218396404727 variance 18.600373918864452 votes 6756 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/1464/row` |  |  |  |  |  |
| [Arena vision / english (config: vision)](https://benchize.com/benchmarks/benchmark%3Avision%3Aenglish--config-vision.md) | 1,071.91 | — | 91 / 92 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1071.9144609462342 \| rating \| reported \| Higher is better \| ### Configuration category english config vision ### Reported statistics lower 1055.4453350148651 rank 140 upper 1088.3835868776032 variance 70.60653819381002 votes 1744 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/729/row` |  |  |  |  |  |
| [Arena text style control / multi turn](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Amulti_turn.md) | 1,326.87 | — | 142 / 173 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1326.8703898750791 \| rating \| reported \| Higher is better \| ### Configuration category multi_turn config text_style_control ### Reported statistics lower 1318.9686536346012 rank 239 upper 1334.772126115557 variance 16.253574105162752 votes 8201 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/9554/row` |  |  |  |  |  |
| [SimpleQA Verified](https://benchize.com/benchmarks/epoch-ai%3Asimpleqa_verified.md) | 26% | SE ±1.39 pp | 34 / 40 | [epoch ai · SimpleQA Verified](https://epoch.ai/data/benchmark_data.zip#file=simpleqa_verified.csv) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.26 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.26 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion SimpleQA Verified reasoningBudget Not reported Reasoning effort Not reported sourceModelVersion gpt-4o-2024-08-06 ### Reported statistics Uncertainty Standard error: ±1.39 pp standardError 0.01387777332977422 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=simpleqa_verified.csv) Source epoch ai Original model label gpt-4o-2024-08-06 Source version SimpleQA Verified Evaluated 2026-08-31T22:02:02.000Z Observed 2026-10-22T03:00:05.281Z Evidence SHA-256 `e2d3fae377f0ddd3d079bcc3971b9b9388a0a950289effe7b521177ea2e988cc` Source locator `/rows/16` |  |  |  |  |  |
| [Arena text style control / hard prompts](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Ahard_prompts.md) | 1,327.01 | — | 150 / 173 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1327.01291313421 \| rating \| reported \| Higher is better \| ### Configuration category hard_prompts config text_style_control ### Reported statistics lower 1320.5610799513302 rank 260 upper 1333.46474631709 variance 10.836026978987379 votes 12655 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/3710/row` |  |  |  |  |  |
| [Arena text style control / chinese](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Achinese.md) | 1,331.22 | — | 149 / 168 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1331.2159690807216 \| rating \| reported \| Higher is better \| ### Configuration category chinese config text_style_control ### Reported statistics lower 1320.458043029725 rank 252 upper 1341.973895131718 variance 30.127349613967056 votes 3778 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/668/row` |  |  |  |  |  |
| [Arena text / coding](https://benchize.com/benchmarks/lmarena%3Atext%3Acoding.md) | 1,283.38 | — | 157 / 173 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1283.3815695565363 \| rating \| reported \| Higher is better \| ### Configuration category coding config text ### Reported statistics lower 1275.526384307101 rank 273 upper 1291.236754805972 variance 16.06263093868069 votes 7318 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/1082/row` |  |  |  |  |  |
| [Arena text / longer query](https://benchize.com/benchmarks/lmarena%3Atext%3Alonger_query.md) | 1,283.27 | — | 154 / 172 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1283.272809360057 \| rating \| reported \| Higher is better \| ### Configuration category longer_query config text ### Reported statistics lower 1274.9154368346688 rank 263 upper 1291.6301818854452 variance 18.182070611261235 votes 6160 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/8780/row` |  |  |  |  |  |
| [Arena text / french](https://benchize.com/benchmarks/lmarena%3Atext%3Afrench.md) | 1,263.06 | — | 144 / 152 | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1263.0557859803498 \| rating \| reported \| Higher is better \| ### Configuration category french config text ### Reported statistics lower 1234.6603771085427 rank 238 upper 1291.4511948521572 variance 209.89402272218464 votes 457 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label GPT-4o (2024-08-06) Observed 2026-10-22T06:45:03.380Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/3075/row` |  |  |  |  |  |

---
Cite as: GPT-4o (2024-08-06) — Benchize, https://benchize.com/models/gpt-4o-2024-08-06 (retrieved 2026-10-22)