# Arena vision / entity recognition (config: vision) > Source: Benchize (https://benchize.com) — https://benchize.com/benchmarks/benchmark%3Avision%3Aentity_recognition--config-vision. When citing or reusing this content, credit "Benchize" and link to https://benchize.com/benchmarks/benchmark%3Avision%3Aentity_recognition--config-vision. Human pairwise preferences on entity recognition prompts in Arena’s vision evaluation. The original organizer publishes model ratings and uncertainty; these are preference ratings rather than task accuracy. Canonical URL: https://benchize.com/benchmarks/benchmark%3Avision%3Aentity_recognition--config-vision Last updated: Wed, 21 Oct 2026 18:52:20 GMT Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations. Human pairwise preferences on entity recognition prompts in Arena’s vision evaluation. The original organizer publishes model ratings and uncertainty; these are preference ratings rather than task accuracy. Multimodal · Models tested: 34 · Score publishers: [Arena](https://huggingface.co/datasets/lmarena-ai/leaderboard-dataset) ## Model results | # | Model | Score | | | --- | --- | --- | --- | | 1 | [Gemini 3 Pro](https://benchize.com/models/gemini-3-pro.md) | 1,347.6 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1347.5985392578884 \| rating \| reported \| Higher is better \| ### Configuration category entity_recognition config vision ### Reported statistics lower 1311.744501183655 rank 1 upper 1383.4525773321218 variance 334.64163127389406 votes 249 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label Gemini 3 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/757/row` | | | | | 2 | [Gemini 3 Flash](https://benchize.com/models/gemini-3-flash.md) | 1,335.54 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1335.544850209527 \| rating \| reported \| Higher is better \| ### Configuration category entity_recognition config vision ### Reported statistics lower 1305.9118660760903 rank 2 upper 1365.1778343429642 variance 228.5886142842625 votes 368 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label Gemini 3 Flash Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/758/row` | | | | | 3 | [Gemini 3.1 Pro Preview](https://benchize.com/models/gemini-3-1-pro-preview.md) | 1,329.7 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1329.7022623203447 \| rating \| reported \| Higher is better \| ### Configuration category entity_recognition config vision ### Reported statistics lower 1300.794250958198 rank 3 upper 1358.6102736824912 variance 217.54056464491646 votes 388 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label Gemini 3.1 Pro Preview Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/759/row` | | | | | 4 | [Gemini 3 Flash](https://benchize.com/models/gemini-3-flash-minimal.md)Minimal | 1,311.12 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1311.124409012367 \| rating \| reported \| Higher is better \| ### Configuration category entity_recognition config vision Reasoning effort minimal thinkingEnabled true ### Reported statistics lower 1281.1576724310478 rank 4 upper 1341.0911455936862 variance 233.76673895254936 votes 323 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label Gemini 3 Flash (Minimal) Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/760/row` | | | | | 5 | [Gemini 3.1 Flash Lite Preview](https://benchize.com/models/gemini-3-1-flash-lite-preview.md) | 1,307.59 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1307.5929948588014 \| rating \| reported \| Higher is better \| ### Configuration category entity_recognition config vision ### Reported statistics lower 1274.1601749873996 rank 5 upper 1341.0258147302031 variance 290.97108591460204 votes 259 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label Gemini 3.1 Flash-Lite Preview Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/761/row` | | | | | 6 | [Gemini 2.5 Pro](https://benchize.com/models/gemini-2-5-pro.md) | 1,283.16 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1283.1608183516266 \| rating \| reported \| Higher is better \| ### Configuration category entity_recognition config vision ### Reported statistics lower 1261.078329834686 rank 8 upper 1305.2433068685675 variance 126.94039474636551 votes 917 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/764/row` | | | | | 7 | [Claude Opus 4.7](https://benchize.com/models/claude-opus-4-7-high.md)High | 1,277.84 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1277.835367242795 \| rating \| reported \| Higher is better \| ### Configuration category entity_recognition config vision Reasoning effort high thinkingEnabled true ### Reported statistics lower 1237.2231017288184 rank 9 upper 1318.4476327567718 variance 429.35670722085564 votes 154 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label Claude Opus 4.7 (High) Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/765/row` | | | | | 8 | [Claude Opus 4.6](https://benchize.com/models/claude-opus-4-6.md) | 1,273.55 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1273.553246408339 \| rating \| reported \| Higher is better \| ### Configuration category entity_recognition config vision ### Reported statistics lower 1235.2015357429118 rank 11 upper 1311.9049570737661 variance 382.8893604276267 votes 189 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label Claude Opus 4.6 Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/767/row` | | | | | 9 | [Claude Opus 4.6](https://benchize.com/models/claude-opus-4-6-high.md)High | 1,271.67 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1271.6666290639682 \| rating \| reported \| Higher is better \| ### Configuration category entity_recognition config vision Reasoning effort high thinkingEnabled true ### Reported statistics lower 1225.0822907672919 rank 12 upper 1318.2509673606446 variance 564.9157457705272 votes 125 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label Claude Opus 4.6 (High) Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/768/row` | | | | | 10 | [Qwen3.5 397B A17B](https://benchize.com/models/qwen3-5-397b-a17b.md) | 1,264.78 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1264.7777075197748 \| rating \| reported \| Higher is better \| ### Configuration category entity_recognition config vision ### Reported statistics lower 1228.0925247692526 rank 14 upper 1301.4628902702968 variance 350.3363425866521 votes 222 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/770/row` | | | | | 11 | [GPT-5](https://benchize.com/models/gpt-5-high.md)High | 1,262.58 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1262.5809739235285 \| rating \| reported \| Higher is better \| ### Configuration category entity_recognition config vision Reasoning effort high thinkingEnabled true ### Reported statistics lower 1232.4849502445459 rank 15 upper 1292.6769976025112 variance 235.78819494470522 votes 432 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label GPT-5 (High) Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/771/row` | | | | | 12 | [Gemini 2.5 Flash](https://benchize.com/models/gemini-2-5-flash.md) | 1,251.64 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1251.6437237658427 \| rating \| reported \| Higher is better \| ### Configuration category entity_recognition config vision ### Reported statistics lower 1227.8944230091643 rank 16 upper 1275.3930245225208 variance 146.82684697612967 votes 628 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label Gemini 2.5 Flash Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/772/row` | | | | | 13 | [GPT-5.4](https://benchize.com/models/gpt-5-4.md) | 1,251.13 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1251.1294095628514 \| rating \| reported \| Higher is better \| ### Configuration category entity_recognition config vision ### Reported statistics lower 1205.2335349609211 rank 18 upper 1297.0252841647819 variance 548.3415035269074 votes 137 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label GPT-5.4 Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/774/row` | | | | | 14 | [Qwen3 VL 235B A22B Instruct](https://benchize.com/models/qwen3-vl-235b-a22b-instruct.md) | 1,248.54 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1248.540528355999 \| rating \| reported \| Higher is better \| ### Configuration category entity_recognition config vision ### Reported statistics lower 1206.8327197721608 rank 19 upper 1290.2483369398374 variance 452.8335140533339 votes 151 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label Qwen3-VL-235B-A22B-Instruct Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/775/row` | | | | | 15 | [GPT-5.2](https://benchize.com/models/gpt-5-2-high.md)High | 1,231.96 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1231.964074713659 \| rating \| reported \| Higher is better \| ### Configuration category entity_recognition config vision Reasoning effort high thinkingEnabled true ### Reported statistics lower 1190.8395148076202 rank 24 upper 1273.0886346196976 variance 440.2570758678018 votes 168 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label GPT-5.2 (High) Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/780/row` | | | | | 16 | [GPT-5.1](https://benchize.com/models/gpt-5-1-high.md)High | 1,231.81 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1231.8116671913624 \| rating \| reported \| Higher is better \| ### Configuration category entity_recognition config vision Reasoning effort high thinkingEnabled true ### Reported statistics lower 1182.4612995147236 rank 25 upper 1281.1620348680012 variance 633.9932050551985 votes 112 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label GPT-5.1 (High) Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/781/row` | | | | | 17 | [GPT-5.5](https://benchize.com/models/gpt-5-5.md) | 1,231.28 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1231.2784312744789 \| rating \| reported \| Higher is better \| ### Configuration category entity_recognition config vision ### Reported statistics lower 1179.0193206225274 rank 26 upper 1283.53754192643 variance 710.9316469620309 votes 119 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label GPT-5.5 Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/782/row` | | | | | 18 | [GPT-5.4](https://benchize.com/models/gpt-5-4-high.md)High | 1,229.4 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1229.4048969948453 \| rating \| reported \| Higher is better \| ### Configuration category entity_recognition config vision Reasoning effort high thinkingEnabled true ### Reported statistics lower 1184.5937679926978 rank 27 upper 1274.216025996993 variance 522.7277907105816 votes 159 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label GPT-5.4 (High) Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/783/row` | | | | | 19 | [Claude Opus 4.7](https://benchize.com/models/claude-opus-4-7.md) | 1,226.17 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1226.166812425111 \| rating \| reported \| Higher is better \| ### Configuration category entity_recognition config vision ### Reported statistics lower 1182.658470402693 rank 28 upper 1269.6751544475292 variance 492.7752486482897 votes 154 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label Claude Opus 4.7 Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/784/row` | | | | | 20 | [GPT-5 Mini](https://benchize.com/models/gpt-5-mini-high.md)High | 1,226.03 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1226.0321800913969 \| rating \| reported \| Higher is better \| ### Configuration category entity_recognition config vision Reasoning effort high thinkingEnabled true ### Reported statistics lower 1190.4628041175185 rank 29 upper 1261.6015560652752 variance 329.3489703327089 votes 282 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label GPT-5 mini (High) Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/785/row` | | | | | 21 | [Gemma 4 31B](https://benchize.com/models/gemma-4-31b-it.md) | 1,225.71 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1225.7072113834445 \| rating \| reported \| Higher is better \| ### Configuration category entity_recognition config vision ### Reported statistics lower 1197.0043817282967 rank 30 upper 1254.4100410385922 variance 214.4634287823948 votes 359 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label Gemma 4 31B Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/786/row` | | | | | 22 | [GPT-5.5](https://benchize.com/models/gpt-5-5-high.md)High | 1,224.72 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1224.7200673944376 \| rating \| reported \| Higher is better \| ### Configuration category entity_recognition config vision Reasoning effort high thinkingEnabled true ### Reported statistics lower 1176.9859281666236 rank 31 upper 1272.4542066222514 variance 593.1465503536468 votes 130 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label GPT-5.5 (High) Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/787/row` | | | | | 23 | [GPT-5 Chat](https://benchize.com/models/gpt-5-chat.md) | 1,219.08 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1219.0810413948975 \| rating \| reported \| Higher is better \| ### Configuration category entity_recognition config vision ### Reported statistics lower 1186.3890139950483 rank 32 upper 1251.7730687947467 variance 278.2194747878019 votes 377 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label GPT-5 Chat Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/788/row` | | | | | 24 | [GPT-5.4 Mini](https://benchize.com/models/gpt-5-4-mini-high.md)High | 1,218.22 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1218.2159438730218 \| rating \| reported \| Higher is better \| ### Configuration category entity_recognition config vision Reasoning effort high thinkingEnabled true ### Reported statistics lower 1177.7101609103834 rank 33 upper 1258.7217268356603 variance 427.1081716606572 votes 183 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label GPT-5.4 mini (High) Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/789/row` | | | | | 25 | [Qwen3.5-27B](https://benchize.com/models/qwen3-5-27b.md) | 1,210.11 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1210.10867267618 \| rating \| reported \| Higher is better \| ### Configuration category entity_recognition config vision ### Reported statistics lower 1169.0480068457564 rank 36 upper 1251.1693385066042 variance 438.8901084544466 votes 187 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label Qwen3.5-27B Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/792/row` | | | | | 26 | [GPT-5.2](https://benchize.com/models/gpt-5-2.md) | 1,197.41 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1197.410413914079 \| rating \| reported \| Higher is better \| ### Configuration category entity_recognition config vision ### Reported statistics lower 1156.9005542817526 rank 38 upper 1237.9202735464055 variance 427.19414785611616 votes 176 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label GPT-5.2 Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/794/row` | | | | | 27 | [MiniMax M3](https://benchize.com/models/minimax-m3.md) | 1,196.75 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1196.7494623815019 \| rating \| reported \| Higher is better \| ### Configuration category entity_recognition config vision ### Reported statistics lower 1143.5952379269315 rank 39 upper 1249.903686836072 variance 735.4944330384125 votes 107 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label MiniMax-M3 Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/795/row` | | | | | 28 | [Gemma 3 27B](https://benchize.com/models/gemma-3-27b-it.md) | 1,196.02 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1196.0216482696978 \| rating \| reported \| Higher is better \| ### Configuration category entity_recognition config vision ### Reported statistics lower 1161.6771113992443 rank 40 upper 1230.3661851401516 variance 307.0571019769028 votes 313 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label Gemma 3 27B IT Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/796/row` | | | | | 29 | [Claude Sonnet 4.6](https://benchize.com/models/claude-sonnet-4-6.md) | 1,195.47 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1195.4717443715072 \| rating \| reported \| Higher is better \| ### Configuration category entity_recognition config vision ### Reported statistics lower 1149.8949084046055 rank 41 upper 1241.0485803384086 variance 540.7445644252697 votes 162 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label Claude Sonnet 4.6 Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/797/row` | | | | | 30 | [Gemma 4 26B A4B](https://benchize.com/models/gemma-4-26b-a4b-it.md) | 1,190.65 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1190.6465354821917 \| rating \| reported \| Higher is better \| ### Configuration category entity_recognition config vision ### Reported statistics lower 1154.5530742026308 rank 42 upper 1226.739996761753 variance 339.12583941321077 votes 235 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label Gemma 4 26B A4B Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/798/row` | | | | | 31 | [MiMo-V2.5](https://benchize.com/models/mimo-v2-5.md) | 1,188.64 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1188.6438029996154 \| rating \| reported \| Higher is better \| ### Configuration category entity_recognition config vision ### Reported statistics lower 1148.3256129329866 rank 43 upper 1228.9619930662443 variance 423.1612327826779 votes 185 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label MiMo-V2.5 Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/799/row` | | | | | 32 | [GPT-5.1](https://benchize.com/models/gpt-5-1.md) | 1,182.36 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1182.3582679526894 \| rating \| reported \| Higher is better \| ### Configuration category entity_recognition config vision ### Reported statistics lower 1139.3946109447973 rank 46 upper 1225.3219249605818 variance 480.51428107155255 votes 143 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label GPT-5.1 Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/802/row` | | | | | 33 | [Mistral Small 3.1 24B](https://benchize.com/models/mistral-small-3-1-24b-instruct.md) | 1,154.73 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1154.7263308805454 \| rating \| reported \| Higher is better \| ### Configuration category entity_recognition config vision ### Reported statistics lower 1113.9329533335103 rank 47 upper 1195.5197084275806 variance 433.19471309450455 votes 240 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label Mistral Small 3.1 24B Instruct (2503) Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/803/row` | | | | | 34 | [GPT-5.4 Nano](https://benchize.com/models/gpt-5-4-nano-high.md)High | 1,140.78 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1140.777609977281 \| rating \| reported \| Higher is better \| ### Configuration category entity_recognition config vision Reasoning effort high thinkingEnabled true ### Reported statistics lower 1098.392286866257 rank 50 upper 1183.1629330883045 variance 467.6649416487201 votes 178 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label GPT-5.4 nano (High) Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/806/row` | | | | --- Cite as: Arena vision / entity recognition (config: vision) — Benchize, https://benchize.com/benchmarks/benchmark%3Avision%3Aentity_recognition--config-vision (retrieved 2026-10-21)