# Qwen3.5 397B A17B > Source: Benchize (https://benchize.com) — https://benchize.com/models/qwen3-5-397b-a17b. When citing or reusing this content, credit "Benchize" and link to https://benchize.com/models/qwen3-5-397b-a17b. Alibaba Canonical URL: https://benchize.com/models/qwen3-5-397b-a17b Last updated: Thu, 22 Oct 2026 04:30:12 GMT Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations. Alibaba ## Benchmarks | Benchmark | Score | ± | Rank | Cost | Source | | | --- | --- | --- | --- | --- | --- | --- | | [Arena text style control / french](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Afrench.md) | 1,468.95 | — | 53 / 132 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1468.9470097570206 \| rating \| reported \| Higher is better \| ### Configuration category french config text_style_control ### Reported statistics lower 1456.526389540445 rank 82 upper 1481.3676299735962 variance 40.159692909719304 votes 3103 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/2919/row` | | | | | | | | [Arena text style control / industry mathematical](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aindustry_mathematical.md) | 1,454.55 | — | 55 / 148 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1454.5492212128238 \| rating \| reported \| Higher is better \| ### Configuration category industry_mathematical config text_style_control ### Reported statistics lower 1446.002866142906 rank 81 upper 1463.0955762827416 variance 19.013658193505826 votes 5556 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/5993/row` | | | | | | | | [Arena webdev / webdev-html](https://benchize.com/benchmarks/lmarena%3Awebdev%3Awebdev-html.md) | 1,409.63 | — | 60 / 89 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/webdev/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1409.625361532455 \| rating \| reported \| Higher is better \| ### Configuration category webdev-html config webdev ### Reported statistics lower 1397.5792348611403 rank 96 upper 1421.6714882037695 variance 37.7744951994921 votes 2604 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/webdev/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `f82507859808110820a4ab6df15561b8864137ddefc1f6fb0c552af2e58ea738` Source locator `/rows/455/row` | | | | | | | | [Arena text / math](https://benchize.com/benchmarks/lmarena%3Atext%3Amath.md) | 1,453.38 | — | 49 / 149 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1453.377786409216 \| rating \| reported \| Higher is better \| ### Configuration category math config text ### Reported statistics lower 1444.8242278326354 rank 70 upper 1461.9313449857966 variance 19.04572396529694 votes 5233 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/8982/row` | | | | | | | | [Arena text / industry business and management and financial operations](https://benchize.com/benchmarks/lmarena%3Atext%3Aindustry_business_and_management_and_financial_operations.md) | 1,434.79 | — | 48 / 151 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1434.7908310196829 \| rating \| reported \| Higher is better \| ### Configuration category industry_business_and_management_and_financial_operations config text ### Reported statistics lower 1429.598364722978 rank 66 upper 1439.983297316388 variance 7.01861128828792 votes 18962 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/4348/row` | | | | | | | | [Arena text / industry medicine and healthcare](https://benchize.com/benchmarks/lmarena%3Atext%3Aindustry_medicine_and_healthcare.md) | 1,455.32 | — | 40 / 151 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1455.3198874571303 \| rating \| reported \| Higher is better \| ### Configuration category industry_medicine_and_healthcare config text ### Reported statistics lower 1447.6139167071387 rank 62 upper 1463.025858207122 variance 15.458186061980486 votes 7090 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/6374/row` | | | | | | | | [DesignArena 3D design generation](https://benchize.com/benchmarks/designarena%3A3d-design.md) | 1,161elo | — | 48 / 110 | — | [designarena · public](https://www.designarena.ai/api/leaderboard#board=3d-design) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 1161 \| elo \| 3d-design \| Higher is better \| ### Configuration arenaType models category 3d inputModality Not reported sourceModelVersion qwen3.5-397b-a17b variationName public ### Reported statistics averageGenerationTimeMs 104740 battles 960 losses 416 standardError Not reported winRate 56.7 wins 544 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=3d-design) Source designarena Original model label Qwen3.5 397B A17B Source version public Observed 2026-10-21T16:37:58.515Z Evidence SHA-256 `bcc0267f7bc7e9ec112306b3a35413cf78bbccbfaa838356232d5d5ed0b83d0f` Source locator `/data/77` | | | | | | | | [Arena webdev / webdev](https://benchize.com/benchmarks/lmarena%3Awebdev%3Awebdev.md) | 1,400.42 | — | 59 / 90 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/webdev/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1400.4186856730862 \| rating \| reported \| Higher is better \| ### Configuration category webdev config webdev ### Reported statistics lower 1395.2889932431185 rank 97 upper 1405.5483781030543 variance 6.849935312157123 votes 21156 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/webdev/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `f82507859808110820a4ab6df15561b8864137ddefc1f6fb0c552af2e58ea738` Source locator `/rows/308/row` | | | | | | | | [Arena text / hard prompts](https://benchize.com/benchmarks/lmarena%3Atext%3Ahard_prompts.md) | 1,447.76 | — | 51 / 151 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1447.7588316903516 \| rating \| reported \| Higher is better \| ### Configuration category hard_prompts config text ### Reported statistics lower 1444.1142906734735 rank 79 upper 1451.4033727072297 variance 3.457717456751795 votes 62653 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/3529/row` | | | | | | | | [Arena text / industry entertainment and sports and media](https://benchize.com/benchmarks/lmarena%3Atext%3Aindustry_entertainment_and_sports_and_media.md) | 1,398.71 | — | 60 / 151 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1398.710799835689 \| rating \| reported \| Higher is better \| ### Configuration category industry_entertainment_and_sports_and_media config text ### Reported statistics lower 1393.604845640928 rank 100 upper 1403.8167540304498 variance 6.7866842925797455 votes 21623 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/4792/row` | | | | | | | | [Arena text style control / russian](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Arussian.md) | 1,435.64 | — | 60 / 150 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1435.6355269323944 \| rating \| reported \| Higher is better \| ### Configuration category russian config text_style_control ### Reported statistics lower 1429.3393290872805 rank 99 upper 1441.9317247775084 variance 10.31954503618851 votes 10945 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/10482/row` | | | | | | | | [Kangaroo 2025 5-6](https://benchize.com/benchmarks/matharena%3Akangaroo--kangaroo_2025_5-6.md) | 74.91% | — | 8 / 16 | 0.06usd per problem | [matharena · kangaroo--kangaroo_2025_5-6](https://matharena.ai/competition_tables/kangaroo--kangaroo_2025_5-6) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 74.91 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.059 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition kangaroo--kangaroo_2025_5-6 predicted true sourceModelName Qwen3.5-397b-a17b sourceModelVersion qwen/qwen3.5_397b ### Reported statistics confidenceInterval95 Not reported problems 30 ### Source [Original source](https://matharena.ai/competition_tables/kangaroo--kangaroo_2025_5-6) Source matharena Original model label Qwen3.5-397b-a17b Source version kangaroo--kangaroo_2025_5-6 Observed 2026-10-21T16:52:32.526Z Evidence SHA-256 `9460cafccce0b6f3ba1f90e1090be31d6cf94dd10b9157819abc97efe624b126` Source locator `/table/rows/9` | | | | | | | | [ArXivMath 01/2026](https://benchize.com/benchmarks/matharena%3Aarxiv--january.md) | 54.89% | 95% CI 47.7–62.08% | 11 / 18 | 0.13usd per problem | [matharena · arxiv--january](https://matharena.ai/competition_tables/arxiv--january) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 54.89 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.13 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition arxiv--january predicted false sourceModelName Qwen3.5-397b-a17b sourceModelVersion qwen/qwen3.5_397b ### Reported statistics Uncertainty 95% confidence interval: 47.7–62.08% confidenceInterval95 7.19 problems 23 ### Source [Original source](https://matharena.ai/competition_tables/arxiv--january) Source matharena Original model label Qwen3.5-397b-a17b Source version arxiv--january Observed 2026-10-21T16:52:27.447Z Evidence SHA-256 `e895f6ccd0711bb1a512b580bab39de8f977c57f83bf492527e4fc710315d706` Source locator `/table/rows/14` | | | | | | | | [DesignArena UI component generation](https://benchize.com/benchmarks/designarena%3Aui-components.md) | 1,163elo | — | 64 / 112 | — | [designarena · public](https://www.designarena.ai/api/leaderboard#board=ui-components) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 1163 \| elo \| ui-components \| Higher is better \| ### Configuration arenaType models category uicomponent inputModality Not reported sourceModelVersion qwen3.5-397b-a17b variationName public ### Reported statistics averageGenerationTimeMs 133187 battles 488 losses 237 standardError Not reported winRate 51.4 wins 251 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=ui-components) Source designarena Original model label Qwen3.5 397B A17B Source version public Observed 2026-10-21T16:37:57.993Z Evidence SHA-256 `46482ec1b4012638eace65493daea4750e2088098018fd9d5fc46126fc1f8557` Source locator `/data/97` | | | | | | | | [SVGBench Arena](https://benchize.com/benchmarks/svgbench%3Aarena.md) | 1,586 | — | 36 / 191 | — | [svgbench](https://svgbench.ai/api/leaderboard?shape=2) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1586 \| rating \| reported \| Higher is better \| ### Configuration Reasoning effort unknown sourceModelId model_qwen_qwen3_5_397b_a17b ### Reported statistics coverageCount 27 draws 7 judged 73 losses 28 rank 44 ratingDeviation 28 wins 38 ### Source [Original source](https://svgbench.ai/api/leaderboard?shape=2) Source svgbench Original model label Qwen3.5 397B A17B Observed 2026-10-22T04:30:04.538Z Evidence SHA-256 `5c0a9c869593820d57d2c05f6d416e1b44a740b4835e66c66e9ad8b8edc59e2c` Source locator `/rows/42` | | | | | | | | [Arena text / russian](https://benchize.com/benchmarks/lmarena%3Atext%3Arussian.md) | 1,429.57 | — | 52 / 150 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1429.5719817517438 \| rating \| reported \| Higher is better \| ### Configuration category russian config text ### Reported statistics lower 1423.2948975300803 rank 82 upper 1435.8490659734075 variance 10.256985214470719 votes 10945 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/10465/row` | | | | | | | | [Arena vision / english (config: vision)](https://benchize.com/benchmarks/benchmark%3Avision%3Aenglish--config-vision.md) | 1,268.45 | — | 40 / 82 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1268.4533140856306 \| rating \| reported \| Higher is better \| ### Configuration category english config vision ### Reported statistics lower 1261.0035945567784 rank 51 upper 1275.9030336144824 variance 14.447199267004924 votes 12659 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/640/row` | | | | | | | | [Arena text / coding](https://benchize.com/benchmarks/lmarena%3Atext%3Acoding.md) | 1,464.25 | — | 52 / 151 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1464.2476241078691 \| rating \| reported \| Higher is better \| ### Configuration category coding config text ### Reported statistics lower 1459.5083521188255 rank 82 upper 1468.9868960969125 variance 5.846919109254962 votes 26863 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/891/row` | | | | | | | | [Arena text / korean](https://benchize.com/benchmarks/lmarena%3Atext%3Akorean.md) | 1,384.45 | — | 49 / 124 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1384.4456462966307 \| rating \| reported \| Higher is better \| ### Configuration category korean config text ### Reported statistics lower 1368.243440443561 rank 85 upper 1400.6478521497004 variance 68.33640206972554 votes 1590 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/8318/row` | | | | | | | | [Arena text style control / multi turn](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Amulti_turn.md) | 1,452.99 | — | 53 / 151 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1452.9916503804916 \| rating \| reported \| Higher is better \| ### Configuration category multi_turn config text_style_control ### Reported statistics lower 1447.3225928110433 rank 83 upper 1458.6607079499395 variance 8.366148181150814 votes 15321 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/9398/row` | | | | | | | | [Kangaroo 2025 11-12](https://benchize.com/benchmarks/matharena%3Akangaroo--kangaroo_2025_11-12.md) | 91.67% | 95% CI 86.72–96.62% | 10 / 16 | 0.04usd per problem | [matharena · kangaroo--kangaroo_2025_11-12](https://matharena.ai/competition_tables/kangaroo--kangaroo_2025_11-12) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 91.67 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.037 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition kangaroo--kangaroo_2025_11-12 predicted false sourceModelName Qwen3.5-397b-a17b sourceModelVersion qwen/qwen3.5_397b ### Reported statistics Uncertainty 95% confidence interval: 86.72–96.62% confidenceInterval95 4.95 problems 30 ### Source [Original source](https://matharena.ai/competition_tables/kangaroo--kangaroo_2025_11-12) Source matharena Original model label Qwen3.5-397b-a17b Source version kangaroo--kangaroo_2025_11-12 Observed 2026-10-21T16:52:34.045Z Evidence SHA-256 `1e53cfaa398a3ab9a1de8f0f33a4b2499b23b5df61a94735b6b646efc684444c` Source locator `/table/rows/11` | | | | | | | | [Arena vision style control / chinese](https://benchize.com/benchmarks/lmarena%3Avision_style_control%3Achinese.md) | 1,291.25 | — | 39 / 74 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1291.2544253937394 \| rating \| reported \| Higher is better \| ### Configuration category chinese config vision_style_control ### Reported statistics lower 1275.877010788798 rank 49 upper 1306.6318399986806 variance 61.556010612013424 votes 2045 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `38568936995f36625aae49e9ea05557d55c1b1df9b2954f5c50cee523f26fe92` Source locator `/rows/249/row` | | | | | | | | [Arena text / english](https://benchize.com/benchmarks/lmarena%3Atext%3Aenglish.md) | 1,442.87 | — | 53 / 151 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1442.8716891975362 \| rating \| reported \| Higher is better \| ### Configuration category english config text ### Reported statistics lower 1438.853108395972 rank 86 upper 1446.8902699991004 variance 4.2038695226160625 votes 41872 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/1722/row` | | | | | | | | [SpreadsheetBench v2-full](https://benchize.com/benchmarks/spreadsheetbench%3Av2-full.md) | 11.22% | — | 5 / 6 | — | [spreadsheetbench](https://spreadsheetbench.github.io/data/leaderboard-v2-full.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 11.22 \| percent \| reported \| Higher is better \| \| `Template` \| 17.53 \| percent \| task_category \| Higher is better \| \| `Fin.Model` \| 10 \| percent \| task_category \| Higher is better \| \| `Debug` \| 3 \| percent \| task_category \| Higher is better \| \| `Visualization` \| 25 \| percent \| task_category \| Higher is better \| ### Configuration Reasoning effort unknown scaffold SWE-agent verifiedSubmission true ### Source [Original source](https://spreadsheetbench.github.io/data/leaderboard-v2-full.json) Source spreadsheetbench Original model label Qwen3.5-397B-A17B Observed 2026-10-22T04:20:04.823Z Evidence SHA-256 `56490b18fd005f51e088710996636a4de82054809673f24cca40200915be338a` Source locator `/rows/9` | | | | | | | | [OTIS Mock AIME 2024–2025](https://benchize.com/benchmarks/epoch-ai%3Aotis_mock_aime_2024_2025.md) | 88.89% | SE ±4.74 pp | 44 / 124 | — | [epoch ai · OTIS Mock AIME 2024-2025](https://epoch.ai/data/benchmark_data.zip#file=otis_mock_aime_2024_2025.csv) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.8888888888888888 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.8888888888888888 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion OTIS Mock AIME 2024-2025 reasoningBudget Not reported Reasoning effort Not reported sourceModelVersion qwen3.5-397b-a17b ### Reported statistics Uncertainty Standard error: ±4.74 pp standardError 0.04737793696791343 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=otis_mock_aime_2024_2025.csv) Source epoch ai Original model label qwen3.5-397b-a17b Source version OTIS Mock AIME 2024-2025 Evaluated 2026-08-07T00:12:18.000Z Observed 2026-10-22T03:00:05.281Z Evidence SHA-256 `b7c9da8c0587c82f1e0d814ceb496c24308380b997a16203b6e5d39eb07f4f50` Source locator `/rows/98` | | | | | | | | [Arena text / longer query](https://benchize.com/benchmarks/lmarena%3Atext%3Alonger_query.md) | 1,441.31 | — | 54 / 150 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1441.3075734847832 \| rating \| reported \| Higher is better \| ### Configuration category longer_query config text ### Reported statistics lower 1437.01675711605 rank 76 upper 1445.5983898535164 variance 4.792737855474877 votes 41898 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/8593/row` | | | | | | | | [FrontierMath Tiers 1–3 v2 (private)](https://benchize.com/benchmarks/epoch-ai%3Afrontiermath_tiers_1_3_v2.md) | 29.47% | SE ±2.71 pp | 37 / 50 | — | [epoch ai · FrontierMath-Tiers-1-3-v2-Private](https://epoch.ai/data/benchmark_data.zip#file=frontiermath_tiers_1_3_v2.csv) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.29473684210526313 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.29473684210526313 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion FrontierMath-Tiers-1-3-v2-Private reasoningBudget Not reported Reasoning effort Not reported sourceModelVersion qwen3.5-397b-a17b ### Reported statistics Uncertainty Standard error: ±2.71 pp standardError 0.02705413430767295 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=frontiermath_tiers_1_3_v2.csv) Source epoch ai Original model label qwen3.5-397b-a17b Source version FrontierMath-Tiers-1-3-v2-Private Evaluated 2026-08-28T12:28:11.000Z Observed 2026-10-22T03:00:05.281Z Evidence SHA-256 `d3458d4272f99e04212525904a59fffffa7a94e827c62b26e36e3fd3e15fe587` Source locator `/rows/47` | | | | | | | | [Arena text / chinese](https://benchize.com/benchmarks/lmarena%3Atext%3Achinese.md) | 1,498.4 | — | 40 / 146 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1498.4034115453726 \| rating \| reported \| Higher is better \| ### Configuration category chinese config text ### Reported statistics lower 1490.529956931363 rank 55 upper 1506.2768661593823 variance 16.137433837613884 votes 6635 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/471/row` | | | | | | | | [GPQA Diamond](https://benchize.com/benchmarks/gpqa-diamond.md) | 85.86% | SE ±2.48 pp | 46 / 126 | — | [epoch ai · GPQA diamond](https://epoch.ai/data/benchmark_data.zip#file=gpqa_diamond.csv) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.8585858585858586 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.8585858585858586 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion GPQA diamond reasoningBudget Not reported Reasoning effort Not reported sourceModelVersion qwen3.5-397b-a17b ### Reported statistics Uncertainty Standard error: ±2.48 pp standardError 0.024825909793343353 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=gpqa_diamond.csv) Source epoch ai Original model label qwen3.5-397b-a17b Source version GPQA diamond Evaluated 2026-08-07T00:24:06.000Z Observed 2026-10-22T03:00:05.281Z Evidence SHA-256 `9ef0b938bdd8406b029d595983ee8ad3a80bd9d64b82605b91b5ce39ba650c39` Source locator `/rows/89` | | | | | | | | [Arena text style control / longer query](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Alonger_query.md) | 1,452.8 | — | 54 / 150 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1452.7990111964014 \| rating \| reported \| Higher is better \| ### Configuration category longer_query config text_style_control ### Reported statistics lower 1448.4723849068148 rank 84 upper 1457.125637485988 variance 4.873069300885924 votes 41898 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/8601/row` | | | | | | | | [ArXivMath 12/2025](https://benchize.com/benchmarks/matharena%3Aarxiv--december.md) | 38.24% | 95% CI 30.07–46.41% | 10 / 12 | 0.13usd per problem | [matharena · arxiv--december](https://matharena.ai/competition_tables/arxiv--december) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 38.24 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.13 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition arxiv--december predicted false sourceModelName Qwen3.5-397b-a17b sourceModelVersion qwen/qwen3.5_397b ### Reported statistics Uncertainty 95% confidence interval: 30.07–46.41% confidenceInterval95 8.17 problems 17 ### Source [Original source](https://matharena.ai/competition_tables/arxiv--december) Source matharena Original model label Qwen3.5-397b-a17b Source version arxiv--december Observed 2026-10-21T16:52:26.934Z Evidence SHA-256 `6bbceef2706ad55e793e81bd959f7c1ec869f0ad04c6aa9013b2ad7b1a0820e3` Source locator `/table/rows/13` | | | | | | | | [Arena text / german](https://benchize.com/benchmarks/lmarena%3Atext%3Agerman.md) | 1,444.68 | — | 38 / 129 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1444.684953117593 \| rating \| reported \| Higher is better \| ### Configuration category german config text ### Reported statistics lower 1428.2907522962528 rank 63 upper 1461.0791539389334 variance 69.96556077148489 votes 1474 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/3199/row` | | | | | | | | [Arena vision style control / english](https://benchize.com/benchmarks/lmarena%3Avision_style_control%3Aenglish.md) | 1,250 | — | 44 / 82 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1249.9986417275798 \| rating \| reported \| Higher is better \| ### Configuration category english config vision_style_control ### Reported statistics lower 1242.5199235600817 rank 57 upper 1257.4773598950778 variance 14.559891968009923 votes 12659 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `38568936995f36625aae49e9ea05557d55c1b1df9b2954f5c50cee523f26fe92` Source locator `/rows/646/row` | | | | | | | | [Arena webdev / overall](https://benchize.com/benchmarks/lmarena%3Awebdev%3Aoverall.md) | 1,400.42 | — | 59 / 90 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/webdev/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1400.4186856730862 \| rating \| reported \| Higher is better \| ### Configuration category overall config webdev ### Reported statistics lower 1395.2889932431185 rank 97 upper 1405.5483781030543 variance 6.849935312157123 votes 21156 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/webdev/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `f82507859808110820a4ab6df15561b8864137ddefc1f6fb0c552af2e58ea738` Source locator `/rows/96/row` | | | | | | | | [Arena vision style control / creative writing vision](https://benchize.com/benchmarks/lmarena%3Avision_style_control%3Acreative_writing_vision.md) | 1,244.04 | — | 39 / 70 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1244.041037573844 \| rating \| reported \| Higher is better \| ### Configuration category creative_writing_vision config vision_style_control ### Reported statistics lower 1231.0795021745482 rank 50 upper 1257.0025729731399 variance 43.73375005405927 votes 2304 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `38568936995f36625aae49e9ea05557d55c1b1df9b2954f5c50cee523f26fe92` Source locator `/rows/412/row` | | | | | | | | [Arena text / exclude ties](https://benchize.com/benchmarks/lmarena%3Atext%3Aexclude_ties.md) | 1,432.98 | — | 50 / 151 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1432.9802475560398 \| rating \| reported \| Higher is better \| ### Configuration category exclude_ties config text ### Reported statistics lower 1428.8856166256467 rank 79 upper 1437.074878486433 variance 4.364488398473124 votes 69593 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/2132/row` | | | | | | | | [Arena vision style control / humor](https://benchize.com/benchmarks/lmarena%3Avision_style_control%3Ahumor.md) | 1,241.99 | — | 36 / 63 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1241.993659317402 \| rating \| reported \| Higher is better \| ### Configuration category humor config vision_style_control ### Reported statistics lower 1224.6742084976147 rank 46 upper 1259.3131101371898 variance 78.08579779200595 votes 1223 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `38568936995f36625aae49e9ea05557d55c1b1df9b2954f5c50cee523f26fe92` Source locator `/rows/971/row` | | | | | | | | [Creative Writing v3](https://benchize.com/benchmarks/eq-bench%3Acreative-writing-v3.md) | 1,478.2elo | — | 54 / 90 | — | [eq bench · creative-writing-v3](https://eqbench.com/creative_writing.js) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo_score` \| 1478.2 \| elo \| overall \| Higher is better \| \| `creative_writing_score` \| 16.00 \| rubric_score \| overall \| Higher is better \| ### Configuration interactiveAdjustments none protocol creative-writing-v3 sourceModelVersion Qwen/Qwen3.5-397B-A17B ### Source [Original source](https://eqbench.com/creative_writing.js) Source eq bench Original model label Qwen/Qwen3.5-397B-A17B Source version creative-writing-v3 Observed 2026-10-21T16:35:01.421Z Evidence SHA-256 `722ddb132e8d3a5e5c39b8d445f8475f3f7e24893a007260c6f3e3cce5c1ee18` Source locator `/leaderboardDataCreativeWritingV3/67` | | | | | | | | [Arena text / overall](https://benchize.com/benchmarks/lmarena%3Atext.md) | 1,437.49 | — | 51 / 151 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1437.4909107334572 \| rating \| reported \| Higher is better \| ### Configuration category overall config text ### Reported statistics lower 1434.438319282118 rank 81 upper 1440.5435021847964 variance 2.4257228838667038 votes 95123 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/80/row` | | | | | | | | [Arena text / french](https://benchize.com/benchmarks/lmarena%3Atext%3Afrench.md) | 1,461.72 | — | 41 / 132 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1461.7218154534594 \| rating \| reported \| Higher is better \| ### Configuration category french config text ### Reported statistics lower 1449.3933558791591 rank 59 upper 1474.0502750277592 variance 39.56593642403971 votes 3103 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/2896/row` | | | | | | | | [Arena text style control / industry legal and government](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aindustry_legal_and_government.md) | 1,445.68 | — | 62 / 151 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1445.677684042054 \| rating \| reported \| Higher is better \| ### Configuration category industry_legal_and_government config text_style_control ### Reported statistics lower 1438.1186123403452 rank 103 upper 1453.2367557437628 variance 14.874444230343421 votes 7335 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/5210/row` | | | | | | | | [Longform Creative Writing](https://benchize.com/benchmarks/eq-bench%3Alongform-writing.md) | 68.3% | — | 39 / 93 | — | [eq bench · longform-writing](https://eqbench.com/creative_writing_longform.js) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `overall_score_100` \| 68.3 \| percent \| overall \| Higher is better \| \| `chapter1_avg` \| 15.31 \| rubric_score \| overall \| Higher is better \| \| `chapter2_avg` \| 14.87 \| rubric_score \| overall \| Higher is better \| \| `chapter3_avg` \| 14.64 \| rubric_score \| overall \| Higher is better \| \| `chapter4_avg` \| 14.31 \| rubric_score \| overall \| Higher is better \| \| `chapter5_avg` \| 13.91 \| rubric_score \| overall \| Higher is better \| \| `chapter6_avg` \| 14.34 \| rubric_score \| overall \| Higher is better \| \| `chapter7_avg` \| 14.09 \| rubric_score \| overall \| Higher is better \| \| `chapter8_avg` \| 14.14 \| rubric_score \| overall \| Higher is better \| \| `final_judgement_avg` \| 12.79 \| rubric_score \| overall \| Higher is better \| ### Configuration interactiveAdjustments none protocol longform-writing sourceModelVersion Qwen/Qwen3.5-397B-A17B ### Source [Original source](https://eqbench.com/creative_writing_longform.js) Source eq bench Original model label Qwen/Qwen3.5-397B-A17B Source version longform-writing Observed 2026-10-21T16:35:02.575Z Evidence SHA-256 `3ba283ce357ac7620e16db640a961879c30fe3ddc50a27de9a8ed4290784825c` Source locator `/leaderboardDataLongformV3/13` | | | | | | | | [Arena vision / humor (config: vision)](https://benchize.com/benchmarks/benchmark%3Avision%3Ahumor--config-vision.md) | 1,261.88 | — | 32 / 63 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1261.87693537721 \| rating \| reported \| Higher is better \| ### Configuration category humor config vision ### Reported statistics lower 1244.672059827201 rank 42 upper 1279.0818109272186 variance 77.05607596173655 votes 1223 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/967/row` | | | | | | | | [Arena text style control / coding](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Acoding.md) | 1,491.19 | — | 58 / 151 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1491.1930645133675 \| rating \| reported \| Higher is better \| ### Configuration category coding config text_style_control ### Reported statistics lower 1486.421120810996 rank 94 upper 1495.9650082157389 variance 5.927812261303192 votes 26863 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/903/row` | | | | | | | | [Arena vision / captioning (config: vision)](https://benchize.com/benchmarks/benchmark%3Avision%3Acaptioning--config-vision.md) | 1,229.7 | — | 12 / 22 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1229.6993078212156 \| rating \| reported \| Higher is better \| ### Configuration category captioning config vision ### Reported statistics lower 1172.9633100356807 rank 15 upper 1286.4353056067505 variance 837.9559940560723 votes 78 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/181/row` | | | | | | | | [Arena vision style control / ocr](https://benchize.com/benchmarks/lmarena%3Avision_style_control%3Aocr.md) | 1,260.16 | — | 46 / 74 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1260.1596381338738 \| rating \| reported \| Higher is better \| ### Configuration category ocr config vision_style_control ### Reported statistics lower 1254.9590939935085 rank 59 upper 1265.360182274239 variance 7.040465775707531 votes 22696 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `38568936995f36625aae49e9ea05557d55c1b1df9b2954f5c50cee523f26fe92` Source locator `/rows/1077/row` | | | | | | | | [Judgemark v4](https://benchize.com/benchmarks/eq-bench%3Ajudgemark-v4.md) | 54.24% | CI 48.53–62.05% | 21 / 38 | — | [eq bench · judgemark-v4](https://eqbench.com/judgemark-v4.js) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.542445 \| score_fraction \| overall \| Higher is better \| ### Configuration interactiveAdjustments none protocol judgemark-v4 sourceModelVersion Qwen/Qwen3.5-397B-A17B ### Reported statistics Uncertainty Confidence interval: 48.53–62.05% confidenceIntervalHigh 0.620456 confidenceIntervalLow 0.485310 ### Source [Original source](https://eqbench.com/judgemark-v4.js) Source eq bench Original model label Qwen/Qwen3.5-397B-A17B Source version judgemark-v4 Observed 2026-10-21T16:35:03.901Z Evidence SHA-256 `2b0d42aef4f614dd199dc38399be7b88075a919db52020c3759f190defc92a4d` Source locator `/leaderboardDataJudgemarkV4/22` | | | | | | | | [Arena vision / chinese (config: vision)](https://benchize.com/benchmarks/benchmark%3Avision%3Achinese--config-vision.md) | 1,313.96 | — | 34 / 74 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1313.9609595219395 \| rating \| reported \| Higher is better \| ### Configuration category chinese config vision ### Reported statistics lower 1298.7012722773727 rank 43 upper 1329.2206467665064 variance 60.61708993145447 votes 2045 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/243/row` | | | | | | | | [Arena webdev / webdev-react](https://benchize.com/benchmarks/lmarena%3Awebdev%3Awebdev-react.md) | 1,387.64 | — | 58 / 81 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/webdev/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1387.6398857598383 \| rating \| reported \| Higher is better \| ### Configuration category webdev-react config webdev ### Reported statistics lower 1381.942205100097 rank 95 upper 1393.33756641958 variance 8.450842873938898 votes 16758 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/webdev/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `f82507859808110820a4ab6df15561b8864137ddefc1f6fb0c552af2e58ea738` Source locator `/rows/601/row` | | | | | | | | [DesignArena Overall frontend coding](https://benchize.com/benchmarks/designarena%3Acode.md) | 1,180elo | SE ±3.98 | 54 / 116 | — | [designarena · public](https://www.designarena.ai/api/leaderboard#board=code) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 1180 \| elo \| code \| Higher is better \| ### Configuration arenaType models category allcategories inputModality text sourceModelVersion qwen3.5-397b-a17b variationName public ### Reported statistics Uncertainty Standard error: ±3.98 averageGenerationTimeMs 135674 battles 8130 losses 3850 standardError 3.9832 winRate 52.6 wins 4280 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=code) Source designarena Original model label Qwen3.5 397B A17B Source version public Observed 2026-10-21T16:37:57.301Z Evidence SHA-256 `0c897b58670f5e352bd123db999a40c0d1781a443964c502b90774a76a3a7758` Source locator `/data/87` | | | | | | | | [PerceptionBench](https://benchize.com/benchmarks/perceptionbench.md) | 47.5% | — | 7 / 14 | — | [Moonshot AI / PerceptionBench · ba032c06e9b6ee3679171ff6ba643b7a0cfebe2e](https://github.com/MoonshotAI/PerceptionBench) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 47.5 \| percent \| overall \| Higher is better \| \| `visual_relation_accuracy` \| 55.2 \| percent \| atomic_capability \| Higher is better \| \| `counting_accuracy` \| 49.1 \| percent \| atomic_capability \| Higher is better \| \| `attribute_accuracy` \| 53.0 \| percent \| atomic_capability \| Higher is better \| \| `depth_3d_accuracy` \| 44.6 \| percent \| atomic_capability \| Higher is better \| \| `localization_accuracy` \| 46.7 \| percent \| atomic_capability \| Higher is better \| \| `comparison_accuracy` \| 49.8 \| percent \| atomic_capability \| Higher is better \| \| `fine_grained_recognition_accuracy` \| 44.8 \| percent \| atomic_capability \| Higher is better \| \| `contextual_integration_accuracy` \| 50.2 \| percent \| atomic_capability \| Higher is better \| \| `ocr_accuracy` \| 52.9 \| percent \| atomic_capability \| Higher is better \| \| `hallucination_accuracy` \| 26.9 \| percent \| atomic_capability \| Higher is better \| ### Configuration judgeModel gpt-oss-120b promptProtocol unified reasoningBudgetPolicy highest_available ### Reported statistics sampleSize 3000 ### Source Score publisher [Moonshot AI / PerceptionBench](https://github.com/MoonshotAI/PerceptionBench) Collected via [perceptionbench](https://api.github.com/repos/MoonshotAI/PerceptionBench/contents/README.md?ref=ba032c06e9b6ee3679171ff6ba643b7a0cfebe2e) Publisher reference Referenced by the collection source; the upstream result has not been independently captured. Benchmark [https://api.github.com/repos/MoonshotAI/PerceptionBench/contents/README.md?ref=ba032c06e9b6ee3679171ff6ba643b7a0cfebe2e](https://api.github.com/repos/MoonshotAI/PerceptionBench/contents/README.md?ref=ba032c06e9b6ee3679171ff6ba643b7a0cfebe2e) [Collected via](https://api.github.com/repos/MoonshotAI/PerceptionBench/contents/README.md?ref=ba032c06e9b6ee3679171ff6ba643b7a0cfebe2e) Source Moonshot AI / PerceptionBench Original model label Qwen3.5-397B-A17B Source version ba032c06e9b6ee3679171ff6ba643b7a0cfebe2e Observed 2026-10-21T16:33:36.858Z Evidence SHA-256 `0863d20bc397e2324ea76099fe703aed419dc7f0dbb359e522f7dac07dda6529` Source locator `/leaderboard/rows/8` | | | | | | | | [Arena vision / overall (config: vision)](https://benchize.com/benchmarks/benchmark%3Avision%3Aoverall--config-vision.md) | 1,262.47 | — | 43 / 82 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1262.4660916015766 \| rating \| reported \| Higher is better \| ### Configuration category overall config vision ### Reported statistics lower 1257.1891508537085 rank 54 upper 1267.7430323494445 variance 7.248835652357253 votes 32657 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/53/row` | | | | | | | | [Arena text style control / industry business and management and financial operations](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aindustry_business_and_management_and_financial_operations.md) | 1,445.86 | — | 55 / 151 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1445.860839661064 \| rating \| reported \| Higher is better \| ### Configuration category industry_business_and_management_and_financial_operations config text_style_control ### Reported statistics lower 1440.6245313300565 rank 85 upper 1451.0971479920715 variance 7.137633440106661 votes 18962 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/4367/row` | | | | | | | | [DesignArena Browser game generation](https://benchize.com/benchmarks/designarena%3Agame-dev.md) | 1,140elo | — | 70 / 117 | — | [designarena · public](https://www.designarena.ai/api/leaderboard#board=game-dev) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 1140 \| elo \| game-dev \| Higher is better \| ### Configuration arenaType models category gamedev inputModality Not reported sourceModelVersion qwen3.5-397b-a17b variationName public ### Reported statistics averageGenerationTimeMs 142465 battles 1162 losses 579 standardError Not reported winRate 50.2 wins 583 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=game-dev) Source designarena Original model label Qwen3.5 397B A17B Source version public Observed 2026-10-21T16:38:01.100Z Evidence SHA-256 `53db6a89112ce8cdf644568c666d4b8309aece764cfcedb291ffd52ae3934e30` Source locator `/data/105` | | | | | | | | [Arena text style control / overall](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aoverall.md) | 1,441.32 | — | 56 / 151 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1441.315663528568 \| rating \| reported \| Higher is better \| ### Configuration category overall config text_style_control ### Reported statistics lower 1438.2417907698289 rank 94 upper 1444.389536287307 variance 2.459662898380577 votes 95123 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/93/row` | | | | | | | | [Arena text style control / non english](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Anon_english.md) | 1,431.59 | — | 53 / 151 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1431.5938049753781 \| rating \| reported \| Higher is better \| ### Configuration category non_english config text_style_control ### Reported statistics lower 1427.8798114158817 rank 87 upper 1435.3077985348746 variance 3.5907577833904187 votes 53245 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/9817/row` | | | | | | | | [Kangaroo 2025 3-4](https://benchize.com/benchmarks/matharena%3Akangaroo--kangaroo_2025_3-4.md) | 68.75% | 95% CI 59.48–78.02% | 6 / 16 | 0.04usd per problem | [matharena · kangaroo--kangaroo_2025_3-4](https://matharena.ai/competition_tables/kangaroo--kangaroo_2025_3-4) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 68.75 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.044 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition kangaroo--kangaroo_2025_3-4 predicted false sourceModelName Qwen3.5-397b-a17b sourceModelVersion qwen/qwen3.5_397b ### Reported statistics Uncertainty 95% confidence interval: 59.48–78.02% confidenceInterval95 9.27 problems 24 ### Source [Original source](https://matharena.ai/competition_tables/kangaroo--kangaroo_2025_3-4) Source matharena Original model label Qwen3.5-397b-a17b Source version kangaroo--kangaroo_2025_3-4 Observed 2026-10-21T16:52:32.012Z Evidence SHA-256 `38fec99c55752fef6703c9ed49d9e1e204b235f2bd78d5ee47725dac9e5da89c` Source locator `/table/rows/6` | | | | | | | | [EQ-Bench 3](https://benchize.com/benchmarks/eq-bench%3Aeqbench3.md) | 1,413.1elo | CI 1,381.4–1,444.9 | 22 / 50 | — | [eq bench · eqbench3](https://eqbench.com/eqbench3.js) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo_norm` \| 1413.1 \| elo \| overall \| Higher is better \| \| `rubric_0_100` \| 71.3 \| percent \| overall \| Higher is better \| ### Configuration interactiveAdjustments none protocol eqbench3 sourceModelVersion Qwen/Qwen3.5-397B-A17B ### Reported statistics Uncertainty Confidence interval: 1,381.4–1,444.9 confidenceIntervalHigh 1444.9 confidenceIntervalLow 1381.4 ### Source [Original source](https://eqbench.com/eqbench3.js) Source eq bench Original model label Qwen/Qwen3.5-397B-A17B Source version eqbench3 Observed 2026-10-21T16:35:00.608Z Evidence SHA-256 `3672ff093e739f07ff664a2e6013bc38a6977a146e4092b4cef80ba1780542b2` Source locator `/leaderboardDataEQBench3/29` | | | | | | | | [Arena text / industry legal and government](https://benchize.com/benchmarks/lmarena%3Atext%3Aindustry_legal_and_government.md) | 1,440.95 | — | 52 / 151 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1440.9516185019681 \| rating \| reported \| Higher is better \| ### Configuration category industry_legal_and_government config text ### Reported statistics lower 1433.4739036161197 rank 84 upper 1448.4293333878165 variance 14.555985765828282 votes 7335 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/5191/row` | | | | | | | | [Arena vision / ocr (config: vision)](https://benchize.com/benchmarks/benchmark%3Avision%3Aocr--config-vision.md) | 1,270.5 | — | 41 / 74 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1270.5023178691142 \| rating \| reported \| Higher is better \| ### Configuration category ocr config vision ### Reported statistics lower 1265.325341336047 rank 51 upper 1275.6792944021815 variance 6.976798990933019 votes 22696 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/1069/row` | | | | | | | | [Arena vision style control / captioning](https://benchize.com/benchmarks/lmarena%3Avision_style_control%3Acaptioning.md) | 1,174.48 | — | 15 / 22 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1174.4848521263846 \| rating \| reported \| Higher is better \| ### Configuration category captioning config vision_style_control ### Reported statistics lower 1117.2431604366516 rank 23 upper 1231.7265438161176 variance 852.9601436441734 votes 78 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `38568936995f36625aae49e9ea05557d55c1b1df9b2954f5c50cee523f26fe92` Source locator `/rows/189/row` | | | | | | | | [Arena text / industry mathematical](https://benchize.com/benchmarks/lmarena%3Atext%3Aindustry_mathematical.md) | 1,453.77 | — | 52 / 148 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1453.769439982529 \| rating \| reported \| Higher is better \| ### Configuration category industry_mathematical config text ### Reported statistics lower 1445.21030417417 rank 74 upper 1462.328575790888 variance 19.07056907424953 votes 5556 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/5986/row` | | | | | | | | [Arena text style control / industry writing and literature and language](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aindustry_writing_and_literature_and_language.md) | 1,420.81 | — | 58 / 151 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1420.8094352038297 \| rating \| reported \| Higher is better \| ### Configuration category industry_writing_and_literature_and_language config text_style_control ### Reported statistics lower 1415.9148408369044 rank 94 upper 1425.7040295707548 variance 6.236446916384466 votes 23546 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/7211/row` | | | | | | | | [Arena text / multi turn](https://benchize.com/benchmarks/lmarena%3Atext%3Amulti_turn.md) | 1,446.38 | — | 49 / 151 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1446.3777737132611 \| rating \| reported \| Higher is better \| ### Configuration category multi_turn config text ### Reported statistics lower 1440.7267114837775 rank 71 upper 1452.028835942745 variance 8.313119002985253 votes 15321 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/9386/row` | | | | | | | | [Arena text / non english](https://benchize.com/benchmarks/lmarena%3Atext%3Anon_english.md) | 1,429.71 | — | 48 / 151 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1429.7065553636405 \| rating \| reported \| Higher is better \| ### Configuration category non_english config text ### Reported statistics lower 1426.015927339561 rank 73 upper 1433.3971833877201 variance 3.545719438340915 votes 53245 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/9803/row` | | | | | | | | [Arena text style control / polish](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Apolish.md) | 1,445.41 | — | 50 / 117 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1445.4098953952202 \| rating \| reported \| Higher is better \| ### Configuration category polish config text_style_control ### Reported statistics lower 1430.7690833281663 rank 81 upper 1460.050707462274 variance 55.79999369720044 votes 1687 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/10228/row` | | | | | | | | [Arena text style control / expert](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aexpert.md) | 1,477.17 | — | 53 / 148 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1477.1700732853142 \| rating \| reported \| Higher is better \| ### Configuration category expert config text_style_control ### Reported statistics lower 1470.5172458539341 rank 77 upper 1483.8229007166942 variance 11.521693944313625 votes 10224 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/2547/row` | | | | | | | | [Arena text / spanish](https://benchize.com/benchmarks/lmarena%3Atext%3Aspanish.md) | 1,440.78 | — | 46 / 134 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1440.7848889406705 \| rating \| reported \| Higher is better \| ### Configuration category spanish config text ### Reported statistics lower 1428.9772454111699 rank 80 upper 1452.5925324701707 variance 36.293619749008975 votes 2989 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/10844/row` | | | | | | | | [Arena text style control / english](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aenglish.md) | 1,448.87 | — | 58 / 151 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1448.867921255657 \| rating \| reported \| Higher is better \| ### Configuration category english config text_style_control ### Reported statistics lower 1444.8172525542145 rank 98 upper 1452.9185899570991 variance 4.271272371957603 votes 41872 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/1734/row` | | | | | | | | [Judgemark v2.1](https://benchize.com/benchmarks/eq-bench%3Ajudgemark-v2.md) | 85.45% | — | 4 / 39 | — | [eq bench · judgemark-v2](https://eqbench.com/judgemark-v2.js) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `judgemark_score` \| 85.45 \| percent \| overall \| Higher is better \| \| `stability` \| 0.707 \| score_fraction \| overall \| Higher is better \| \| `separability` \| 0.902 \| score_fraction \| overall \| Higher is better \| \| `human_corr` \| 0.814 \| correlation \| overall \| Higher is better \| ### Configuration interactiveAdjustments none protocol judgemark-v2 sourceModelVersion Qwen/Qwen3.5-397B-A17B ### Source [Original source](https://eqbench.com/judgemark-v2.js) Source eq bench Original model label Qwen/Qwen3.5-397B-A17B Source version judgemark-v2 Observed 2026-10-21T16:35:03.564Z Evidence SHA-256 `070cc3fbd6f0333dde2b52bec4329ea3fba7eccbf016bbbbef95e0f8b2197781` Source locator `/leaderboardDataV2/35` | | | | | | | | [Arena text style control / industry life and physical and social science](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aindustry_life_and_physical_and_social_science.md) | 1,464.96 | — | 55 / 151 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1464.962632254644 \| rating \| reported \| Higher is better \| ### Configuration category industry_life_and_physical_and_social_science config text_style_control ### Reported statistics lower 1459.4115166991337 rank 87 upper 1470.513747810154 variance 8.021661912559253 votes 15562 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/5584/row` | | | | | | | | [USAMO 2026](https://benchize.com/benchmarks/matharena%3Ausamo--usamo_2026.md) | 36.31% | 95% CI 17.07–55.55% | 7 / 8 | 0.12usd per problem | [matharena · usamo--usamo_2026](https://matharena.ai/competition_tables/usamo--usamo_2026) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 36.31 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.12 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition usamo--usamo_2026 predicted false sourceModelName Qwen3.5-397b-a17b sourceModelVersion qwen/qwen3.5_397b ### Reported statistics Uncertainty 95% confidence interval: 17.07–55.55% confidenceInterval95 19.24 problems 6 ### Source [Original source](https://matharena.ai/competition_tables/usamo--usamo_2026) Source matharena Original model label Qwen3.5-397b-a17b Source version usamo--usamo_2026 Observed 2026-10-21T16:52:41.374Z Evidence SHA-256 `2c6f85fa189ac482d54d597e1cbbe64803cda65cd85e78add44087d94799756b` Source locator `/table/rows/7` | | | | | | | | [Arena vision / diagram (config: vision)](https://benchize.com/benchmarks/benchmark%3Avision%3Adiagram--config-vision.md) | 1,276.84 | — | 41 / 74 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1276.8390543564187 \| rating \| reported \| Higher is better \| ### Configuration category diagram config vision ### Reported statistics lower 1269.4922409178753 rank 52 upper 1284.1858677949622 variance 14.050825537941813 votes 8623 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/518/row` | | | | | | | | [Arena text style control / instruction following](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Ainstruction_following.md) | 1,433.79 | — | 60 / 151 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1433.788664215889 \| rating \| reported \| Higher is better \| ### Configuration category instruction_following config text_style_control ### Reported statistics lower 1429.3850053427577 rank 92 upper 1438.1923230890204 variance 5.0481372770266 votes 32566 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/7625/row` | | | | | | | | [Arena text style control / industry entertainment and sports and media](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aindustry_entertainment_and_sports_and_media.md) | 1,403.09 | — | 63 / 151 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1403.090195136719 \| rating \| reported \| Higher is better \| ### Configuration category industry_entertainment_and_sports_and_media config text_style_control ### Reported statistics lower 1397.9418840085602 rank 104 upper 1408.2385062648782 variance 6.899750513930076 votes 21623 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/4796/row` | | | | | | | | [Arena text / japanese](https://benchize.com/benchmarks/lmarena%3Atext%3Ajapanese.md) | 1,429.3 | — | 33 / 120 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1429.2974401070505 \| rating \| reported \| Higher is better \| ### Configuration category japanese config text ### Reported statistics lower 1410.2979817006328 rank 43 upper 1448.296898513468 variance 93.96935814919496 votes 1182 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/7993/row` | | | | | | | | [AIME 2026](https://benchize.com/benchmarks/aime-2026.md) | 94.17% | 95% CI 89.98–98.36% | 17 / 21 | 0.08usd per problem | [matharena · aime--aime_2026](https://matharena.ai/competition_tables/aime--aime_2026) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 94.17 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.075 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition aime--aime_2026 predicted false sourceModelName Qwen3.5-397b-a17b sourceModelVersion qwen/qwen3.5_397b ### Reported statistics Uncertainty 95% confidence interval: 89.98–98.36% confidenceInterval95 4.19 problems 30 ### Source [Original source](https://matharena.ai/competition_tables/aime--aime_2026) Source matharena Original model label Qwen3.5-397b-a17b Source version aime--aime_2026 Observed 2026-10-21T16:52:37.816Z Evidence SHA-256 `58b3ac1e0805975eba566c493b8e0165d41eb7ca517218106e112529fb6342de` Source locator `/table/rows/21` | | | | | | | | [Arena text style control / japanese](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Ajapanese.md) | 1,430.92 | — | 42 / 120 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1430.9196174501667 \| rating \| reported \| Higher is better \| ### Configuration category japanese config text_style_control ### Reported statistics lower 1411.8322450096014 rank 58 upper 1450.006989890732 variance 94.8409975715997 votes 1182 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/8008/row` | | | | | | | | [Arena vision style control / entity recognition](https://benchize.com/benchmarks/lmarena%3Avision_style_control%3Aentity_recognition.md) | 1,211.34 | — | 16 / 34 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1211.3362879420488 \| rating \| reported \| Higher is better \| ### Configuration category entity_recognition config vision_style_control ### Reported statistics lower 1174.2252263290811 rank 25 upper 1248.4473495550164 variance 358.51767735274655 votes 222 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `38568936995f36625aae49e9ea05557d55c1b1df9b2954f5c50cee523f26fe92` Source locator `/rows/781/row` | | | | | | | | [Arena vision style control / overall](https://benchize.com/benchmarks/lmarena%3Avision_style_control%3Aoverall.md) | 1,245.81 | — | 45 / 82 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1245.8143294781817 \| rating \| reported \| Higher is better \| ### Configuration category overall config vision_style_control ### Reported statistics lower 1240.5101866579396 rank 59 upper 1251.1184722984235 variance 7.323762240002493 votes 32657 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `38568936995f36625aae49e9ea05557d55c1b1df9b2954f5c50cee523f26fe92` Source locator `/rows/58/row` | | | | | | | | [Arena text / instruction following](https://benchize.com/benchmarks/lmarena%3Atext%3Ainstruction_following.md) | 1,423.53 | — | 56 / 151 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1423.534952830042 \| rating \| reported \| Higher is better \| ### Configuration category instruction_following config text ### Reported statistics lower 1419.1485575583642 rank 82 upper 1427.9213481017193 variance 5.008634578027084 votes 32566 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/7615/row` | | | | | | | | [Arena text style control / chinese](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Achinese.md) | 1,496.65 | — | 43 / 146 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1496.6450841828996 \| rating \| reported \| Higher is better \| ### Configuration category chinese config text_style_control ### Reported statistics lower 1488.7243872928796 rank 64 upper 1504.5657810729197 variance 16.331670376265585 votes 6635 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/480/row` | | | | | | | | [Arena text style control / spanish](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aspanish.md) | 1,439.24 | — | 51 / 134 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1439.235583569915 \| rating \| reported \| Higher is better \| ### Configuration category spanish config text_style_control ### Reported statistics lower 1427.4028770470404 rank 88 upper 1451.068290092789 variance 36.447857491590476 votes 2989 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/10852/row` | | | | | | | | [Arena text style control / exclude ties](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aexclude_ties.md) | 1,440.16 | — | 57 / 151 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1440.1588093023972 \| rating \| reported \| Higher is better \| ### Configuration category exclude_ties config text_style_control ### Reported statistics lower 1435.991951769918 rank 95 upper 1444.3256668348765 variance 4.519819814921715 votes 69593 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/2148/row` | | | | | | | | [Arena text / industry life and physical and social science](https://benchize.com/benchmarks/lmarena%3Atext%3Aindustry_life_and_physical_and_social_science.md) | 1,456.61 | — | 45 / 151 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1456.6089605770126 \| rating \| reported \| Higher is better \| ### Configuration category industry_life_and_physical_and_social_science config text ### Reported statistics lower 1451.110945669169 rank 65 upper 1462.1069754848563 variance 7.868929315090042 votes 15562 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/5562/row` | | | | | | | | [Arena vision / entity recognition (config: vision)](https://benchize.com/benchmarks/benchmark%3Avision%3Aentity_recognition--config-vision.md) | 1,264.78 | — | 10 / 34 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1264.7777075197748 \| rating \| reported \| Higher is better \| ### Configuration category entity_recognition config vision ### Reported statistics lower 1228.0925247692526 rank 14 upper 1301.4628902702968 variance 350.3363425866521 votes 222 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/770/row` | | | | | | | | [Arena text style control / creative writing](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Acreative_writing.md) | 1,405.99 | — | 59 / 151 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1405.9905151757494 \| rating \| reported \| Higher is better \| ### Configuration category creative_writing config text_style_control ### Reported statistics lower 1400.3917845566507 rank 101 upper 1411.5892457948476 variance 8.159864782714523 votes 16934 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/1322/row` | | | | | | | | [DesignArena SVG generation](https://benchize.com/benchmarks/designarena%3Asvgs.md) | 1,140elo | — | 40 / 77 | — | [designarena · public](https://www.designarena.ai/api/leaderboard#board=svgs) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 1140 \| elo \| svgs \| Higher is better \| ### Configuration arenaType models category svg inputModality Not reported sourceModelVersion qwen3.5-397b-a17b variationName public ### Reported statistics averageGenerationTimeMs 73358 battles 969 losses 425 standardError Not reported winRate 56.1 wins 544 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=svgs) Source designarena Original model label Qwen3.5 397B A17B Source version public Observed 2026-10-21T16:38:03.249Z Evidence SHA-256 `8cbc34a474a66ef5c64f3ffe557df9b55bf7e13368c07c0214223e3ed8f3f21e` Source locator `/data/71` | | | | | | | | [Kangaroo 2025 1-2](https://benchize.com/benchmarks/matharena%3Akangaroo--kangaroo_2025_1-2.md) | 81.25% | 95% CI 73.44–89.06% | 7 / 16 | 0.04usd per problem | [matharena · kangaroo--kangaroo_2025_1-2](https://matharena.ai/competition_tables/kangaroo--kangaroo_2025_1-2) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 81.25 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.038 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition kangaroo--kangaroo_2025_1-2 predicted false sourceModelName Qwen3.5-397b-a17b sourceModelVersion qwen/qwen3.5_397b ### Reported statistics Uncertainty 95% confidence interval: 73.44–89.06% confidenceInterval95 7.81 problems 24 ### Source [Original source](https://matharena.ai/competition_tables/kangaroo--kangaroo_2025_1-2) Source matharena Original model label Qwen3.5-397b-a17b Source version kangaroo--kangaroo_2025_1-2 Observed 2026-10-21T16:52:31.513Z Evidence SHA-256 `a59a4c362e2d87350330706a01dd330e9a1ac7cc64a4de0bacbf1a439d8fcf90` Source locator `/table/rows/7` | | | | | | | | [Arena text style control / math](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Amath.md) | 1,450.53 | — | 53 / 149 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1450.5250740352922 \| rating \| reported \| Higher is better \| ### Configuration category math config text_style_control ### Reported statistics lower 1441.9566584086715 rank 78 upper 1459.0934896619128 variance 19.11194412784334 votes 5233 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/8990/row` | | | | | | | | [Arena text style control / industry medicine and healthcare](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aindustry_medicine_and_healthcare.md) | 1,466.77 | — | 49 / 151 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1466.766838058293 \| rating \| reported \| Higher is better \| ### Configuration category industry_medicine_and_healthcare config text_style_control ### Reported statistics lower 1458.9715921923957 rank 82 upper 1474.5620839241903 variance 15.81843277414347 votes 7090 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/6394/row` | | | | | | | | [HMMT Feb 2026](https://benchize.com/benchmarks/matharena%3Ahmmt--hmmt_feb_2026.md) | 87.88% | 95% CI 82.31–93.45% | 15 / 21 | 0.09usd per problem | [matharena · hmmt--hmmt_feb_2026](https://matharena.ai/competition_tables/hmmt--hmmt_feb_2026) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 87.88 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.087 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition hmmt--hmmt_feb_2026 predicted false sourceModelName Qwen3.5-397b-a17b sourceModelVersion qwen/qwen3.5_397b ### Reported statistics Uncertainty 95% confidence interval: 82.31–93.45% confidenceInterval95 5.57 problems 33 ### Source [Original source](https://matharena.ai/competition_tables/hmmt--hmmt_feb_2026) Source matharena Original model label Qwen3.5-397b-a17b Source version hmmt--hmmt_feb_2026 Observed 2026-10-21T16:52:38.351Z Evidence SHA-256 `0dce922c33a54d29d4a1872a42d74077b491915c80d8433f4b379ea0b78bb979` Source locator `/table/rows/17` | | | | | | | | [Arena text / industry writing and literature and language](https://benchize.com/benchmarks/lmarena%3Atext%3Aindustry_writing_and_literature_and_language.md) | 1,415.44 | — | 53 / 151 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1415.4372596942235 \| rating \| reported \| Higher is better \| ### Configuration category industry_writing_and_literature_and_language config text ### Reported statistics lower 1410.57828358967 rank 83 upper 1420.296235798777 variance 6.146011160508731 votes 23546 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/7200/row` | | | | | | | | [Arena text style control / hard prompts english](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Ahard_prompts_english.md) | 1,467.02 | — | 59 / 151 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1467.021737680669 \| rating \| reported \| Higher is better \| ### Configuration category hard_prompts_english config text_style_control ### Reported statistics lower 1462.3284471744014 rank 94 upper 1471.7150281869363 variance 5.734013249747989 votes 28085 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/3961/row` | | | | | | | | [DesignArena Website generation](https://benchize.com/benchmarks/designarena%3Awebsite.md) | 1,191elo | — | 57 / 123 | — | [designarena · public](https://www.designarena.ai/api/leaderboard#board=website) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 1191 \| elo \| website \| Higher is better \| ### Configuration arenaType models category website inputModality text sourceModelVersion qwen3.5-397b-a17b variationName public ### Reported statistics averageGenerationTimeMs 140653 battles 5253 losses 2493 standardError Not reported winRate 52.5 wins 2760 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=website) Source designarena Original model label Qwen3.5 397B A17B Source version public Observed 2026-10-21T16:37:57.757Z Evidence SHA-256 `51873e97776a3c5ae706b24cc2c60384793dd18398df970e213a8e7c276d8ac0` Source locator `/data/90` | | | | | | | | [Arena text style control / german](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Agerman.md) | 1,443.32 | — | 48 / 129 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1443.3184946278943 \| rating \| reported \| Higher is better \| ### Configuration category german config text_style_control ### Reported statistics lower 1426.8260500375854 rank 82 upper 1459.8109392182034 variance 70.80662354081008 votes 1474 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/3218/row` | | | | | | | | [Arena text style control / hard prompts](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Ahard_prompts.md) | 1,463.39 | — | 56 / 151 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1463.3907002875771 \| rating \| reported \| Higher is better \| ### Configuration category hard_prompts config text_style_control ### Reported statistics lower 1459.7216892501199 rank 90 upper 1467.0597113250346 variance 3.504304646054082 votes 62653 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/3540/row` | | | | | | | | [Apex Shortlist](https://benchize.com/benchmarks/matharena%3Aapex--shortlist_2025.md) | 60.11% | 95% CI 53.11–67.11% | 18 / 24 | 0.14usd per problem | [matharena · apex--shortlist_2025](https://matharena.ai/competition_tables/apex--shortlist_2025) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 60.11 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.14 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition apex--shortlist_2025 predicted false sourceModelName Qwen3.5-397b-a17b sourceModelVersion qwen/qwen3.5_397b ### Reported statistics Uncertainty 95% confidence interval: 53.11–67.11% confidenceInterval95 7.00 problems 47 ### Source [Original source](https://matharena.ai/competition_tables/apex--shortlist_2025) Source matharena Original model label Qwen3.5-397b-a17b Source version apex--shortlist_2025 Observed 2026-10-21T16:52:39.300Z Evidence SHA-256 `74513abecacb4d230d741f4d6df425ce878fb450220e88a1a6823524476c2989` Source locator `/table/rows/21` | | | | | | | | [Arena text / polish](https://benchize.com/benchmarks/lmarena%3Atext%3Apolish.md) | 1,447.36 | — | 33 / 117 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1447.363876435893 \| rating \| reported \| Higher is better \| ### Configuration category polish config text ### Reported statistics lower 1432.921476561449 rank 53 upper 1461.806276310337 variance 54.29783940665793 votes 1687 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/10200/row` | | | | | | | | [Arena vision / creative writing vision (config: vision)](https://benchize.com/benchmarks/benchmark%3Avision%3Acreative_writing_vision--config-vision.md) | 1,260.3 | — | 35 / 70 | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1260.303354012809 \| rating \| reported \| Higher is better \| ### Configuration category creative_writing_vision config vision ### Reported statistics lower 1247.35155255141 rank 44 upper 1273.255155474208 variance 43.66808780868044 votes 2304 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label Qwen3.5-397B-A17B Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/406/row` | | | | | | | [Next page](https://benchize.com/models/qwen3-5-397b-a17b.md?cursor=ea46f1b7aeb323e54cddd7c3a806cd5e0f889907d16a5111559da8a972220384) --- Cite as: Qwen3.5 397B A17B — Benchize, https://benchize.com/models/qwen3-5-397b-a17b (retrieved 2026-10-22)