# Llama 4 Scout > Source: Benchize (https://benchize.com) — https://benchize.com/models/llama-4-scout. When citing or reusing this content, credit "Benchize" and link to https://benchize.com/models/llama-4-scout. Meta Canonical URL: https://benchize.com/models/llama-4-scout Last updated: Thu, 22 Oct 2026 06:20:09 GMT Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations. Meta ## Benchmarks | Benchmark | Score | ± | Rank | Cost | Latency | Source | | | --- | --- | --- | --- | --- | --- | --- | --- | | [Arena text style control / industry legal and government](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aindustry_legal_and_government.md) | 1,340.86 | — | 125 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1340.8606909081604 \| rating \| reported \| Higher is better \| ### Configuration category industry_legal_and_government config text_style_control ### Reported statistics lower 1327.0259459015142 rank 242 upper 1354.6954359148062 variance 49.824865586957074 votes 1976 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/5349/row` | | | | | | | | | [Arena text style control / coding](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Acoding.md) | 1,362.69 | — | 127 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1362.691438242459 \| rating \| reported \| Higher is better \| ### Configuration category coding config text_style_control ### Reported statistics lower 1354.165244735492 rank 255 upper 1371.2176317494263 variance 18.924054405225405 votes 5228 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/1064/row` | | | | | | | | | [Arena text / non english](https://benchize.com/benchmarks/lmarena%3Atext%3Anon_english.md) | 1,252.35 | — | 139 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1252.3530631457634 \| rating \| reported \| Higher is better \| ### Configuration category non_english config text ### Reported statistics lower 1246.6461702916358 rank 277 upper 1258.0599559998911 variance 8.478192157897215 votes 16774 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/10007/row` | | | | | | | | | [Arena vision / ocr (config: vision)](https://benchize.com/benchmarks/benchmark%3Avision%3Aocr--config-vision.md) | 1,116.71 | — | 74 / 74 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1116.7148618356043 \| rating \| reported \| Higher is better \| ### Configuration category ocr config vision ### Reported statistics lower 1104.282501099349 rank 121 upper 1129.1472225718596 variance 40.23565022843385 votes 2788 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/1139/row` | | | | | | | | | [Arena text style control / exclude ties](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aexclude_ties.md) | 1,267.91 | — | 128 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1267.9113675832518 \| rating \| reported \| Higher is better \| ### Configuration category exclude_ties config text_style_control ### Reported statistics lower 1261.209792290276 rank 256 upper 1274.6129428762276 variance 11.691160442872903 votes 21401 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/2309/row` | | | | | | | | | [Arena text style control / creative writing](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Acreative_writing.md) | 1,288.81 | — | 127 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1288.8073607406354 \| rating \| reported \| Higher is better \| ### Configuration category creative_writing config text_style_control ### Reported statistics lower 1278.7048067324486 rank 253 upper 1298.9099147488225 variance 26.56844762685619 votes 3761 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/1474/row` | | | | | | | | | [Arena vision / overall (config: vision)](https://benchize.com/benchmarks/benchmark%3Avision%3Aoverall--config-vision.md) | 1,118.36 | — | 77 / 82 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1118.3570237168362 \| rating \| reported \| Higher is better \| ### Configuration category overall config vision ### Reported statistics lower 1108.9192288772972 rank 129 upper 1127.794818556375 variance 23.18701711792196 votes 6446 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/128/row` | | | | | | | | | [Arena text / german](https://benchize.com/benchmarks/lmarena%3Atext%3Agerman.md) | 1,272.65 | — | 112 / 129 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1272.647669985447 \| rating \| reported \| Higher is better \| ### Configuration category german config text ### Reported statistics lower 1250.9576527181207 rank 214 upper 1294.3376872527735 variance 122.46827859316032 votes 797 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/3350/row` | | | | | | | | | [Longform Creative Writing](https://benchize.com/benchmarks/eq-bench%3Alongform-writing.md) | 31.1% | — | 90 / 93 | — | — | [eq bench · longform-writing](https://eqbench.com/creative_writing_longform.js) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `overall_score_100` \| 31.1 \| percent \| overall \| Higher is better \| \| `chapter1_avg` \| 7.73 \| rubric_score \| overall \| Higher is better \| \| `chapter2_avg` \| 7.05 \| rubric_score \| overall \| Higher is better \| \| `chapter3_avg` \| 6.46 \| rubric_score \| overall \| Higher is better \| \| `chapter4_avg` \| 5.95 \| rubric_score \| overall \| Higher is better \| \| `chapter5_avg` \| 5.42 \| rubric_score \| overall \| Higher is better \| \| `chapter6_avg` \| 4.37 \| rubric_score \| overall \| Higher is better \| \| `chapter7_avg` \| 4.06 \| rubric_score \| overall \| Higher is better \| \| `chapter8_avg` \| 3.60 \| rubric_score \| overall \| Higher is better \| \| `final_judgement_avg` \| 4.17 \| rubric_score \| overall \| Higher is better \| ### Configuration interactiveAdjustments none protocol longform-writing sourceModelVersion meta-llama/Llama-4-Scout-17B-16E-Instruct ### Source [Original source](https://eqbench.com/creative_writing_longform.js) Source eq bench Original model label meta-llama/Llama-4-Scout-17B-16E-Instruct Source version longform-writing Observed 2026-10-22T05:10:05.903Z Evidence SHA-256 `3ba283ce357ac7620e16db640a961879c30fe3ddc50a27de9a8ed4290784825c` Source locator `/leaderboardDataLongformV3/81` | | | | | | | | | [Arena text style control / english](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aenglish.md) | 1,342.51 | — | 129 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1342.5081235345224 \| rating \| reported \| Higher is better \| ### Configuration category english config text_style_control ### Reported statistics lower 1336.4404538346525 rank 257 upper 1348.5757932343924 variance 9.584019328383262 votes 13039 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/1893/row` | | | | | | | | | [Arena text style control / french](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Afrench.md) | 1,325.44 | — | 120 / 132 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1325.4351647971648 \| rating \| reported \| Higher is better \| ### Configuration category french config text_style_control ### Reported statistics lower 1295.9378260013505 rank 231 upper 1354.9325035929796 variance 226.500669836114 votes 427 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/3068/row` | | | | | | | | | [Arena text / overall](https://benchize.com/benchmarks/lmarena%3Atext.md) | 1,279.25 | — | 136 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1279.246829264462 \| rating \| reported \| Higher is better \| ### Configuration category overall config text ### Reported statistics lower 1274.5360766696933 rank 274 upper 1283.9575818592305 variance 5.7767611329250945 votes 29824 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/273/row` | | | | | | | | | [Arena text style control / japanese](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Ajapanese.md) | 1,258.64 | — | 102 / 120 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1258.6425924252285 \| rating \| reported \| Higher is better \| ### Configuration category japanese config text_style_control ### Reported statistics lower 1236.2062497997533 rank 192 upper 1281.0789350507036 variance 131.04122519703506 votes 764 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/8142/row` | | | | | | | | | [Arena text style control / hard prompts english](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Ahard_prompts_english.md) | 1,351.97 | — | 125 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1351.9659496700592 \| rating \| reported \| Higher is better \| ### Configuration category hard_prompts_english config text_style_control ### Reported statistics lower 1343.796564236106 rank 248 upper 1360.135335104013 variance 17.37331089141589 votes 5734 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/4115/row` | | | | | | | | | [Arena vision style control / chinese](https://benchize.com/benchmarks/lmarena%3Avision_style_control%3Achinese.md) | 1,127.49 | — | 69 / 74 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1127.4925011189923 \| rating \| reported \| Higher is better \| ### Configuration category chinese config vision_style_control ### Reported statistics lower 1091.4868536442468 rank 105 upper 1163.498148593738 variance 337.4776902701258 votes 278 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `38568936995f36625aae49e9ea05557d55c1b1df9b2954f5c50cee523f26fe92` Source locator `/rows/305/row` | | | | | | | | | [Arena text style control / industry entertainment and sports and media](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aindustry_entertainment_and_sports_and_media.md) | 1,288.68 | — | 123 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1288.6787080479467 \| rating \| reported \| Higher is better \| ### Configuration category industry_entertainment_and_sports_and_media config text_style_control ### Reported statistics lower 1280.1056153057027 rank 248 upper 1297.2518007901904 variance 19.132814536804666 votes 5279 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/4940/row` | | | | | | | | | [Arena text / hard prompts english](https://benchize.com/benchmarks/lmarena%3Atext%3Ahard_prompts_english.md) | 1,293.09 | — | 129 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1293.0853993961873 \| rating \| reported \| Higher is better \| ### Configuration category hard_prompts_english config text ### Reported statistics lower 1284.913719940445 rank 257 upper 1301.2570788519297 variance 17.38306936096145 votes 5734 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/4124/row` | | | | | | | | | [Arena text style control / industry software and it services](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aindustry_software_and_it_services.md) | 1,349.32 | — | 129 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1349.3161801403426 \| rating \| reported \| Higher is better \| ### Configuration category industry_software_and_it_services config text_style_control ### Reported statistics lower 1342.4949702216359 rank 262 upper 1356.1373900590495 variance 12.112300802083736 votes 9503 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/6962/row` | | | | | | | | | [Arena vision style control / ocr](https://benchize.com/benchmarks/lmarena%3Avision_style_control%3Aocr.md) | 1,131.09 | — | 74 / 74 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1131.089545879527 \| rating \| reported \| Higher is better \| ### Configuration category ocr config vision_style_control ### Reported statistics lower 1118.600877205361 rank 122 upper 1143.5782145536925 variance 40.600941603978384 votes 2788 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `38568936995f36625aae49e9ea05557d55c1b1df9b2954f5c50cee523f26fe92` Source locator `/rows/1140/row` | | | | | | | | | [DesignArena Website generation](https://benchize.com/benchmarks/designarena%3Awebsite.md) | 750elo | — | 123 / 123 | — | — | [designarena · public](https://www.designarena.ai/api/leaderboard#board=website) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 750 \| elo \| website \| Higher is better \| ### Configuration arenaType models category website inputModality text sourceModelVersion llama-4-scout variationName public ### Reported statistics averageGenerationTimeMs 11855 battles 752 losses 581 standardError Not reported winRate 22.7 wins 171 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=website) Source designarena Original model label Llama 4 Scout Source version public Observed 2026-10-21T16:37:57.757Z Evidence SHA-256 `51873e97776a3c5ae706b24cc2c60384793dd18398df970e213a8e7c276d8ac0` Source locator `/data/195` | | | | | | | | | [Arena text style control / german](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Agerman.md) | 1,311.83 | — | 109 / 129 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1311.8332696297798 \| rating \| reported \| Higher is better \| ### Configuration category german config text_style_control ### Reported statistics lower 1290.2298565986787 rank 206 upper 1333.4366826608807 variance 121.4922445811919 votes 797 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/3342/row` | | | | | | | | | [Arena text / industry entertainment and sports and media](https://benchize.com/benchmarks/lmarena%3Atext%3Aindustry_entertainment_and_sports_and_media.md) | 1,242.08 | — | 136 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1242.083323422029 \| rating \| reported \| Higher is better \| ### Configuration category industry_entertainment_and_sports_and_media config text ### Reported statistics lower 1233.5903352419643 rank 269 upper 1250.5763116020937 variance 18.776941675945196 votes 5279 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/4961/row` | | | | | | | | | [Arena vision / creative writing (config: vision)](https://benchize.com/benchmarks/benchmark%3Avision%3Acreative_writing--config-vision.md) | 1,126.76 | — | 12 / 13 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1126.759681598881 \| rating \| reported \| Higher is better \| ### Configuration category creative_writing config vision ### Reported statistics lower 1090.1427705507765 rank 32 upper 1163.3765926469855 variance 349.0335930407099 votes 265 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label llama-4-scout-17b-16e-instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/360/row` | | | | | | | | | [Arena text style control / instruction following](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Ainstruction_following.md) | 1,299.31 | — | 129 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1299.3058182124325 \| rating \| reported \| Higher is better \| ### Configuration category instruction_following config text_style_control ### Reported statistics lower 1291.9858031225492 rank 267 upper 1306.625833302316 variance 13.94850847481915 votes 7475 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/7800/row` | | | | | | | | | [Arena vision style control / humor](https://benchize.com/benchmarks/lmarena%3Avision_style_control%3Ahumor.md) | 1,101.3 | — | 61 / 63 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1101.2972246644351 \| rating \| reported \| Higher is better \| ### Configuration category humor config vision_style_control ### Reported statistics lower 1056.5599508328507 rank 91 upper 1146.0344984960193 variance 521.0061498252646 votes 191 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `38568936995f36625aae49e9ea05557d55c1b1df9b2954f5c50cee523f26fe92` Source locator `/rows/1016/row` | | | | | | | | | [Arena text style control / chinese](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Achinese.md) | 1,314.81 | — | 133 / 146 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1314.8108789240648 \| rating \| reported \| Higher is better \| ### Configuration category chinese config text_style_control ### Reported statistics lower 1300.8816789913628 rank 268 upper 1328.7400788567668 variance 50.507533679647274 votes 2081 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/684/row` | | | | | | | | | [Arena text style control / russian](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Arussian.md) | 1,308.36 | — | 131 / 150 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1308.3606783117375 \| rating \| reported \| Higher is better \| ### Configuration category russian config text_style_control ### Reported statistics lower 1296.0646560822029 rank 253 upper 1320.6567005412726 variance 39.358006873517965 votes 2274 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/10636/row` | | | | | | | | | [Arena text / multi turn](https://benchize.com/benchmarks/lmarena%3Atext%3Amulti_turn.md) | 1,280.34 | — | 130 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1280.339606750501 \| rating \| reported \| Higher is better \| ### Configuration category multi_turn config text ### Reported statistics lower 1271.625021387592 rank 263 upper 1289.05419211341 variance 19.769572340152255 votes 5226 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/9578/row` | | | | | | | | | [Arena text / industry software and it services](https://benchize.com/benchmarks/lmarena%3Atext%3Aindustry_software_and_it_services.md) | 1,285.76 | — | 136 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1285.7593529815285 \| rating \| reported \| Higher is better \| ### Configuration category industry_software_and_it_services config text ### Reported statistics lower 1278.9473532893485 rank 272 upper 1292.5713526737086 variance 12.079614014416915 votes 9503 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/6972/row` | | | | | | | | | [Arena vision style control / overall](https://benchize.com/benchmarks/lmarena%3Avision_style_control%3Aoverall.md) | 1,127.52 | — | 76 / 82 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1127.5180267602816 \| rating \| reported \| Higher is better \| ### Configuration category overall config vision_style_control ### Reported statistics lower 1118.0150335850715 rank 127 upper 1137.0210199354917 variance 23.508485578864377 votes 6446 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `38568936995f36625aae49e9ea05557d55c1b1df9b2954f5c50cee523f26fe92` Source locator `/rows/126/row` | | | | | | | | | [Arena text style control / polish](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Apolish.md) | 1,322.43 | — | 104 / 117 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1322.43186313902 \| rating \| reported \| Higher is better \| ### Configuration category polish config text_style_control ### Reported statistics lower 1309.2726054076911 rank 197 upper 1335.5911208703487 variance 45.0782039121913 votes 2469 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/10344/row` | | | | | | | | | [Arena text style control / spanish](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aspanish.md) | 1,316.03 | — | 120 / 134 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1316.0304490267301 \| rating \| reported \| Higher is better \| ### Configuration category spanish config text_style_control ### Reported statistics lower 1292.052186524846 rank 225 upper 1340.0087115286142 variance 149.67154392282774 votes 711 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/10989/row` | | | | | | | | | [Arena vision / creative writing vision (config: vision)](https://benchize.com/benchmarks/benchmark%3Avision%3Acreative_writing_vision--config-vision.md) | 1,126.32 | — | 68 / 70 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1126.3210298263893 \| rating \| reported \| Higher is better \| ### Configuration category creative_writing_vision config vision ### Reported statistics lower 1085.315829634756 rank 101 upper 1167.3262300180227 variance 437.7051847329457 votes 238 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/463/row` | | | | | | | | | [Arena text / industry writing and literature and language](https://benchize.com/benchmarks/lmarena%3Atext%3Aindustry_writing_and_literature_and_language.md) | 1,268.53 | — | 134 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1268.526851035029 \| rating \| reported \| Higher is better \| ### Configuration category industry_writing_and_literature_and_language config text ### Reported statistics lower 1260.8284459765916 rank 268 upper 1276.2252560934662 variance 15.42784739081598 votes 6706 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/7385/row` | | | | | | | | | [Arena vision / english (config: vision)](https://benchize.com/benchmarks/benchmark%3Avision%3Aenglish--config-vision.md) | 1,143.29 | — | 77 / 82 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1143.2853213617263 \| rating \| reported \| Higher is better \| ### Configuration category english config vision ### Reported statistics lower 1130.8577799378832 rank 126 upper 1155.7128627855695 variance 40.20446217185477 votes 3098 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/715/row` | | | | | | | | | [Arena text / industry medicine and healthcare](https://benchize.com/benchmarks/lmarena%3Atext%3Aindustry_medicine_and_healthcare.md) | 1,275.2 | — | 136 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1275.2026171641407 \| rating \| reported \| Higher is better \| ### Configuration category industry_medicine_and_healthcare config text ### Reported statistics lower 1260.4677724831035 rank 262 upper 1289.937461845178 variance 56.51906161395765 votes 1814 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/6574/row` | | | | | | | | | [ARC-AGI-2](https://benchize.com/benchmarks/arc-prize%3Av2_Semi_Private.md) | 0% | — | 231 / 243 | 0.0062usd per task | — | [arc prize · v2](https://arcprize.org/media/data/leaderboard/v2.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0 \| score_fraction \| v2_Semi_Private \| Higher is better \| \| `cost_per_task` \| 0.0062 \| usd_per_task \| v2_Semi_Private \| Lower is better \| ### Configuration evaluationSplit v2_Semi_Private harness Not reported modelGroup Llama 4 modelType Base LLM sourceModelVersion Llama-4-Scout-17B-16E-Instruct-together ### Source [Original source](https://arcprize.org/media/data/leaderboard/v2.json) Source arc prize Original model label Llama 4 Scout Source version v2 Observed 2026-10-22T05:20:04.306Z Evidence SHA-256 `4351eb696e78113b0459e9bb5f0258318b905efef34f473dcea51ce641b0d94d` Source locator `/evaluations/16` | | | | | | | | | [Arena text / english](https://benchize.com/benchmarks/lmarena%3Atext%3Aenglish.md) | 1,304.26 | — | 130 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1304.2623680717768 \| rating \| reported \| Higher is better \| ### Configuration category english config text ### Reported statistics lower 1298.2215446039081 rank 262 upper 1310.3031915396457 variance 9.499398502822137 votes 13039 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/1898/row` | | | | | | | | | [Arena text style control / industry business and management and financial operations](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aindustry_business_and_management_and_financial_operations.md) | 1,316 | — | 130 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1316.0042495087835 \| rating \| reported \| Higher is better \| ### Configuration category industry_business_and_management_and_financial_operations config text_style_control ### Reported statistics lower 1307.0279886327116 rank 255 upper 1324.9805103848553 variance 20.974651317682813 votes 4920 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/4537/row` | | | | | | | | | [Arena text style control / industry writing and literature and language](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aindustry_writing_and_literature_and_language.md) | 1,304.64 | — | 126 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1304.642907882901 \| rating \| reported \| Higher is better \| ### Configuration category industry_writing_and_literature_and_language config text_style_control ### Reported statistics lower 1296.9060946499544 rank 254 upper 1312.3797211158474 variance 15.582173803097081 votes 6706 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/7371/row` | | | | | | | | | [Arena text style control / expert](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aexpert.md) | 1,307.99 | — | 129 / 148 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1307.9894455239307 \| rating \| reported \| Higher is better \| ### Configuration category expert config text_style_control ### Reported statistics lower 1292.382231678489 rank 257 upper 1323.5966593693724 variance 63.40953668568358 votes 1534 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/2727/row` | | | | | | | | | [Arena vision / diagram (config: vision)](https://benchize.com/benchmarks/benchmark%3Avision%3Adiagram--config-vision.md) | 1,125.31 | — | 73 / 74 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1125.3066435395635 \| rating \| reported \| Higher is better \| ### Configuration category diagram config vision ### Reported statistics lower 1105.1717995772856 rank 120 upper 1145.4414875018413 variance 105.5359331723939 votes 845 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/586/row` | | | | | | | | | [Arena text / exclude ties](https://benchize.com/benchmarks/lmarena%3Atext%3Aexclude_ties.md) | 1,207.99 | — | 136 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1207.9888375427322 \| rating \| reported \| Higher is better \| ### Configuration category exclude_ties config text ### Reported statistics lower 1201.3873432645041 rank 272 upper 1214.5903318209603 variance 11.344577344083966 votes 21401 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/2325/row` | | | | | | | | | [Arena text / instruction following](https://benchize.com/benchmarks/lmarena%3Atext%3Ainstruction_following.md) | 1,247.81 | — | 138 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1247.8144996073336 \| rating \| reported \| Higher is better \| ### Configuration category instruction_following config text ### Reported statistics lower 1240.5036793927388 rank 280 upper 1255.125319821928 variance 13.91348826185478 votes 7475 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/7813/row` | | | | | | | | | [Arena vision style control / english](https://benchize.com/benchmarks/lmarena%3Avision_style_control%3Aenglish.md) | 1,145.23 | — | 76 / 82 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1145.2329391542366 \| rating \| reported \| Higher is better \| ### Configuration category english config vision_style_control ### Reported statistics lower 1132.6877609386172 rank 126 upper 1157.7781173698559 variance 40.969200454220626 votes 3098 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `38568936995f36625aae49e9ea05557d55c1b1df9b2954f5c50cee523f26fe92` Source locator `/rows/715/row` | | | | | | | | | [Arena text / chinese](https://benchize.com/benchmarks/lmarena%3Atext%3Achinese.md) | 1,254.59 | — | 133 / 146 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1254.5898572600172 \| rating \| reported \| Higher is better \| ### Configuration category chinese config text ### Reported statistics lower 1240.6390926229308 rank 267 upper 1268.5406218971034 variance 50.6640427618094 votes 2081 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/683/row` | | | | | | | | | [DesignArena Browser game generation](https://benchize.com/benchmarks/designarena%3Agame-dev.md) | 773elo | — | 117 / 117 | — | — | [designarena · public](https://www.designarena.ai/api/leaderboard#board=game-dev) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 773 \| elo \| game-dev \| Higher is better \| ### Configuration arenaType models category gamedev inputModality Not reported sourceModelVersion llama-4-scout variationName public ### Reported statistics averageGenerationTimeMs 14894 battles 175 losses 127 standardError Not reported winRate 27.4 wins 48 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=game-dev) Source designarena Original model label Llama 4 Scout Source version public Observed 2026-10-21T16:38:01.100Z Evidence SHA-256 `53db6a89112ce8cdf644568c666d4b8309aece764cfcedb291ffd52ae3934e30` Source locator `/data/182` | | | | | | | | | [Arena text style control / math](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Amath.md) | 1,309.42 | — | 128 / 149 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1309.423183692348 \| rating \| reported \| Higher is better \| ### Configuration category math config text_style_control ### Reported statistics lower 1296.1981973574354 rank 243 upper 1322.6481700272602 variance 45.52964686655536 votes 1942 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/9155/row` | | | | | | | | | [Arena vision style control / creative writing vision](https://benchize.com/benchmarks/lmarena%3Avision_style_control%3Acreative_writing_vision.md) | 1,137.99 | — | 68 / 70 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1137.9867997685321 \| rating \| reported \| Higher is better \| ### Configuration category creative_writing_vision config vision_style_control ### Reported statistics lower 1096.7466224071152 rank 100 upper 1179.2269771299489 variance 442.73603029116975 votes 238 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `38568936995f36625aae49e9ea05557d55c1b1df9b2954f5c50cee523f26fe92` Source locator `/rows/462/row` | | | | | | | | | [Arena text style control / industry mathematical](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aindustry_mathematical.md) | 1,314.16 | — | 127 / 148 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1314.1578131594274 \| rating \| reported \| Higher is better \| ### Configuration category industry_mathematical config text_style_control ### Reported statistics lower 1300.433599555763 rank 249 upper 1327.8820267630913 variance 49.0319037195788 votes 1804 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/6161/row` | | | | | | | | | [Arena text style control / non english](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Anon_english.md) | 1,297.72 | — | 131 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1297.724586383372 \| rating \| reported \| Higher is better \| ### Configuration category non_english config text_style_control ### Reported statistics lower 1291.9966488170703 rank 263 upper 1303.4525239496738 variance 8.540835733212901 votes 16774 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/9993/row` | | | | | | | | | [Berkeley Function Calling Leaderboard](https://benchize.com/benchmarks/bfcl%3Aoverall.md) | 28.13% | — | 21 / 26 | $24.68 | 17.86s | [Berkeley Function Calling Leaderboard](https://api.github.com/repos/HuanzhiMao/BFCL-Result/contents/2025-12-16/score/data_overall.csv?ref=cadd76a8dc62984e7bf15ecaf358f070bae745cc) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 28.13 \| percent \| reported \| Higher is better \| \| `cost_total` \| 24.68 \| USD \| evaluation_total \| Lower is better \| \| `latency_mean` \| 17.86 \| seconds \| per_call_mean \| Lower is better \| \| `latency_sd` \| 50.68 \| seconds \| per_call_sd \| Lower is better \| \| `non_live_ast_acc` \| 89.38 \| percent \| reported_task_score \| Higher is better \| \| `non_live_simple_ast` \| 79 \| percent \| reported_task_score \| Higher is better \| \| `non_live_multiple_ast` \| 94 \| percent \| reported_task_score \| Higher is better \| \| `non_live_parallel_ast` \| 94 \| percent \| reported_task_score \| Higher is better \| \| `non_live_parallel_multiple_ast` \| 90.5 \| percent \| reported_task_score \| Higher is better \| \| `live_acc` \| 74.69 \| percent \| reported_task_score \| Higher is better \| \| `live_simple_ast` \| 81.78 \| percent \| reported_task_score \| Higher is better \| \| `live_multiple_ast` \| 72.74 \| percent \| reported_task_score \| Higher is better \| \| `live_parallel_ast` \| 81.25 \| percent \| reported_task_score \| Higher is better \| \| `live_parallel_multiple_ast` \| 79.17 \| percent \| reported_task_score \| Higher is better \| \| `multi_turn_acc` \| 9 \| percent \| reported_task_score \| Higher is better \| \| `multi_turn_base` \| 12 \| percent \| reported_task_score \| Higher is better \| \| `multi_turn_miss_func` \| 7 \| percent \| reported_task_score \| Higher is better \| \| `multi_turn_miss_param` \| 7.5 \| percent \| reported_task_score \| Higher is better \| \| `multi_turn_long_context` \| 9.5 \| percent \| reported_task_score \| Higher is better \| \| `web_search_acc` \| 14.5 \| percent \| reported_task_score \| Higher is better \| \| `web_search_base` \| 18 \| percent \| reported_task_score \| Higher is better \| \| `web_search_no_snippet` \| 11 \| percent \| reported_task_score \| Higher is better \| \| `memory_acc` \| 8.17 \| percent \| reported_task_score \| Higher is better \| \| `memory_kv` \| 2.58 \| percent \| reported_task_score \| Higher is better \| \| `memory_vector` \| 2.58 \| percent \| reported_task_score \| Higher is better \| \| `memory_recursive_summarization` \| 19.35 \| percent \| reported_task_score \| Higher is better \| \| `relevance_detection` \| 100 \| percent \| reported_task_score \| Higher is better \| \| `irrelevance_detection` \| 44.92 \| percent \| reported_task_score \| Higher is better \| \| `latency_p95` \| 166.2 \| seconds \| per_call_p95 \| Lower is better \| ### Configuration mode FC sourceRelease 2025-12-16 ### Reported statistics rank 72 ### Source [Original source](https://api.github.com/repos/HuanzhiMao/BFCL-Result/contents/2025-12-16/score/data_overall.csv?ref=cadd76a8dc62984e7bf15ecaf358f070bae745cc) Source Berkeley Function Calling Leaderboard Original model label Llama-4-Scout-17B-16E-Instruct Observed 2026-10-22T02:40:09.731Z Evidence SHA-256 `ede5081a24bc5ac7f9b3b09a52af6bcfcd35aa0f1709239fed979db77a8159a6` Source locator `/rows/72` | | | | | | | | | [Arena text / polish](https://benchize.com/benchmarks/lmarena%3Atext%3Apolish.md) | 1,265.05 | — | 111 / 117 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1265.0496108226193 \| rating \| reported \| Higher is better \| ### Configuration category polish config text ### Reported statistics lower 1252.0874770977225 rank 213 upper 1278.0117445475164 variance 43.7377877896267 votes 2469 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/10360/row` | | | | | | | | | [Arena text / longer query](https://benchize.com/benchmarks/lmarena%3Atext%3Alonger_query.md) | 1,264.99 | — | 139 / 150 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1264.9909012634191 \| rating \| reported \| Higher is better \| ### Configuration category longer_query config text ### Reported statistics lower 1256.6877087032317 rank 277 upper 1273.2940938236063 variance 17.94708987121021 votes 5806 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/8794/row` | | | | | | | | | [Arena text style control / industry medicine and healthcare](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aindustry_medicine_and_healthcare.md) | 1,341.08 | — | 127 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1341.082303534955 \| rating \| reported \| Higher is better \| ### Configuration category industry_medicine_and_healthcare config text_style_control ### Reported statistics lower 1326.2850528722083 rank 247 upper 1355.8795541977015 variance 56.998821905004746 votes 1814 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/6559/row` | | | | | | | | | [Arena text / russian](https://benchize.com/benchmarks/lmarena%3Atext%3Arussian.md) | 1,262.82 | — | 136 / 150 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1262.820692095611 \| rating \| reported \| Higher is better \| ### Configuration category russian config text ### Reported statistics lower 1250.5092896246388 rank 265 upper 1275.1320945665834 variance 39.456528854544686 votes 2274 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/10648/row` | | | | | | | | | [Arena text / industry business and management and financial operations](https://benchize.com/benchmarks/lmarena%3Atext%3Aindustry_business_and_management_and_financial_operations.md) | 1,256.9 | — | 136 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1256.896568405506 \| rating \| reported \| Higher is better \| ### Configuration category industry_business_and_management_and_financial_operations config text ### Reported statistics lower 1247.8831570472637 rank 266 upper 1265.9099797637487 variance 21.148628191780375 votes 4920 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/4548/row` | | | | | | | | | [Arena text style control / hard prompts](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Ahard_prompts.md) | 1,329.41 | — | 127 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1329.4117020812469 \| rating \| reported \| Higher is better \| ### Configuration category hard_prompts config text_style_control ### Reported statistics lower 1323.2410198305465 rank 257 upper 1335.5823843319472 variance 9.912202945918215 votes 12899 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/3707/row` | | | | | | | | | [Arena text / math](https://benchize.com/benchmarks/lmarena%3Atext%3Amath.md) | 1,286.83 | — | 128 / 149 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1286.8319726767877 \| rating \| reported \| Higher is better \| ### Configuration category math config text ### Reported statistics lower 1273.6151538047075 rank 248 upper 1300.048791548868 variance 45.47342799988954 votes 1942 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/9160/row` | | | | | | | | | [Arena vision style control / homework](https://benchize.com/benchmarks/lmarena%3Avision_style_control%3Ahomework.md) | 1,147.5 | — | 73 / 73 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1147.500203083837 \| rating \| reported \| Higher is better \| ### Configuration category homework config vision_style_control ### Reported statistics lower 1121.2600833557506 rank 116 upper 1173.7403228119235 variance 179.24020937959727 votes 477 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `38568936995f36625aae49e9ea05557d55c1b1df9b2954f5c50cee523f26fe92` Source locator `/rows/923/row` | | | | | | | | | [Arena text / japanese](https://benchize.com/benchmarks/lmarena%3Atext%3Ajapanese.md) | 1,206.44 | — | 109 / 120 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1206.4354264826256 \| rating \| reported \| Higher is better \| ### Configuration category japanese config text ### Reported statistics lower 1184.1340130555584 rank 209 upper 1228.736839909693 variance 129.46983530467855 votes 764 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/8159/row` | | | | | | | | | [Arena text / industry legal and government](https://benchize.com/benchmarks/lmarena%3Atext%3Aindustry_legal_and_government.md) | 1,284.73 | — | 135 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1284.7338654063567 \| rating \| reported \| Higher is better \| ### Configuration category industry_legal_and_government config text ### Reported statistics lower 1270.9089986803365 rank 264 upper 1298.5587321323771 variance 49.75373911666425 votes 1976 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/5371/row` | | | | | | | | | [Arena text style control / overall](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aoverall.md) | 1,321.57 | — | 129 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1321.57399123449 \| rating \| reported \| Higher is better \| ### Configuration category overall config text_style_control ### Reported statistics lower 1316.836089874163 rank 261 upper 1326.311892594817 variance 5.8435376631557245 votes 29824 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/260/row` | | | | | | | | | [Arena vision / chinese (config: vision)](https://benchize.com/benchmarks/benchmark%3Avision%3Achinese--config-vision.md) | 1,106.25 | — | 70 / 74 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1106.2490036670324 \| rating \| reported \| Higher is better \| ### Configuration category chinese config vision ### Reported statistics lower 1069.9363464061464 rank 106 upper 1142.5616609279184 variance 343.2573766620033 votes 278 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/306/row` | | | | | | | | | [Arena vision / humor (config: vision)](https://benchize.com/benchmarks/benchmark%3Avision%3Ahumor--config-vision.md) | 1,101.56 | — | 62 / 63 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1101.5604794717256 \| rating \| reported \| Higher is better \| ### Configuration category humor config vision ### Reported statistics lower 1056.6866569920921 rank 92 upper 1146.4343019513587 variance 524.1914694193656 votes 191 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/1017/row` | | | | | | | | | [Creative Writing v3](https://benchize.com/benchmarks/eq-bench%3Acreative-writing-v3.md) | 783.1elo | — | 82 / 90 | — | — | [eq bench · creative-writing-v3](https://eqbench.com/creative_writing.js) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo_score` \| 783.1 \| elo \| overall \| Higher is better \| \| `creative_writing_score` \| 9.12 \| rubric_score \| overall \| Higher is better \| ### Configuration interactiveAdjustments none protocol creative-writing-v3 sourceModelVersion meta-llama/Llama-4-Scout-17B-16E-Instruct ### Source [Original source](https://eqbench.com/creative_writing.js) Source eq bench Original model label meta-llama/Llama-4-Scout-17B-16E-Instruct Source version creative-writing-v3 Observed 2026-10-22T05:10:05.433Z Evidence SHA-256 `722ddb132e8d3a5e5c39b8d445f8475f3f7e24893a007260c6f3e3cce5c1ee18` Source locator `/leaderboardDataCreativeWritingV3/127` | | | | | | | | | [Arena text / korean](https://benchize.com/benchmarks/lmarena%3Atext%3Akorean.md) | 1,207.07 | — | 113 / 124 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1207.07193301639 \| rating \| reported \| Higher is better \| ### Configuration category korean config text ### Reported statistics lower 1181.8784300964505 rank 212 upper 1232.2654359363291 variance 165.2269668902246 votes 649 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/8445/row` | | | | | | | | | [Arena text / coding](https://benchize.com/benchmarks/lmarena%3Atext%3Acoding.md) | 1,285.92 | — | 134 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1285.9244673751205 \| rating \| reported \| Higher is better \| ### Configuration category coding config text ### Reported statistics lower 1277.4038088451089 rank 272 upper 1294.4451259051316 variance 18.899492399592337 votes 5228 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/1081/row` | | | | | | | | | [Arena text style control / multi turn](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Amulti_turn.md) | 1,319.43 | — | 126 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1319.4330165411375 \| rating \| reported \| Higher is better \| ### Configuration category multi_turn config text_style_control ### Reported statistics lower 1310.6875893282624 rank 253 upper 1328.1784437540123 variance 19.909753222832332 votes 5226 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/9568/row` | | | | | | | | | [Arena text style control / korean](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Akorean.md) | 1,269.03 | — | 107 / 124 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1269.0253905197292 \| rating \| reported \| Higher is better \| ### Configuration category korean config text_style_control ### Reported statistics lower 1243.6989233676609 rank 204 upper 1294.351857671797 variance 166.97561222037916 votes 649 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/8437/row` | | | | | | | | | [DesignArena UI component generation](https://benchize.com/benchmarks/designarena%3Aui-components.md) | 768elo | — | 112 / 112 | — | — | [designarena · public](https://www.designarena.ai/api/leaderboard#board=ui-components) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 768 \| elo \| ui-components \| Higher is better \| ### Configuration arenaType models category uicomponent inputModality Not reported sourceModelVersion llama-4-scout variationName public ### Reported statistics averageGenerationTimeMs 12056 battles 157 losses 117 standardError Not reported winRate 25.5 wins 40 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=ui-components) Source designarena Original model label Llama 4 Scout Source version public Observed 2026-10-21T16:37:57.993Z Evidence SHA-256 `46482ec1b4012638eace65493daea4750e2088098018fd9d5fc46126fc1f8557` Source locator `/data/174` | | | | | | | | | [Arena text / french](https://benchize.com/benchmarks/lmarena%3Atext%3Afrench.md) | 1,282.71 | — | 119 / 132 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1282.7055796988495 \| rating \| reported \| Higher is better \| ### Configuration category french config text ### Reported statistics lower 1253.0821536658439 rank 224 upper 1312.329005731855 variance 228.44117583808656 votes 427 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/3061/row` | | | | | | | | | [Arena vision style control / creative writing](https://benchize.com/benchmarks/lmarena%3Avision_style_control%3Acreative_writing.md) | 1,137.93 | — | 11 / 13 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1137.931183100854 \| rating \| reported \| Higher is better \| ### Configuration category creative_writing config vision_style_control ### Reported statistics lower 1101.1497480538835 rank 31 upper 1174.7126181478243 variance 352.17713563047823 votes 265 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) Source Arena Original model label llama-4-scout-17b-16e-instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `38568936995f36625aae49e9ea05557d55c1b1df9b2954f5c50cee523f26fe92` Source locator `/rows/359/row` | | | | | | | | | [Arena text style control / industry life and physical and social science](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aindustry_life_and_physical_and_social_science.md) | 1,333.97 | — | 128 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1333.9727568049216 \| rating \| reported \| Higher is better \| ### Configuration category industry_life_and_physical_and_social_science config text_style_control ### Reported statistics lower 1324.997757624329 rank 260 upper 1342.947755985514 variance 20.96875537431369 votes 4978 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/5757/row` | | | | | | | | | [Arena text / expert](https://benchize.com/benchmarks/lmarena%3Atext%3Aexpert.md) | 1,235.31 | — | 135 / 148 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1235.3070894529772 \| rating \| reported \| Higher is better \| ### Configuration category expert config text ### Reported statistics lower 1219.686664104204 rank 268 upper 1250.9275148017505 variance 63.51693444224058 votes 1534 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/2738/row` | | | | | | | | | [ARC-AGI-1](https://benchize.com/benchmarks/arc-prize%3Av1_Semi_Private.md) | 0.5% | — | 244 / 245 | 0.0041usd per task | — | [arc prize · v1](https://arcprize.org/media/data/leaderboard/v1.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.005 \| score_fraction \| v1_Semi_Private \| Higher is better \| \| `cost_per_task` \| 0.0041 \| usd_per_task \| v1_Semi_Private \| Lower is better \| ### Configuration evaluationSplit v1_Semi_Private harness Not reported modelGroup Llama 4 modelType Base LLM sourceModelVersion Llama-4-Scout-17B-16E-Instruct-together ### Source [Original source](https://arcprize.org/media/data/leaderboard/v1.json) Source arc prize Original model label Llama 4 Scout Source version v1 Observed 2026-10-22T05:20:04.066Z Evidence SHA-256 `2bf68d22dafba37047d07ad833ebc0e8199c9aa2f9eeaed50c75c1b704462836` Source locator `/evaluations/14` | | | | | | | | | [Arena text / hard prompts](https://benchize.com/benchmarks/lmarena%3Atext%3Ahard_prompts.md) | 1,266.2 | — | 136 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1266.202580372937 \| rating \| reported \| Higher is better \| ### Configuration category hard_prompts config text ### Reported statistics lower 1260.0481248081908 rank 274 upper 1272.3570359376836 variance 9.86014039624523 votes 12899 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/3724/row` | | | | | | | | | [Arena text style control / longer query](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Alonger_query.md) | 1,325.56 | — | 129 / 150 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1325.5591266751444 \| rating \| reported \| Higher is better \| ### Configuration category longer_query config text_style_control ### Reported statistics lower 1317.23783187404 rank 260 upper 1333.880421476249 variance 18.025430025142466 votes 5806 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/8777/row` | | | | | | | | | [Arena vision / homework (config: vision)](https://benchize.com/benchmarks/benchmark%3Avision%3Ahomework--config-vision.md) | 1,148.06 | — | 73 / 73 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1148.0631782736937 \| rating \| reported \| Higher is better \| ### Configuration category homework config vision ### Reported statistics lower 1122.0260380381455 rank 115 upper 1174.1003185092416 variance 176.47792239592283 votes 477 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/922/row` | | | | | | | | | [Arena text / industry mathematical](https://benchize.com/benchmarks/lmarena%3Atext%3Aindustry_mathematical.md) | 1,285.56 | — | 128 / 148 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1285.555593687641 \| rating \| reported \| Higher is better \| ### Configuration category industry_mathematical config text ### Reported statistics lower 1271.8331970219274 rank 252 upper 1299.2779903533549 variance 49.0189219878629 votes 1804 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/6164/row` | | | | | | | | | [DesignArena Overall frontend coding](https://benchize.com/benchmarks/designarena%3Acode.md) | 790elo | SE ±11.57 | 116 / 116 | — | — | [designarena · public](https://www.designarena.ai/api/leaderboard#board=code) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 790 \| elo \| code \| Higher is better \| ### Configuration arenaType models category allcategories inputModality text sourceModelVersion llama-4-scout variationName public ### Reported statistics Uncertainty Standard error: ±11.57 averageGenerationTimeMs 11984 battles 1275 losses 936 standardError 11.5678 winRate 26.6 wins 339 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=code) Source designarena Original model label Llama 4 Scout Source version public Observed 2026-10-21T16:37:57.301Z Evidence SHA-256 `0c897b58670f5e352bd123db999a40c0d1781a443964c502b90774a76a3a7758` Source locator `/data/182` | | | | | | | | | [Arena text / creative writing](https://benchize.com/benchmarks/lmarena%3Atext%3Acreative_writing.md) | 1,248.68 | — | 136 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1248.678902399669 \| rating \| reported \| Higher is better \| ### Configuration category creative_writing config text ### Reported statistics lower 1238.681963648852 rank 269 upper 1258.675841150486 variance 26.015841650888405 votes 3761 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/1490/row` | | | | | | | | | [Arena vision style control / diagram](https://benchize.com/benchmarks/lmarena%3Avision_style_control%3Adiagram.md) | 1,151.26 | — | 73 / 74 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1151.2584476560808 \| rating \| reported \| Higher is better \| ### Configuration category diagram config vision_style_control ### Reported statistics lower 1131.190586643501 rank 117 upper 1171.3263086686607 variance 104.83492454760935 votes 845 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `38568936995f36625aae49e9ea05557d55c1b1df9b2954f5c50cee523f26fe92` Source locator `/rows/583/row` | | | | | | | | | [Arena text / spanish](https://benchize.com/benchmarks/lmarena%3Atext%3Aspanish.md) | 1,278.02 | — | 121 / 134 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1278.023861998339 \| rating \| reported \| Higher is better \| ### Configuration category spanish config text ### Reported statistics lower 1254.2500591412486 rank 227 upper 1301.7976648554295 variance 147.12996511717768 votes 711 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/10991/row` | | | | | | | | | [EQ-Bench 3](https://benchize.com/benchmarks/eq-bench%3Aeqbench3.md) | 608.2elo | CI 578.3–638.2 | 49 / 50 | — | — | [eq bench · eqbench3](https://eqbench.com/eqbench3.js) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo_norm` \| 608.2 \| elo \| overall \| Higher is better \| \| `rubric_0_100` \| 29.4 \| percent \| overall \| Higher is better \| ### Configuration interactiveAdjustments none protocol eqbench3 sourceModelVersion meta-llama/Llama-4-Scout-17B-16E-Instruct ### Reported statistics Uncertainty Confidence interval: 578.3–638.2 confidenceIntervalHigh 638.2 confidenceIntervalLow 578.3 ### Source [Original source](https://eqbench.com/eqbench3.js) Source eq bench Original model label meta-llama/Llama-4-Scout-17B-16E-Instruct Source version eqbench3 Observed 2026-10-22T05:10:04.922Z Evidence SHA-256 `3672ff093e739f07ff664a2e6013bc38a6977a146e4092b4cef80ba1780542b2` Source locator `/leaderboardDataEQBench3/75` | | | | | | | | | [Arena text / industry life and physical and social science](https://benchize.com/benchmarks/lmarena%3Atext%3Aindustry_life_and_physical_and_social_science.md) | 1,278.12 | — | 136 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1278.1205669138483 \| rating \| reported \| Higher is better \| ### Configuration category industry_life_and_physical_and_social_science config text ### Reported statistics lower 1269.1493284714136 rank 274 upper 1287.091805356283 variance 20.95118624139673 votes 4978 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Llama 4 Scout 17B 16E Instruct Observed 2026-10-22T00:45:04.817Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/5771/row` | | | | | | | | --- Cite as: Llama 4 Scout — Benchize, https://benchize.com/models/llama-4-scout (retrieved 2026-10-22)