# Gemini 2.5 Pro

> Source: Benchize (https://benchize.com) — https://benchize.com/models/gemini-2-5-pro. When citing or reusing this content, credit "Benchize" and link to https://benchize.com/models/gemini-2-5-pro.

Google

Canonical URL: https://benchize.com/models/gemini-2-5-pro
Last updated: Wed, 21 Oct 2026 18:52:20 GMT

Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations.

Google

## Benchmarks

| Benchmark | Score | ± | Rank | Cost | Latency | Source |  |
| --- | --- | --- | --- | --- | --- | --- | --- |
| [Arena text / instruction following](https://benchize.com/benchmarks/lmarena%3Atext%3Ainstruction_following.md) | 1,436.52 | — | 48 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1436.5151326837383 \| rating \| reported \| Higher is better \| ### Configuration category instruction_following config text ### Reported statistics lower 1432.6944365957752 rank 64 upper 1440.3358287717015 variance 3.8000455758989284 votes 35196 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/7597/row` |  |  |  |  |  |  |  |
| [CorpFin v2 / shared max context](https://benchize.com/benchmarks/vals-ai%3Acorp_fin_v2%3Ashared_max_context.md) | 62.59% | SE ±1.65 pp | 21 / 39 | $0.08 | 28.75source duration | [Vals AI · 2](https://www.vals.ai/_astro/benchmark_view_corp_fin_v2.CectKwl1.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 62.587 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.081072 \| USD \| per_test \| Lower is better \| \| `latency` \| 28.746 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 65536 provider Google reasoning Not reported Reasoning effort unknown Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.65 pp sourcePopulation 134 stderr 1.652 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_corp_fin_v2.CectKwl1.json) Source Vals AI Original model label google/gemini-2.5-pro Source version 2 Observed 2026-10-21T16:45:57.998Z Evidence SHA-256 `7cf2217ab3728d5a84bffce82aab9fc52d7f810b0cbe8c65b387df47f3d31c9b` Source locator `/tasks/shared_max_context/google~1gemini-2.5-pro` |  |  |  |  |  |  |  |
| [DesignArena Overall frontend coding](https://benchize.com/benchmarks/designarena%3Acode.md) | 1,152elo | SE ±4.31 | 76 / 116 | — | — | [designarena · public](https://www.designarena.ai/api/leaderboard#board=code) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 1152 \| elo \| code \| Higher is better \| ### Configuration arenaType models category allcategories inputModality text sourceModelVersion gemini-2.5-pro variationName public ### Reported statistics Uncertainty Standard error: ±4.31 averageGenerationTimeMs 74111 battles 7220 losses 3069 standardError 4.3072 winRate 57.5 wins 4151 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=code) Source designarena Original model label Gemini 2.5 Pro Source version public Observed 2026-10-21T16:37:57.301Z Evidence SHA-256 `0c897b58670f5e352bd123db999a40c0d1781a443964c502b90774a76a3a7758` Source locator `/data/111` |  |  |  |  |  |  |  |
| [Arena text / industry mathematical](https://benchize.com/benchmarks/lmarena%3Atext%3Aindustry_mathematical.md) | 1,454.29 | — | 51 / 148 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1454.2902857581437 \| rating \| reported \| Higher is better \| ### Configuration category industry_mathematical config text ### Reported statistics lower 1446.950420035239 rank 72 upper 1461.6301514810482 variance 14.024263006556358 votes 6914 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/5984/row` |  |  |  |  |  |  |  |
| [SWE-bench / >4 hours](https://benchize.com/benchmarks/vals-ai%3Aswebench%3A%3E4%20hours.md) | 0% | SE ±0 pp | 32 / 39 | $1.23 | 486.97source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_swebench.Ae8ni7h0.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 0 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 1.226948 \| USD \| per_test \| Lower is better \| \| `latency` \| 486.969 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 65536 provider Google reasoning Not reported Reasoning effort unknown Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0 pp sourcePopulation 88 stderr 0 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_swebench.Ae8ni7h0.json) Source Vals AI Original model label google/gemini-2.5-pro Source version 1 Observed 2026-10-21T16:46:13.711Z Evidence SHA-256 `7a4e2e8485283caac500127419f68ec4bd5414c837ade114fc6afa5b2d34ccaa` Source locator `/tasks/>4 hours/google~1gemini-2.5-pro` |  |  |  |  |  |  |  |
| [DesignArena 3D design generation](https://benchize.com/benchmarks/designarena%3A3d-design.md) | 1,081elo | — | 70 / 110 | — | — | [designarena · public](https://www.designarena.ai/api/leaderboard#board=3d-design) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 1081 \| elo \| 3d-design \| Higher is better \| ### Configuration arenaType models category 3d inputModality Not reported sourceModelVersion gemini-2.5-pro variationName public ### Reported statistics averageGenerationTimeMs 57072 battles 644 losses 318 standardError Not reported winRate 50.6 wins 326 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=3d-design) Source designarena Original model label Gemini 2.5 Pro Source version public Observed 2026-10-21T16:37:58.515Z Evidence SHA-256 `bcc0267f7bc7e9ec112306b3a35413cf78bbccbfaa838356232d5d5ed0b83d0f` Source locator `/data/113` |  |  |  |  |  |  |  |
| [CaseLaw v2 / overall](https://benchize.com/benchmarks/vals-ai%3Acase_law_v2%3Aoverall.md) | 63.88% | SE ±0.6 pp | 6 / 17 | $0.26 | 44.02source duration | [Vals AI · 2](https://www.vals.ai/_astro/benchmark_view_case_law_v2.DLKA06_7.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 63.88 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.257186 \| USD \| per_test \| Lower is better \| \| `latency` \| 44.02 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 65536 provider Google reasoning Not reported Reasoning effort unknown Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.6 pp sourcePopulation 54 stderr 0.597 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_case_law_v2.DLKA06_7.json) Source Vals AI Original model label google/gemini-2.5-pro Source version 2 Observed 2026-10-21T16:45:54.497Z Evidence SHA-256 `293f388f7e0fe563287d4cd19beaa7ef9821b32795dace34bd0197ed47a592d4` Source locator `/tasks/overall/google~1gemini-2.5-pro` |  |  |  |  |  |  |  |
| [AIME 2025](https://benchize.com/benchmarks/aime-2025.md) | 88.33% | 95% CI 82.59–94.07% | 14 / 35 | 0.13usd per problem | — | [matharena · aime--aime_2025](https://matharena.ai/competition_tables/aime--aime_2025) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 88.33 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.13 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition aime--aime_2025 predicted false sourceModelName Gemini 2.5 Pro sourceModelVersion gemini/gemini-pro-2.5 ### Reported statistics Uncertainty 95% confidence interval: 82.59–94.07% confidenceInterval95 5.74 problems 30 ### Source [Original source](https://matharena.ai/competition_tables/aime--aime_2025) Source matharena Original model label Gemini 2.5 Pro Source version aime--aime_2025 Observed 2026-10-21T16:52:35.082Z Evidence SHA-256 `fab0abcecc4032852ef2cbd2a84d34ffc42202be358b2994bfaba44ae7a0cd9a` Source locator `/table/rows/24` |  |  |  |  |  |  |  |
| [Arena vision style control / ocr](https://benchize.com/benchmarks/lmarena%3Avision_style_control%3Aocr.md) | 1,258.98 | — | 48 / 74 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1258.9832441853382 \| rating \| reported \| Higher is better \| ### Configuration category ocr config vision_style_control ### Reported statistics lower 1254.1355945585194 rank 62 upper 1263.830893812157 variance 6.117391335240229 votes 32875 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `38568936995f36625aae49e9ea05557d55c1b1df9b2954f5c50cee523f26fe92` Source locator `/rows/1080/row` |  |  |  |  |  |  |  |
| [Arena text / russian](https://benchize.com/benchmarks/lmarena%3Atext%3Arussian.md) | 1,460.55 | — | 32 / 150 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1460.5545336697535 \| rating \| reported \| Higher is better \| ### Configuration category russian config text ### Reported statistics lower 1454.9276199482176 rank 39 upper 1466.1814473912893 variance 8.242222423169512 votes 12206 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/10422/row` |  |  |  |  |  |  |  |
| [Spiral-Bench v1.0](https://benchize.com/benchmarks/eq-bench%3Aspiral-bench-v1.0.md) | 43.5% | CI 43.5–43.5% | 9 / 11 | — | — | [eq bench · spiral-bench-v1.0](https://eqbench.com/spiral-bench_v1.0.js) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score_norm` \| 43.5 \| percent \| overall \| Higher is better \| ### Configuration interactiveAdjustments none protocol spiral-bench-v1.0 sourceModelVersion gemini-2.5-pro ### Reported statistics Uncertainty Confidence interval: 43.5–43.5% confidenceIntervalHigh 43.5 confidenceIntervalLow 43.5 ### Source [Original source](https://eqbench.com/spiral-bench_v1.0.js) Source eq bench Original model label gemini-2.5-pro Source version spiral-bench-v1.0 Observed 2026-10-21T16:35:04.619Z Evidence SHA-256 `d939ed9ba6d42226765fb4acf3e440127472566e1b5c2894d4ca25baa5ae75d2` Source locator `/leaderboardDataDelusion/5` |  |  |  |  |  |  |  |
| [Kangaroo 2025 3-4](https://benchize.com/benchmarks/matharena%3Akangaroo--kangaroo_2025_3-4.md) | 64.58% | 95% CI 55.01–74.15% | 11 / 16 | 0.13usd per problem | — | [matharena · kangaroo--kangaroo_2025_3-4](https://matharena.ai/competition_tables/kangaroo--kangaroo_2025_3-4) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 64.58 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.13 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition kangaroo--kangaroo_2025_3-4 predicted false sourceModelName Gemini 2.5 Pro sourceModelVersion gemini/gemini-pro-2.5 ### Reported statistics Uncertainty 95% confidence interval: 55.01–74.15% confidenceInterval95 9.57 problems 24 ### Source [Original source](https://matharena.ai/competition_tables/kangaroo--kangaroo_2025_3-4) Source matharena Original model label Gemini 2.5 Pro Source version kangaroo--kangaroo_2025_3-4 Observed 2026-10-21T16:52:32.012Z Evidence SHA-256 `38fec99c55752fef6703c9ed49d9e1e204b235f2bd78d5ee47725dac9e5da89c` Source locator `/table/rows/13` |  |  |  |  |  |  |  |
| [Arena text style control / korean](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Akorean.md) | 1,414.42 | — | 43 / 124 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1414.4173041965691 \| rating \| reported \| Higher is better \| ### Configuration category korean config text_style_control ### Reported statistics lower 1401.3671217960496 rank 68 upper 1427.4674865970892 variance 44.33400659389705 votes 2497 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/8301/row` |  |  |  |  |  |  |  |
| [MortgageTax / semantic extraction](https://benchize.com/benchmarks/vals-ai%3Amortgage_tax%3Asemantic_extraction.md) | 60.25% | SE ±1.38 pp | 12 / 31 | $0.00494 | 19.77source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_mortgage_tax.DCd-oO5Y.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 60.254 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.004942 \| USD \| per_test \| Lower is better \| \| `latency` \| 19.767 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 65536 provider Google reasoning Not reported Reasoning effort unknown Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.38 pp sourcePopulation 98 stderr 1.38 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_mortgage_tax.DCd-oO5Y.json) Source Vals AI Original model label google/gemini-2.5-pro Source version 1 Observed 2026-10-21T16:45:58.500Z Evidence SHA-256 `e5c844561f97d119d66d70269e726ecfb68be79eae39acf14ead3e95422e648c` Source locator `/tasks/semantic_extraction/google~1gemini-2.5-pro` |  |  |  |  |  |  |  |
| [Arena text / industry business and management and financial operations](https://benchize.com/benchmarks/lmarena%3Atext%3Aindustry_business_and_management_and_financial_operations.md) | 1,439.47 | — | 41 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1439.4738941858595 \| rating \| reported \| Higher is better \| ### Configuration category industry_business_and_management_and_financial_operations config text ### Reported statistics lower 1434.9474040441614 rank 55 upper 1444.0003843275579 variance 5.333680239526715 votes 22810 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/4337/row` |  |  |  |  |  |  |  |
| [Project Euler](https://benchize.com/benchmarks/matharena%3Aeuler--euler.md) | 26.7% | — | 10 / 10 | 0.34usd per problem | — | [matharena · euler--euler](https://matharena.ai/competition_tables/euler--euler) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 26.70 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.34 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition euler--euler predicted true sourceModelName Gemini 2.5 Pro sourceModelVersion gemini/gemini-pro-2.5 ### Reported statistics confidenceInterval95 Not reported problems 50 ### Source [Original source](https://matharena.ai/competition_tables/euler--euler) Source matharena Original model label Gemini 2.5 Pro Source version euler--euler Observed 2026-10-21T16:52:41.889Z Evidence SHA-256 `f965e69ef39c2cc9c950899809f028eda1d49070afaf6272153ba51fa222ba3d` Source locator `/table/rows/17` |  |  |  |  |  |  |  |
| [Arena text style control / spanish](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aspanish.md) | 1,453.72 | — | 41 / 134 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1453.7164352785371 \| rating \| reported \| Higher is better \| ### Configuration category spanish config text_style_control ### Reported statistics lower 1442.5750522366143 rank 66 upper 1464.85781832046 variance 32.31335330686146 votes 3453 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/10830/row` |  |  |  |  |  |  |  |
| [HMMT Feb 2025](https://benchize.com/benchmarks/matharena%3Ahmmt--hmmt_feb_2025.md) | 82.5% | 95% CI 75.7–89.3% | 11 / 34 | 0.13usd per problem | — | [matharena · hmmt--hmmt_feb_2025](https://matharena.ai/competition_tables/hmmt--hmmt_feb_2025) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 82.50 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.13 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition hmmt--hmmt_feb_2025 predicted false sourceModelName Gemini 2.5 Pro sourceModelVersion gemini/gemini-pro-2.5 ### Reported statistics Uncertainty 95% confidence interval: 75.7–89.3% confidenceInterval95 6.80 problems 30 ### Source [Original source](https://matharena.ai/competition_tables/hmmt--hmmt_feb_2025) Source matharena Original model label Gemini 2.5 Pro Source version hmmt--hmmt_feb_2025 Observed 2026-10-21T16:52:35.608Z Evidence SHA-256 `8554225c26eb7a3c2649943ee7cf6b404ec1f7441b20fbdcfccbf35b9a864864` Source locator `/table/rows/22` |  |  |  |  |  |  |  |
| [Judgemark v2.1](https://benchize.com/benchmarks/eq-bench%3Ajudgemark-v2.md) | 72.06% | — | 22 / 39 | — | — | [eq bench · judgemark-v2](https://eqbench.com/judgemark-v2.js) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `judgemark_score` \| 72.06 \| percent \| overall \| Higher is better \| \| `stability` \| 0.675 \| score_fraction \| overall \| Higher is better \| \| `separability` \| 0.747 \| score_fraction \| overall \| Higher is better \| \| `human_corr` \| 0.662 \| correlation \| overall \| Higher is better \| ### Configuration interactiveAdjustments none protocol judgemark-v2 sourceModelVersion gemini-2.5-pro ### Source [Original source](https://eqbench.com/judgemark-v2.js) Source eq bench Original model label gemini-2.5-pro Source version judgemark-v2 Observed 2026-10-21T16:35:03.564Z Evidence SHA-256 `070cc3fbd6f0333dde2b52bec4329ea3fba7eccbf016bbbbef95e0f8b2197781` Source locator `/leaderboardDataV2/2` |  |  |  |  |  |  |  |
| [MedCode / overall](https://benchize.com/benchmarks/vals-ai%3Amedcode%3Aoverall.md) | 50.59% | SE ±2.11 pp | 14 / 49 | $0.02 | 27.42source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_medcode.DehpEDgG.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 50.59 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.015389 \| USD \| per_test \| Lower is better \| \| `latency` \| 27.415 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 30000 provider Google reasoning Not reported Reasoning effort unknown Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±2.11 pp sourcePopulation 107 stderr 2.113 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_medcode.DehpEDgG.json) Source Vals AI Original model label google/gemini-2.5-pro Source version 1 Observed 2026-10-21T16:45:59.516Z Evidence SHA-256 `988a6ae1e07e33ce031572ed4a804be11c36ee97a1dd75cbe4740fff3b534f8c` Source locator `/tasks/overall/google~1gemini-2.5-pro` |  |  |  |  |  |  |  |
| [SMT 2025](https://benchize.com/benchmarks/matharena%3Asmt--smt_2025.md) | 84.91% | 95% CI 80.09–89.73% | 13 / 25 | 0.19usd per problem | — | [matharena · smt--smt_2025](https://matharena.ai/competition_tables/smt--smt_2025) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 84.91 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.19 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition smt--smt_2025 predicted false sourceModelName Gemini 2.5 Pro sourceModelVersion gemini/gemini-pro-2.5 ### Reported statistics Uncertainty 95% confidence interval: 80.09–89.73% confidenceInterval95 4.82 problems 53 ### Source [Original source](https://matharena.ai/competition_tables/smt--smt_2025) Source matharena Original model label Gemini 2.5 Pro Source version smt--smt_2025 Observed 2026-10-21T16:52:36.547Z Evidence SHA-256 `1b4f6f8bafc1688e4557a024513f68befa31aff48fd0623fb4892a61263433b0` Source locator `/table/rows/21` |  |  |  |  |  |  |  |
| [FrontierMath Tier 4 v2 (private)](https://benchize.com/benchmarks/epoch-ai%3Afrontiermath_tier_4_v2.md) | 0% | SE ±0 pp | 37 / 38 | — | — | [epoch ai · FrontierMath-Tier-4-v2-Private](https://epoch.ai/data/benchmark_data.zip#file=frontiermath_tier_4_v2.csv) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.0 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.0 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion FrontierMath-Tier-4-v2-Private reasoningBudget Not reported Reasoning effort Not reported sourceModelVersion gemini-2.5-pro ### Reported statistics Uncertainty Standard error: ±0 pp standardError 0 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=frontiermath_tier_4_v2.csv) Source epoch ai Original model label gemini-2.5-pro Source version FrontierMath-Tier-4-v2-Private Evaluated 2026-06-11T23:56:12.000Z Observed 2026-10-21T16:30:24.199Z Evidence SHA-256 `48b886c828092231989fba6e3819efb7462e89ef681b7b306b4bfa3505829e4a` Source locator `/rows/58` |  |  |  |  |  |  |  |
| [Vibe Code Bench v1.1 / overall](https://benchize.com/benchmarks/vals-ai%3Avibe-code%3Aoverall.md) | 0.4% | SE ±0.4 pp | 57 / 59 | $1.22 | 2,097.14source duration | [Vals AI · 1.1](https://www.vals.ai/_astro/benchmark_view_vibe_code_bench.DcEBMbCA.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 0.4 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 1.223831 \| USD \| per_test \| Lower is better \| \| `latency` \| 2097.144 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness OpenHands maxOutputTokens 65536 provider Google reasoning Not reported Reasoning effort unknown Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.4 pp sourcePopulation 116 stderr 0.4 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_vibe_code_bench.DcEBMbCA.json) Source Vals AI Original model label google/gemini-2.5-pro Source version 1.1 Observed 2026-10-21T16:46:08.625Z Evidence SHA-256 `0e8c23f521a0f751c5592952620e197b376cade41c78578461b7aa5740a173e7` Source locator `/tasks/overall/google~1gemini-2.5-pro` |  |  |  |  |  |  |  |
| [Arena webdev / overall](https://benchize.com/benchmarks/lmarena%3Awebdev%3Aoverall.md) | 1,226.32 | — | 88 / 90 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/webdev/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1226.3200378385177 \| rating \| reported \| Higher is better \| ### Configuration category overall config webdev ### Reported statistics lower 1210.449159802538 rank 141 upper 1242.1909158744975 variance 65.57008193762994 votes 2730 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/webdev/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `f82507859808110820a4ab6df15561b8864137ddefc1f6fb0c552af2e58ea738` Source locator `/rows/140/row` |  |  |  |  |  |  |  |
| [Arena vision style control / entity recognition](https://benchize.com/benchmarks/lmarena%3Avision_style_control%3Aentity_recognition.md) | 1,250.81 | — | 7 / 34 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1250.8092307286204 \| rating \| reported \| Higher is better \| ### Configuration category entity_recognition config vision_style_control ### Reported statistics lower 1228.6515633184058 rank 7 upper 1272.966898138835 variance 127.80619238109334 votes 917 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `38568936995f36625aae49e9ea05557d55c1b1df9b2954f5c50cee523f26fe92` Source locator `/rows/763/row` |  |  |  |  |  |  |  |
| [FinanceBenchmark v2](https://benchize.com/benchmarks/financebenchmark%3Av2.md) | 84.93% | CI 76.71–93.15% | 13 / 21 | — | — | [financebenchmark](https://finbenchmark.ai/) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `pass_at_1` \| 0.849315 \| score_fraction \| reported \| Higher is better \| \| `accuracy` \| 0.794521 \| score_fraction \| reported \| Higher is better \| \| `knowledge` \| 1 \| score_fraction \| category \| Higher is better \| \| `analysis` \| 1 \| score_fraction \| category \| Higher is better \| \| `quant` \| 0.533333 \| score_fraction \| category \| Higher is better \| \| `portfolio_mgmt` \| 0.833333 \| score_fraction \| category \| Higher is better \| \| `credit_underwriting` \| 0.833333 \| score_fraction \| category \| Higher is better \| \| `banking_regulation` \| 1 \| score_fraction \| category \| Higher is better \| \| `derivatives_structuring` \| 0.833333 \| score_fraction \| category \| Higher is better \| \| `corporate_finance` \| 0.8 \| score_fraction \| category \| Higher is better \| ### Configuration harnessVersion 0.1.0 Reasoning effort unknown sourceRunId 5d574048-26bd-470e-a7d1-5389e339868e taskSetVersion v2 ### Reported statistics Uncertainty Confidence interval: 76.71–93.15% confidenceInterval [0.7671,0.9315] confidenceMethod percentile bootstrap over tasks, n=5000, alpha=0.05 sampleSize 73 ### Source [Original source](https://finbenchmark.ai/) Source financebenchmark Original model label gemini-2.5-pro Evaluated 2026-06-15T09:03:02.078369+00:00 Observed 2026-10-21T16:30:44.281Z Evidence SHA-256 `f9e7dab8846b092fc0befeca8c5cd02a8187c0f5b6b10c32ab2c7ab60f7af575` Source locator `/rows/15` |  |  |  |  |  |  |  |
| [Kangaroo 2025 1-2](https://benchize.com/benchmarks/matharena%3Akangaroo--kangaroo_2025_1-2.md) | 64.58% | 95% CI 55.01–74.15% | 13 / 16 | 0.1usd per problem | — | [matharena · kangaroo--kangaroo_2025_1-2](https://matharena.ai/competition_tables/kangaroo--kangaroo_2025_1-2) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 64.58 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.10 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition kangaroo--kangaroo_2025_1-2 predicted false sourceModelName Gemini 2.5 Pro sourceModelVersion gemini/gemini-pro-2.5 ### Reported statistics Uncertainty 95% confidence interval: 55.01–74.15% confidenceInterval95 9.57 problems 24 ### Source [Original source](https://matharena.ai/competition_tables/kangaroo--kangaroo_2025_1-2) Source matharena Original model label Gemini 2.5 Pro Source version kangaroo--kangaroo_2025_1-2 Observed 2026-10-21T16:52:31.513Z Evidence SHA-256 `a59a4c362e2d87350330706a01dd330e9a1ac7cc64a4de0bacbf1a439d8fcf90` Source locator `/table/rows/15` |  |  |  |  |  |  |  |
| [Arena text style control / longer query](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Alonger_query.md) | 1,456.38 | — | 51 / 150 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1456.3751832662686 \| rating \| reported \| Higher is better \| ### Configuration category longer_query config text_style_control ### Reported statistics lower 1452.4315591629036 rank 79 upper 1460.3188073696335 variance 4.048506516550832 votes 34001 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/8596/row` |  |  |  |  |  |  |  |
| [SWE-bench Verified](https://benchize.com/benchmarks/swe-bench%3Averified.md) | 53.6% | — | 38 / 63 | — | — | [SWE-bench](https://www.swebench.com/) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `resolved` \| 53.6 \| percent \| verified \| Higher is better \| ### Configuration agent mini-SWE-agent agentOrganization SWE-agent models ["gemini-2.5-pro"] Reasoning effort Not reported sourceSubmission 20250726_mini-v1.0.0_gemini-2.5-pro subset Verified system ["System: Attempts - 1"] ### Reported statistics instanceCalls 20.478 instanceCost 0.28837209562500005 sourceWarning Not reported ### Source [Original source](https://www.swebench.com/) Source SWE-bench Original model label Gemini 2.5 Pro Observed 2026-10-21T14:54:06.913Z Evidence SHA-256 `c862011a4ee1d1a7199fad6ca0905fa5c64f58216f7217ac1eddf37f28788433` Source locator `/leaderboard-data/2/results/97` |  |  |  |  |  |  |  |
| [Arena text / industry writing and literature and language](https://benchize.com/benchmarks/lmarena%3Atext%3Aindustry_writing_and_literature_and_language.md) | 1,453.74 | — | 29 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1453.7441527109502 \| rating \| reported \| Higher is better \| ### Configuration category industry_writing_and_literature_and_language config text ### Reported statistics lower 1449.5233797783574 rank 37 upper 1457.9649256435428 variance 4.637541356043407 votes 28253 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/7154/row` |  |  |  |  |  |  |  |
| [Arena webdev / webdev](https://benchize.com/benchmarks/lmarena%3Awebdev%3Awebdev.md) | 1,226.32 | — | 88 / 90 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/webdev/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1226.3200378385177 \| rating \| reported \| Higher is better \| ### Configuration category webdev config webdev ### Reported statistics lower 1210.449159802538 rank 141 upper 1242.1909158744975 variance 65.57008193762994 votes 2730 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/webdev/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `f82507859808110820a4ab6df15561b8864137ddefc1f6fb0c552af2e58ea738` Source locator `/rows/352/row` |  |  |  |  |  |  |  |
| [SVGBench Arena](https://benchize.com/benchmarks/svgbench%3Aarena.md) | 1,585 | — | 37 / 191 | — | — | [svgbench](https://svgbench.ai/api/leaderboard?shape=2) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1585 \| rating \| reported \| Higher is better \| ### Configuration Reasoning effort unknown sourceModelId model_google_gemini_2_5_pro ### Reported statistics coverageCount 22 draws 6 judged 74 losses 29 rank 45 ratingDeviation 28 wins 39 ### Source [Original source](https://svgbench.ai/api/leaderboard?shape=2) Source svgbench Original model label Gemini 2.5 Pro Observed 2026-10-21T16:32:23.388Z Evidence SHA-256 `5c0a9c869593820d57d2c05f6d416e1b44a740b4835e66c66e9ad8b8edc59e2c` Source locator `/rows/43` |  |  |  |  |  |  |  |
| [SAGE / PDEs](https://benchize.com/benchmarks/vals-ai%3Asage%3APDEs.md) | 30.16% | SE ±5.76 pp | 37 / 41 | $0.00787 | 59.27source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_sage.RRwIIzO5.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 30.159 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.00787 \| USD \| per_test \| Lower is better \| \| `latency` \| 59.266 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 30000 provider Google reasoning Not reported Reasoning effort unknown Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±5.76 pp sourcePopulation 91 stderr 5.759 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_sage.RRwIIzO5.json) Source Vals AI Original model label google/gemini-2.5-pro Source version 1 Observed 2026-10-21T16:46:07.515Z Evidence SHA-256 `cc5fb3fecdb0382d492ff167a42ad84b9c5c3883373c78ed87baaa972b8b6f7c` Source locator `/tasks/PDEs/google~1gemini-2.5-pro` |  |  |  |  |  |  |  |
| [Arena text / industry life and physical and social science](https://benchize.com/benchmarks/lmarena%3Atext%3Aindustry_life_and_physical_and_social_science.md) | 1,479.98 | — | 28 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1479.9836642523055 \| rating \| reported \| Higher is better \| ### Configuration category industry_life_and_physical_and_social_science config text ### Reported statistics lower 1475.3492431245702 rank 34 upper 1484.6180853800408 variance 5.591068443451019 votes 20872 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/5531/row` |  |  |  |  |  |  |  |
| [MortgageTax / overall](https://benchize.com/benchmarks/vals-ai%3Amortgage_tax%3Aoverall.md) | 68.92% | SE ±0.91 pp | 8 / 31 | $0.00479 | 24.01source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_mortgage_tax.DCd-oO5Y.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 68.918 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.004794 \| USD \| per_test \| Lower is better \| \| `latency` \| 24.008 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 65536 provider Google reasoning Not reported Reasoning effort unknown Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.91 pp sourcePopulation 98 stderr 0.907 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_mortgage_tax.DCd-oO5Y.json) Source Vals AI Original model label google/gemini-2.5-pro Source version 1 Observed 2026-10-21T16:45:58.500Z Evidence SHA-256 `e5c844561f97d119d66d70269e726ecfb68be79eae39acf14ead3e95422e648c` Source locator `/tasks/overall/google~1gemini-2.5-pro` |  |  |  |  |  |  |  |
| [Kangaroo 2025 11-12](https://benchize.com/benchmarks/matharena%3Akangaroo--kangaroo_2025_11-12.md) | 89.17% | 95% CI 83.61–94.73% | 12 / 16 | 0.11usd per problem | — | [matharena · kangaroo--kangaroo_2025_11-12](https://matharena.ai/competition_tables/kangaroo--kangaroo_2025_11-12) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 89.17 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.11 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition kangaroo--kangaroo_2025_11-12 predicted false sourceModelName Gemini 2.5 Pro sourceModelVersion gemini/gemini-pro-2.5 ### Reported statistics Uncertainty 95% confidence interval: 83.61–94.73% confidenceInterval95 5.56 problems 30 ### Source [Original source](https://matharena.ai/competition_tables/kangaroo--kangaroo_2025_11-12) Source matharena Original model label Gemini 2.5 Pro Source version kangaroo--kangaroo_2025_11-12 Observed 2026-10-21T16:52:34.045Z Evidence SHA-256 `1e53cfaa398a3ab9a1de8f0f33a4b2499b23b5df61a94735b6b646efc684444c` Source locator `/table/rows/14` |  |  |  |  |  |  |  |
| [Arena text / multi turn](https://benchize.com/benchmarks/lmarena%3Atext%3Amulti_turn.md) | 1,452.59 | — | 43 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1452.5877300745747 \| rating \| reported \| Higher is better \| ### Configuration category multi_turn config text ### Reported statistics lower 1447.9136954456403 rank 63 upper 1457.2617647035092 variance 5.6870581547795815 votes 21187 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/9378/row` |  |  |  |  |  |  |  |
| [Arena text / expert](https://benchize.com/benchmarks/lmarena%3Atext%3Aexpert.md) | 1,452.02 | — | 55 / 148 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1452.024844716218 \| rating \| reported \| Higher is better \| ### Configuration category expert config text ### Reported statistics lower 1445.2805143684245 rank 81 upper 1458.7691750640113 variance 11.840812036076352 votes 8326 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/2551/row` |  |  |  |  |  |  |  |
| [SAGE / automata](https://benchize.com/benchmarks/vals-ai%3Asage%3Aautomata.md) | 43.65% | SE ±6.33 pp | 3 / 41 | $0.00933 | 59.76source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_sage.RRwIIzO5.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 43.651 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.009334 \| USD \| per_test \| Lower is better \| \| `latency` \| 59.764 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 30000 provider Google reasoning Not reported Reasoning effort unknown Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±6.33 pp sourcePopulation 91 stderr 6.33 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_sage.RRwIIzO5.json) Source Vals AI Original model label google/gemini-2.5-pro Source version 1 Observed 2026-10-21T16:46:07.515Z Evidence SHA-256 `cc5fb3fecdb0382d492ff167a42ad84b9c5c3883373c78ed87baaa972b8b6f7c` Source locator `/tasks/automata/google~1gemini-2.5-pro` |  |  |  |  |  |  |  |
| [Arena vision / chinese (config: vision)](https://benchize.com/benchmarks/benchmark%3Avision%3Achinese--config-vision.md) | 1,300.18 | — | 43 / 74 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1300.1780954784963 \| rating \| reported \| Higher is better \| ### Configuration category chinese config vision ### Reported statistics lower 1287.2950894162125 rank 53 upper 1313.06110154078 variance 43.20542089550477 votes 4797 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/253/row` |  |  |  |  |  |  |  |
| [FrontierMath (2025-02-28 private)](https://benchize.com/benchmarks/epoch-ai%3Afrontiermath.md) | 14.14% | SE ±2.05 pp | 11 / 18 | — | — | [epoch ai · FrontierMath-2025-02-28-Private](https://epoch.ai/data/benchmark_data.zip#file=frontiermath.csv) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.1413793103448276 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.1413793103448276 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion FrontierMath-2025-02-28-Private reasoningBudget Not reported Reasoning effort Not reported sourceModelVersion gemini-2.5-pro ### Reported statistics Uncertainty Standard error: ±2.05 pp standardError 0.020494847099131453 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=frontiermath.csv) Source epoch ai Original model label gemini-2.5-pro Source version FrontierMath-2025-02-28-Private Evaluated 2025-11-24T02:37:34.534Z Observed 2026-10-21T16:30:24.199Z Evidence SHA-256 `f5c92f0f0b9103abb02308fd428c0806e7c21b91e8a14d43edb8af77ce941598` Source locator `/rows/42` |  |  |  |  |  |  |  |
| [SWE-bench Verified (Epoch AI)](https://benchize.com/benchmarks/epoch-ai%3Aswe_bench_verified.md) | 57.56% | SE ±2.25 pp | 9 / 10 | — | — | [epoch ai · SWE-Bench verified](https://epoch.ai/data/benchmark_data.zip#file=swe_bench_verified.csv) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.5755693581780539 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.5755693581780539 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion SWE-Bench verified reasoningBudget Not reported Reasoning effort Not reported sourceModelVersion gemini-2.5-pro ### Reported statistics Uncertainty Standard error: ±2.25 pp standardError 0.02251275673889269 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=swe_bench_verified.csv) Source epoch ai Original model label gemini-2.5-pro Source version SWE-Bench verified Evaluated 2026-02-13T18:40:15.413Z Observed 2026-10-21T16:30:24.199Z Evidence SHA-256 `6480176a5d9b1573676fcacc5df5e8c58f9e5fce34025600a19b3bf60617561c` Source locator `/rows/20` |  |  |  |  |  |  |  |
| [PropensityBench](https://benchize.com/benchmarks/scale%3Apropensitybench.md) | 79source score | CI 78.4–79.6 | 1 / 5 | — | — | [scale](https://labs.scale.com/leaderboard/propensitybench) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 79 \| source_score \| reported \| Higher is better \| ### Configuration Reasoning effort unknown Model configuration gemini-2.5-pro sourceModelVersion Not reported thinkingEnabled Not reported ### Reported statistics Uncertainty Confidence interval: 78.4–79.6 contaminationWarning Not reported rank 14 reportedConfidenceHalfWidth 0.6 ### Source [Original source](https://labs.scale.com/leaderboard/propensitybench) Source scale Original model label gemini-2.5-pro Observed 2026-10-21T16:35:35.949Z Evidence SHA-256 `e65bbee55f6a735247cf59c5746c7850ce3413b5c0686e4c5b71a8cd641ec37f` Source locator `/rows/13` |  |  |  |  |  |  |  |
| [SWE-bench / 15 min - 1 hour](https://benchize.com/benchmarks/vals-ai%3Aswebench%3A15%20min%20-%201%20hour.md) | 47.51% | SE ±3.1 pp | 37 / 39 | $0.39 | 230.32source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_swebench.Ae8ni7h0.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 47.51 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.387754 \| USD \| per_test \| Lower is better \| \| `latency` \| 230.32 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 65536 provider Google reasoning Not reported Reasoning effort unknown Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±3.1 pp sourcePopulation 88 stderr 3.097 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_swebench.Ae8ni7h0.json) Source Vals AI Original model label google/gemini-2.5-pro Source version 1 Observed 2026-10-21T16:46:13.711Z Evidence SHA-256 `7a4e2e8485283caac500127419f68ec4bd5414c837ade114fc6afa5b2d34ccaa` Source locator `/tasks/15 min - 1 hour/google~1gemini-2.5-pro` |  |  |  |  |  |  |  |
| [Arena text / korean](https://benchize.com/benchmarks/lmarena%3Atext%3Akorean.md) | 1,434.42 | — | 28 / 124 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1434.42271309656 \| rating \| reported \| Higher is better \| ### Configuration category korean config text ### Reported statistics lower 1421.454013467782 rank 34 upper 1447.3914127253381 variance 43.782109326653625 votes 2497 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/8267/row` |  |  |  |  |  |  |  |
| [CorpFin v2 / exact pages](https://benchize.com/benchmarks/vals-ai%3Acorp_fin_v2%3Aexact_pages.md) | 62.94% | SE ±1.65 pp | 16 / 39 | $0.2 | 32.82source duration | [Vals AI · 2](https://www.vals.ai/_astro/benchmark_view_corp_fin_v2.CectKwl1.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 62.937 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.201351 \| USD \| per_test \| Lower is better \| \| `latency` \| 32.815 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 65536 provider Google reasoning Not reported Reasoning effort unknown Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.65 pp sourcePopulation 134 stderr 1.649 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_corp_fin_v2.CectKwl1.json) Source Vals AI Original model label google/gemini-2.5-pro Source version 2 Observed 2026-10-21T16:45:57.998Z Evidence SHA-256 `7cf2217ab3728d5a84bffce82aab9fc52d7f810b0cbe8c65b387df47f3d31c9b` Source locator `/tasks/exact_pages/google~1gemini-2.5-pro` |  |  |  |  |  |  |  |
| [Arena text style control / english](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aenglish.md) | 1,448.84 | — | 59 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1448.8416894045977 \| rating \| reported \| Higher is better \| ### Configuration category english config text_style_control ### Reported statistics lower 1445.49611891895 rank 99 upper 1452.1872598902453 variance 2.9136956549267086 votes 54043 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/1735/row` |  |  |  |  |  |  |  |
| [Arena text / creative writing](https://benchize.com/benchmarks/lmarena%3Atext%3Acreative_writing.md) | 1,453.57 | — | 26 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1453.5678071271116 \| rating \| reported \| Higher is better \| ### Configuration category creative_writing config text ### Reported statistics lower 1448.5059393621216 rank 31 upper 1458.6296748921018 variance 6.669993475451716 votes 17698 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/1252/row` |  |  |  |  |  |  |  |
| [Kangaroo 2025 9-10](https://benchize.com/benchmarks/matharena%3Akangaroo--kangaroo_2025_9-10.md) | 95.83% | 95% CI 92.25–99.41% | 9 / 15 | 0.1usd per problem | — | [matharena · kangaroo--kangaroo_2025_9-10](https://matharena.ai/competition_tables/kangaroo--kangaroo_2025_9-10) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 95.83 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.10 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition kangaroo--kangaroo_2025_9-10 predicted false sourceModelName Gemini 2.5 Pro sourceModelVersion gemini/gemini-pro-2.5 ### Reported statistics Uncertainty 95% confidence interval: 92.25–99.41% confidenceInterval95 3.58 problems 30 ### Source [Original source](https://matharena.ai/competition_tables/kangaroo--kangaroo_2025_9-10) Source matharena Original model label Gemini 2.5 Pro Source version kangaroo--kangaroo_2025_9-10 Observed 2026-10-21T16:52:33.536Z Evidence SHA-256 `52964b89ab1a06cf2e79ec946b33004aa40ca31f1ec26888e6dd0f0a7994223a` Source locator `/table/rows/11` |  |  |  |  |  |  |  |
| [Arena text style control / french](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Afrench.md) | 1,465.96 | — | 57 / 132 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1465.9567437240962 \| rating \| reported \| Higher is better \| ### Configuration category french config text_style_control ### Reported statistics lower 1452.600891333525 rank 89 upper 1479.312596114668 variance 46.43516991977054 votes 2391 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/2926/row` |  |  |  |  |  |  |  |
| [SAGE / linear algebra](https://benchize.com/benchmarks/vals-ai%3Asage%3Alinear_algebra.md) | 51.94% | SE ±5.61 pp | 36 / 41 | $0.00922 | 39.77source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_sage.RRwIIzO5.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 51.938 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.009215 \| USD \| per_test \| Lower is better \| \| `latency` \| 39.772 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 30000 provider Google reasoning Not reported Reasoning effort unknown Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±5.61 pp sourcePopulation 91 stderr 5.612 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_sage.RRwIIzO5.json) Source Vals AI Original model label google/gemini-2.5-pro Source version 1 Observed 2026-10-21T16:46:07.515Z Evidence SHA-256 `cc5fb3fecdb0382d492ff167a42ad84b9c5c3883373c78ed87baaa972b8b6f7c` Source locator `/tasks/linear_algebra/google~1gemini-2.5-pro` |  |  |  |  |  |  |  |
| [Arena text style control / multi turn](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Amulti_turn.md) | 1,448.24 | — | 60 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1448.2414043137223 \| rating \| reported \| Higher is better \| ### Configuration category multi_turn config text_style_control ### Reported statistics lower 1443.5305931017892 rank 92 upper 1452.9522155256554 variance 5.776904897412149 votes 21187 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/9407/row` |  |  |  |  |  |  |  |
| [Arena vision style control / diagram](https://benchize.com/benchmarks/lmarena%3Avision_style_control%3Adiagram.md) | 1,267.9 | — | 50 / 74 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1267.9044248752775 \| rating \| reported \| Higher is better \| ### Configuration category diagram config vision_style_control ### Reported statistics lower 1260.783561486891 rank 63 upper 1275.025288263664 variance 13.199853952072488 votes 9768 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `38568936995f36625aae49e9ea05557d55c1b1df9b2954f5c50cee523f26fe92` Source locator `/rows/529/row` |  |  |  |  |  |  |  |
| [Arena text style control / chinese](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Achinese.md) | 1,486.6 | — | 52 / 146 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1486.5952047078956 \| rating \| reported \| Higher is better \| ### Configuration category chinese config text_style_control ### Reported statistics lower 1479.8648376800745 rank 83 upper 1493.3255717357167 variance 11.791832854008204 votes 9314 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/499/row` |  |  |  |  |  |  |  |
| [Arena text / industry legal and government](https://benchize.com/benchmarks/lmarena%3Atext%3Aindustry_legal_and_government.md) | 1,480.03 | — | 27 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1480.0302728872562 \| rating \| reported \| Higher is better \| ### Configuration category industry_legal_and_government config text ### Reported statistics lower 1473.3274054398494 rank 31 upper 1486.7331403346632 variance 11.695669305492771 votes 8929 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/5138/row` |  |  |  |  |  |  |  |
| [Arena text style control / industry business and management and financial operations](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aindustry_business_and_management_and_financial_operations.md) | 1,437.25 | — | 69 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1437.2543570493322 \| rating \| reported \| Higher is better \| ### Configuration category industry_business_and_management_and_financial_operations config text_style_control ### Reported statistics lower 1432.6870779964315 rank 110 upper 1441.8216361022326 variance 5.430238594434601 votes 22810 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/4392/row` |  |  |  |  |  |  |  |
| [FrontierMath Tier 4 (2025-07-01 private)](https://benchize.com/benchmarks/epoch-ai%3Afrontiermath_tier_4.md) | 4.17% | SE ±2.91 pp | 8 / 15 | — | — | [epoch ai · FrontierMath-Tier-4-2025-07-01-Private](https://epoch.ai/data/benchmark_data.zip#file=frontiermath_tier_4.csv) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.041666666666666664 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.041666666666666664 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion FrontierMath-Tier-4-2025-07-01-Private reasoningBudget Not reported Reasoning effort Not reported sourceModelVersion gemini-2.5-pro ### Reported statistics Uncertainty Standard error: ±2.91 pp standardError 0.02914766351555603 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=frontiermath_tier_4.csv) Source epoch ai Original model label gemini-2.5-pro Source version FrontierMath-Tier-4-2025-07-01-Private Evaluated 2025-07-03T15:44:08.541Z Observed 2026-10-21T16:30:24.199Z Evidence SHA-256 `c928e5adccd6e0995d50ede183fb99728d6c5be01951434a3077429ffb5802b2` Source locator `/rows/59` |  |  |  |  |  |  |  |
| [Arena vision / english (config: vision)](https://benchize.com/benchmarks/benchmark%3Avision%3Aenglish--config-vision.md) | 1,260.98 | — | 45 / 82 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1260.9808948112159 \| rating \| reported \| Higher is better \| ### Configuration category english config vision ### Reported statistics lower 1254.730386183533 rank 59 upper 1267.2314034388983 variance 10.170318081836642 votes 40672 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/648/row` |  |  |  |  |  |  |  |
| [Arena text / german](https://benchize.com/benchmarks/lmarena%3Atext%3Agerman.md) | 1,487.1 | — | 15 / 129 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1487.0950688659618 \| rating \| reported \| Higher is better \| ### Configuration category german config text ### Reported statistics lower 1474.5644636994448 rank 18 upper 1499.6256740324784 variance 40.87407236888301 votes 2652 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/3154/row` |  |  |  |  |  |  |  |
| [Arena text style control / hard prompts english](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Ahard_prompts_english.md) | 1,458.22 | — | 69 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1458.2232537461214 \| rating \| reported \| Higher is better \| ### Configuration category hard_prompts_english config text_style_control ### Reported statistics lower 1454.0990274206401 rank 113 upper 1462.3474800716021 variance 4.427808178539151 votes 28958 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/3980/row` |  |  |  |  |  |  |  |
| [Arena webdev / image to webdev](https://benchize.com/benchmarks/lmarena%3Awebdev%3Aimage_to_webdev.md) | 1,285.41 | — | 42 / 42 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/webdev/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1285.4095058025518 \| rating \| reported \| Higher is better \| ### Configuration category image_to_webdev config webdev ### Reported statistics lower 1264.2280996638747 rank 64 upper 1306.590911941229 variance 116.79208002821257 votes 1053 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/webdev/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `f82507859808110820a4ab6df15561b8864137ddefc1f6fb0c552af2e58ea738` Source locator `/rows/211/row` |  |  |  |  |  |  |  |
| [Arena text / longer query](https://benchize.com/benchmarks/lmarena%3Atext%3Alonger_query.md) | 1,449.13 | — | 45 / 150 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1449.1335467171357 \| rating \| reported \| Higher is better \| ### Configuration category longer_query config text ### Reported statistics lower 1445.219832694383 rank 63 upper 1453.0472607398883 variance 3.9873282955359777 votes 34001 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/8580/row` |  |  |  |  |  |  |  |
| [DesignArena UI component generation](https://benchize.com/benchmarks/designarena%3Aui-components.md) | 1,140elo | — | 78 / 112 | — | — | [designarena · public](https://www.designarena.ai/api/leaderboard#board=ui-components) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 1140 \| elo \| ui-components \| Higher is better \| ### Configuration arenaType models category uicomponent inputModality Not reported sourceModelVersion gemini-2.5-pro variationName public ### Reported statistics averageGenerationTimeMs 65962 battles 572 losses 243 standardError Not reported winRate 57.5 wins 329 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=ui-components) Source designarena Original model label Gemini 2.5 Pro Source version public Observed 2026-10-21T16:37:57.993Z Evidence SHA-256 `46482ec1b4012638eace65493daea4750e2088098018fd9d5fc46126fc1f8557` Source locator `/data/114` |  |  |  |  |  |  |  |
| [Arena text / industry entertainment and sports and media](https://benchize.com/benchmarks/lmarena%3Atext%3Aindustry_entertainment_and_sports_and_media.md) | 1,441.05 | — | 29 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1441.0491236880255 \| rating \| reported \| Higher is better \| ### Configuration category industry_entertainment_and_sports_and_media config text ### Reported statistics lower 1436.524115581154 rank 36 upper 1445.5741317948966 variance 5.330188171469372 votes 23310 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/4728/row` |  |  |  |  |  |  |  |
| [Terminal-Bench 2.0 / overall](https://benchize.com/benchmarks/vals-ai%3Aterminal-bench-2%3Aoverall.md) | 30.34% | SE ±4.9 pp | 16 / 23 | $0.47 | 796.53source duration | [Vals AI · 2.0](https://www.vals.ai/_astro/benchmark_view_terminal_bench_2.T48tPR4O.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 30.337 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.472003 \| USD \| per_test \| Lower is better \| \| `latency` \| 796.526 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 65536 provider Google reasoning Not reported Reasoning effort unknown Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±4.9 pp sourcePopulation 67 stderr 4.901 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_terminal_bench_2.T48tPR4O.json) Source Vals AI Original model label google/gemini-2.5-pro Source version 2.0 Observed 2026-10-21T16:46:14.732Z Evidence SHA-256 `38e640d995259778e531f048b2f2c7b3b281cb05b56be643ddc9dc53eb85adf7` Source locator `/tasks/overall/google~1gemini-2.5-pro` |  |  |  |  |  |  |  |
| [Arena vision style control / homework](https://benchize.com/benchmarks/lmarena%3Avision_style_control%3Ahomework.md) | 1,271.84 | — | 49 / 73 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1271.8355549385783 \| rating \| reported \| Higher is better \| ### Configuration category homework config vision_style_control ### Reported statistics lower 1262.9055960746432 rank 61 upper 1280.7655138025139 variance 20.758823414165622 votes 5415 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `38568936995f36625aae49e9ea05557d55c1b1df9b2954f5c50cee523f26fe92` Source locator `/rows/868/row` |  |  |  |  |  |  |  |
| [Arena text style control / industry medicine and healthcare](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aindustry_medicine_and_healthcare.md) | 1,469.02 | — | 48 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1469.0167665014353 \| rating \| reported \| Higher is better \| ### Configuration category industry_medicine_and_healthcare config text_style_control ### Reported statistics lower 1461.7908901769085 rank 81 upper 1476.2426428259619 variance 13.592046952600391 votes 7991 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/6393/row` |  |  |  |  |  |  |  |
| [Arena text style control / polish](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Apolish.md) | 1,456.26 | — | 41 / 117 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1456.261610788875 \| rating \| reported \| Higher is better \| ### Configuration category polish config text_style_control ### Reported statistics lower 1447.7202353701186 rank 64 upper 1464.8029862076312 variance 18.991507510407548 votes 6495 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/10211/row` |  |  |  |  |  |  |  |
| [IMO 2025](https://benchize.com/benchmarks/matharena%3Aimo--imo_2025.md) | 31.55% | 95% CI 12.96–50.14% | 2 / 4 | 18usd per problem | — | [matharena · imo--imo_2025](https://matharena.ai/competition_tables/imo--imo_2025) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 31.55 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 18.00 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition imo--imo_2025 predicted false sourceModelName Gemini 2.5 Pro sourceModelVersion gemini/gemini-pro-2.5 ### Reported statistics Uncertainty 95% confidence interval: 12.96–50.14% confidenceInterval95 18.59 problems 6 ### Source [Original source](https://matharena.ai/competition_tables/imo--imo_2025) Source matharena Original model label Gemini 2.5 Pro Source version imo--imo_2025 Observed 2026-10-21T16:52:40.005Z Evidence SHA-256 `1d8d25002237e5658d7597e8559337724a90305229240d1517221f7b3aa09aac` Source locator `/table/rows/1` |  |  |  |  |  |  |  |
| [Arena text / japanese](https://benchize.com/benchmarks/lmarena%3Atext%3Ajapanese.md) | 1,461.11 | — | 23 / 120 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1461.1147782813568 \| rating \| reported \| Higher is better \| ### Configuration category japanese config text ### Reported statistics lower 1446.4780021669824 rank 25 upper 1475.751554395731 variance 55.7692337786432 votes 2064 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/7975/row` |  |  |  |  |  |  |  |
| [Arena vision / humor (config: vision)](https://benchize.com/benchmarks/benchmark%3Avision%3Ahumor--config-vision.md) | 1,262.3 | — | 31 / 63 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1262.2983398944116 \| rating \| reported \| Higher is better \| ### Configuration category humor config vision ### Reported statistics lower 1247.3644409422332 rank 41 upper 1277.23223884659 variance 58.05641771101337 votes 3133 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/966/row` |  |  |  |  |  |  |  |
| [Arena text style control / instruction following](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Ainstruction_following.md) | 1,438.06 | — | 55 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1438.055054286761 \| rating \| reported \| Higher is better \| ### Configuration category instruction_following config text_style_control ### Reported statistics lower 1434.2072891924327 rank 84 upper 1441.9028193810898 variance 3.854081720563142 votes 35196 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/7617/row` |  |  |  |  |  |  |  |
| [Arena text / industry medicine and healthcare](https://benchize.com/benchmarks/lmarena%3Atext%3Aindustry_medicine_and_healthcare.md) | 1,475.81 | — | 24 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1475.8081013711785 \| rating \| reported \| Higher is better \| ### Configuration category industry_medicine_and_healthcare config text ### Reported statistics lower 1468.6783480473878 rank 30 upper 1482.9378546949692 variance 13.232832845757281 votes 7991 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/6342/row` |  |  |  |  |  |  |  |
| [Arena text style control / industry mathematical](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aindustry_mathematical.md) | 1,446.34 | — | 64 / 148 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1446.3393852298614 \| rating \| reported \| Higher is better \| ### Configuration category industry_mathematical config text_style_control ### Reported statistics lower 1438.9406106826586 rank 99 upper 1453.738159777064 variance 14.250280259530093 votes 6914 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/6011/row` |  |  |  |  |  |  |  |
| [SciPredict](https://benchize.com/benchmarks/scale%3Ascipredict.md) | 17.04source score | CI 16.39–17.69 | 2 / 3 | — | — | [scale](https://labs.scale.com/leaderboard/scipredict) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 17.04 \| source_score \| reported \| Higher is better \| ### Configuration Reasoning effort unknown Model configuration gemini-2.5-pro sourceModelVersion Not reported thinkingEnabled Not reported ### Reported statistics Uncertainty Confidence interval: 16.39–17.69 contaminationWarning Not reported rank 12 reportedConfidenceHalfWidth 0.65 ### Source [Original source](https://labs.scale.com/leaderboard/scipredict) Source scale Original model label gemini-2.5-pro Observed 2026-10-21T16:35:32.131Z Evidence SHA-256 `5aa14320f6e771d71e8d7a3317448fdab16aff5276d6f61665625ce12acf1cee` Source locator `/rows/11` |  |  |  |  |  |  |  |
| [Apex](https://benchize.com/benchmarks/matharena%3Aapex--apex_2025.md) | 0.52% | 95% CI -0.5–1.54% | 28 / 30 | 0.31usd per problem | — | [matharena · apex--apex_2025](https://matharena.ai/competition_tables/apex--apex_2025) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 0.52 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.31 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition apex--apex_2025 predicted false sourceModelName Gemini 2.5 Pro sourceModelVersion gemini/gemini-pro-2.5 ### Reported statistics Uncertainty 95% confidence interval: -0.5–1.54% confidenceInterval95 1.02 problems 12 ### Source [Original source](https://matharena.ai/competition_tables/apex--apex_2025) Source matharena Original model label Gemini 2.5 Pro Source version apex--apex_2025 Observed 2026-10-21T16:52:38.728Z Evidence SHA-256 `20b28370d9d7f5a15a19fc9e4226c9857cdb07bc42b32ccec508e687b7b9f3fc` Source locator `/table/rows/46` |  |  |  |  |  |  |  |
| [Arena text / polish](https://benchize.com/benchmarks/lmarena%3Atext%3Apolish.md) | 1,478.7 | — | 18 / 117 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1478.6976389978613 \| rating \| reported \| Higher is better \| ### Configuration category polish config text ### Reported statistics lower 1470.2962885724387 rank 21 upper 1487.098989423284 variance 18.373928308307168 votes 6495 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/10168/row` |  |  |  |  |  |  |  |
| [Arena vision style control / creative writing](https://benchize.com/benchmarks/lmarena%3Avision_style_control%3Acreative_writing.md) | 1,262.39 | — | 4 / 13 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1262.387331733268 \| rating \| reported \| Higher is better \| ### Configuration category creative_writing config vision_style_control ### Reported statistics lower 1248.49317268865 rank 7 upper 1276.281490777886 variance 50.25373551245191 votes 2418 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) Source Arena Original model label gemini-2.5-pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `38568936995f36625aae49e9ea05557d55c1b1df9b2954f5c50cee523f26fe92` Source locator `/rows/335/row` |  |  |  |  |  |  |  |
| [Kangaroo 2025 7-8](https://benchize.com/benchmarks/matharena%3Akangaroo--kangaroo_2025_7-8.md) | 82.5% | 95% CI 75.7–89.3% | 13 / 15 | 0.12usd per problem | — | [matharena · kangaroo--kangaroo_2025_7-8](https://matharena.ai/competition_tables/kangaroo--kangaroo_2025_7-8) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 82.50 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.12 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition kangaroo--kangaroo_2025_7-8 predicted false sourceModelName Gemini 2.5 Pro sourceModelVersion gemini/gemini-pro-2.5 ### Reported statistics Uncertainty 95% confidence interval: 75.7–89.3% confidenceInterval95 6.80 problems 30 ### Source [Original source](https://matharena.ai/competition_tables/kangaroo--kangaroo_2025_7-8) Source matharena Original model label Gemini 2.5 Pro Source version kangaroo--kangaroo_2025_7-8 Observed 2026-10-21T16:52:33.033Z Evidence SHA-256 `197887eb5244aa6bce3570bd9eb25bbb0bb6ec95568339536d94e2859f0ee8c1` Source locator `/table/rows/16` |  |  |  |  |  |  |  |
| [Agent Poker Bench / overall](https://benchize.com/benchmarks/vals-ai%3Apoker_agent%3Aoverall.md) | 1,032.6source score | SE ±0 | 2 / 2 | $0.02 | 19.79source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_poker_agent.BeZvaV0m.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 1032.5962096202413 \| source_score \| reported \| Higher is better \| \| `cost_per_test` \| 0.02165833147163121 \| USD \| per_test \| Lower is better \| \| `latency` \| 19.79321908170333 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens Not reported provider Not reported reasoning Not reported Reasoning effort unknown Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0 sourcePopulation 17 stderr 0 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_poker_agent.BeZvaV0m.json) Source Vals AI Original model label google/gemini-2.5-pro Source version 1 Observed 2026-10-21T16:46:17.361Z Evidence SHA-256 `23821a0049c3ab8467573a74dac6c5037748e301e2abcd91885ec708168335af` Source locator `/tasks/overall/google~1gemini-2.5-pro` |  |  |  |  |  |  |  |
| [Arena text style control / industry life and physical and social science](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aindustry_life_and_physical_and_social_science.md) | 1,471.54 | — | 49 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1471.5445460457577 \| rating \| reported \| Higher is better \| ### Configuration category industry_life_and_physical_and_social_science config text_style_control ### Reported statistics lower 1466.8483535752891 rank 76 upper 1476.240738516226 variance 5.7411063736714825 votes 20872 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/5573/row` |  |  |  |  |  |  |  |
| [Arena vision / homework (config: vision)](https://benchize.com/benchmarks/benchmark%3Avision%3Ahomework--config-vision.md) | 1,280.55 | — | 45 / 73 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1280.5538481724927 \| rating \| reported \| Higher is better \| ### Configuration category homework config vision ### Reported statistics lower 1271.7290475749587 rank 56 upper 1289.3786487700268 variance 20.27279458697023 votes 5415 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/863/row` |  |  |  |  |  |  |  |
| [Arena text style control / overall](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aoverall.md) | 1,445.43 | — | 55 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1445.4337056218487 \| rating \| reported \| Higher is better \| ### Configuration category overall config text_style_control ### Reported statistics lower 1442.9726813906077 rank 87 upper 1447.89472985309 variance 1.5766510977882613 votes 125320 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/86/row` |  |  |  |  |  |  |  |
| [HMMT Nov 2025](https://benchize.com/benchmarks/matharena%3Ahmmt--hmmt_nov_2025.md) | 80% | 95% CI 72.84–87.16% | 12 / 12 | 0.22usd per problem | — | [matharena · hmmt--hmmt_nov_2025](https://matharena.ai/competition_tables/hmmt--hmmt_nov_2025) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 80.00 \| percent \| competition \| Higher is better \| \| `cost_per_problem` \| 0.22 \| usd_per_problem \| competition \| Lower is better \| ### Configuration competition hmmt--hmmt_nov_2025 predicted false sourceModelName Gemini 2.5 Pro sourceModelVersion gemini/gemini-pro-2.5 ### Reported statistics Uncertainty 95% confidence interval: 72.84–87.16% confidenceInterval95 7.16 problems 30 ### Source [Original source](https://matharena.ai/competition_tables/hmmt--hmmt_nov_2025) Source matharena Original model label Gemini 2.5 Pro Source version hmmt--hmmt_nov_2025 Observed 2026-10-21T16:52:37.292Z Evidence SHA-256 `aa9287d733e27dde3646179a18070c07f558fb51926a8fe90cdf38985d6fce6d` Source locator `/table/rows/20` |  |  |  |  |  |  |  |
| [DesignArena Browser game generation](https://benchize.com/benchmarks/designarena%3Agame-dev.md) | 1,111elo | — | 81 / 117 | — | — | [designarena · public](https://www.designarena.ai/api/leaderboard#board=game-dev) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 1111 \| elo \| game-dev \| Higher is better \| ### Configuration arenaType models category gamedev inputModality Not reported sourceModelVersion gemini-2.5-pro variationName public ### Reported statistics averageGenerationTimeMs 86712 battles 633 losses 290 standardError Not reported winRate 54.2 wins 343 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=game-dev) Source designarena Original model label Gemini 2.5 Pro Source version public Observed 2026-10-21T16:38:01.100Z Evidence SHA-256 `53db6a89112ce8cdf644568c666d4b8309aece764cfcedb291ffd52ae3934e30` Source locator `/data/121` |  |  |  |  |  |  |  |
| [Arena text / exclude ties](https://benchize.com/benchmarks/lmarena%3Atext%3Aexclude_ties.md) | 1,460.46 | — | 32 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1460.4591215888502 \| rating \| reported \| Higher is better \| ### Configuration category exclude_ties config text ### Reported statistics lower 1457.0848856122618 rank 41 upper 1463.8333575654383 variance 2.9638397695083443 votes 91433 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/2094/row` |  |  |  |  |  |  |  |
| [CorpFin v2 / max fitting context](https://benchize.com/benchmarks/vals-ai%3Acorp_fin_v2%3Amax_fitting_context.md) | 56.88% | SE ±1.69 pp | 31 / 39 | $0.00363 | 20.71source duration | [Vals AI · 2](https://www.vals.ai/_astro/benchmark_view_corp_fin_v2.CectKwl1.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 56.876 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.003627 \| USD \| per_test \| Lower is better \| \| `latency` \| 20.714 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 65536 provider Google reasoning Not reported Reasoning effort unknown Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.69 pp sourcePopulation 134 stderr 1.691 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_corp_fin_v2.CectKwl1.json) Source Vals AI Original model label google/gemini-2.5-pro Source version 2 Observed 2026-10-21T16:45:57.998Z Evidence SHA-256 `7cf2217ab3728d5a84bffce82aab9fc52d7f810b0cbe8c65b387df47f3d31c9b` Source locator `/tasks/max_fitting_context/google~1gemini-2.5-pro` |  |  |  |  |  |  |  |
| [Arena text style control / math](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Amath.md) | 1,438.97 | — | 60 / 149 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1438.969516910633 \| rating \| reported \| Higher is better \| ### Configuration category math config text_style_control ### Reported statistics lower 1432.0517206462657 rank 97 upper 1445.8873131750004 variance 12.457742589219414 votes 7818 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/9009/row` |  |  |  |  |  |  |  |
| [Arena text / coding](https://benchize.com/benchmarks/lmarena%3Atext%3Acoding.md) | 1,451.59 | — | 61 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1451.5850852009903 \| rating \| reported \| Higher is better \| ### Configuration category coding config text ### Reported statistics lower 1447.3855196691252 rank 100 upper 1455.7846507328557 variance 4.5910555025144095 votes 26942 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/909/row` |  |  |  |  |  |  |  |
| [SAGE / calculus](https://benchize.com/benchmarks/vals-ai%3Asage%3Acalculus.md) | 70.68% | SE ±5.81 pp | 19 / 36 | $0.02 | 62.78source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_sage.RRwIIzO5.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 70.679 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.019416 \| USD \| per_test \| Lower is better \| \| `latency` \| 62.783 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 30000 provider Google reasoning Not reported Reasoning effort unknown Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±5.81 pp sourcePopulation 91 stderr 5.808 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_sage.RRwIIzO5.json) Source Vals AI Original model label google/gemini-2.5-pro Source version 1 Observed 2026-10-21T16:46:07.515Z Evidence SHA-256 `cc5fb3fecdb0382d492ff167a42ad84b9c5c3883373c78ed87baaa972b8b6f7c` Source locator `/tasks/calculus/google~1gemini-2.5-pro` |  |  |  |  |  |  |  |
| [Arena text / hard prompts english](https://benchize.com/benchmarks/lmarena%3Atext%3Ahard_prompts_english.md) | 1,452.52 | — | 54 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1452.5208833282395 \| rating \| reported \| Higher is better \| ### Configuration category hard_prompts_english config text ### Reported statistics lower 1448.4379086526533 rank 79 upper 1456.6038580038262 variance 4.339674842191051 votes 28958 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/3946/row` |  |  |  |  |  |  |  |
| [Arena text style control / industry entertainment and sports and media](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aindustry_entertainment_and_sports_and_media.md) | 1,430.23 | — | 45 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1430.2283516434006 \| rating \| reported \| Higher is better \| ### Configuration category industry_entertainment_and_sports_and_media config text_style_control ### Reported statistics lower 1425.6469650312422 rank 70 upper 1434.8097382555593 variance 5.463836596918966 votes 23310 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/4762/row` |  |  |  |  |  |  |  |
| [Arena vision style control / humor](https://benchize.com/benchmarks/lmarena%3Avision_style_control%3Ahumor.md) | 1,247.17 | — | 32 / 63 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1247.1691661709583 \| rating \| reported \| Higher is better \| ### Configuration category humor config vision_style_control ### Reported statistics lower 1232.1283662752924 rank 42 upper 1262.209966066624 variance 58.890560086905495 votes 3133 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `38568936995f36625aae49e9ea05557d55c1b1df9b2954f5c50cee523f26fe92` Source locator `/rows/967/row` |  |  |  |  |  |  |  |
| [Arena vision / creative writing vision (config: vision)](https://benchize.com/benchmarks/benchmark%3Avision%3Acreative_writing_vision--config-vision.md) | 1,264.72 | — | 34 / 70 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1264.7158169723175 \| rating \| reported \| Higher is better \| ### Configuration category creative_writing_vision config vision ### Reported statistics lower 1252.279033196411 rank 42 upper 1277.152600748224 variance 40.26428445761662 votes 3682 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/404/row` |  |  |  |  |  |  |  |
| [Arena text / math](https://benchize.com/benchmarks/lmarena%3Atext%3Amath.md) | 1,449.59 | — | 50 / 149 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1449.5850420648187 \| rating \| reported \| Higher is better \| ### Configuration category math config text ### Reported statistics lower 1442.7129742121099 rank 71 upper 1456.4571099175275 variance 12.293589174464145 votes 7818 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/8983/row` |  |  |  |  |  |  |  |
| [Arena vision style control / english](https://benchize.com/benchmarks/lmarena%3Avision_style_control%3Aenglish.md) | 1,244.2 | — | 47 / 82 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1244.2015901757663 \| rating \| reported \| Higher is better \| ### Configuration category english config vision_style_control ### Reported statistics lower 1237.926119957057 rank 62 upper 1250.477060394476 variance 10.25171121287563 votes 40672 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `38568936995f36625aae49e9ea05557d55c1b1df9b2954f5c50cee523f26fe92` Source locator `/rows/651/row` |  |  |  |  |  |  |  |
| [Terminal-Bench 2.0 / easy](https://benchize.com/benchmarks/vals-ai%3Aterminal-bench-2%3Aeasy.md) | 100% | SE ±0 pp | 1 / 23 | $10.5 | 17,722.7source duration | [Vals AI · 2.0](https://www.vals.ai/_astro/benchmark_view_terminal_bench_2.T48tPR4O.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 100 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 10.502075 \| USD \| per_test \| Lower is better \| \| `latency` \| 17722.698 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 65536 provider Google reasoning Not reported Reasoning effort unknown Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0 pp sourcePopulation 67 stderr 0 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_terminal_bench_2.T48tPR4O.json) Source Vals AI Original model label google/gemini-2.5-pro Source version 2.0 Observed 2026-10-21T16:46:14.732Z Evidence SHA-256 `38e640d995259778e531f048b2f2c7b3b281cb05b56be643ddc9dc53eb85adf7` Source locator `/tasks/easy/google~1gemini-2.5-pro` |  |  |  |  |  |  |  |
| [Arena vision / ocr (config: vision)](https://benchize.com/benchmarks/benchmark%3Avision%3Aocr--config-vision.md) | 1,270.37 | — | 42 / 74 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1270.3670553491884 \| rating \| reported \| Higher is better \| ### Configuration category ocr config vision ### Reported statistics lower 1265.5653946379787 rank 52 upper 1275.1687160603979 variance 6.001872377589847 votes 32875 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `06e61305486dce3fec5dc776ac2fd8321104e84c346cf9e08fa6f8e8a66ce0d7` Source locator `/rows/1070/row` |  |  |  |  |  |  |  |
| [Arena text / english](https://benchize.com/benchmarks/lmarena%3Atext%3Aenglish.md) | 1,458.03 | — | 36 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1458.027499347607 \| rating \| reported \| Higher is better \| ### Configuration category english config text ### Reported statistics lower 1454.7233083243202 rank 49 upper 1461.3316903708942 variance 2.8420656911786146 votes 54043 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/1685/row` |  |  |  |  |  |  |  |
| [Arena vision style control / creative writing vision](https://benchize.com/benchmarks/lmarena%3Avision_style_control%3Acreative_writing_vision.md) | 1,251.2 | — | 38 / 70 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1251.200473371585 \| rating \| reported \| Higher is better \| ### Configuration category creative_writing_vision config vision_style_control ### Reported statistics lower 1238.6624166895033 rank 45 upper 1263.7385300536669 variance 40.92269960470111 votes 3682 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) Source Arena Original model label Gemini 2.5 Pro Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `38568936995f36625aae49e9ea05557d55c1b1df9b2954f5c50cee523f26fe92` Source locator `/rows/407/row` |  |  |  |  |  |  |  |

[Next page](https://benchize.com/models/gemini-2-5-pro.md?cursor=9384c142cb6a81bcab831640919b9a512adb0d6fac7b8737bf5aa24b8d97e383)

---
Cite as: Gemini 2.5 Pro — Benchize, https://benchize.com/models/gemini-2-5-pro (retrieved 2026-10-21)