# Gemini 2.5 Pro Preview 06-05 > Source: Benchize (https://benchize.com) — https://benchize.com/models/gemini-2-5-pro-preview. When citing or reusing this content, credit "Benchize" and link to https://benchize.com/models/gemini-2-5-pro-preview. Google Canonical URL: https://benchize.com/models/gemini-2-5-pro-preview Last updated: Wed, 21 Oct 2026 18:52:20 GMT Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations. Google ## Benchmarks | Benchmark | Score | ± | Rank | Cost | Source | | | --- | --- | --- | --- | --- | --- | --- | | [ARC-AGI-2](https://benchize.com/benchmarks/arc-prize%3Av2_Semi_Private.md) | 3.75% | — | 151 / 212 | 0.81usd per task | [arc prize · v2](https://arcprize.org/media/data/leaderboard/v2.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.0375 \| score_fraction \| v2_Semi_Private \| Higher is better \| \| `cost_per_task` \| 0.8126 \| usd_per_task \| v2_Semi_Private \| Lower is better \| ### Configuration evaluationSplit v2_Semi_Private harness Not reported modelGroup Not reported modelType CoT sourceModelVersion gemini-2-5-pro-preview-openrouter ### Source [Original source](https://arcprize.org/media/data/leaderboard/v2.json) Source arc prize Original model label Gemini 2.5 Pro (Preview) Source version v2 Observed 2026-10-21T16:34:20.750Z Evidence SHA-256 `bca68e12cc9a01954ae21b641844c1ecbabe146cb24b87f0f8e9b1db27433c29` Source locator `/evaluations/47` | | | | | | | | [EQ-Bench 3](https://benchize.com/benchmarks/eq-bench%3Aeqbench3.md) | 1,545elo | CI 1,515.1–1,574.8 | 12 / 50 | — | [eq bench · eqbench3](https://eqbench.com/eqbench3.js) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo_norm` \| 1545.0 \| elo \| overall \| Higher is better \| \| `rubric_0_100` \| 72.2 \| percent \| overall \| Higher is better \| ### Configuration interactiveAdjustments none protocol eqbench3 sourceModelVersion gemini-2.5-pro-preview-06-05 ### Reported statistics Uncertainty Confidence interval: 1,515.1–1,574.8 confidenceIntervalHigh 1574.8 confidenceIntervalLow 1515.1 ### Source [Original source](https://eqbench.com/eqbench3.js) Source eq bench Original model label gemini-2.5-pro-preview-06-05 Source version eqbench3 Observed 2026-10-21T16:35:00.608Z Evidence SHA-256 `3672ff093e739f07ff664a2e6013bc38a6977a146e4092b4cef80ba1780542b2` Source locator `/leaderboardDataEQBench3/18` | | | | | | | | [Creative Writing v3](https://benchize.com/benchmarks/eq-bench%3Acreative-writing-v3.md) | 1,421.2elo | — | 58 / 90 | — | [eq bench · creative-writing-v3](https://eqbench.com/creative_writing.js) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo_score` \| 1421.2 \| elo \| overall \| Higher is better \| \| `creative_writing_score` \| 16.16 \| rubric_score \| overall \| Higher is better \| ### Configuration interactiveAdjustments none protocol creative-writing-v3 sourceModelVersion gemini-2.5-pro-preview-06-05 ### Source [Original source](https://eqbench.com/creative_writing.js) Source eq bench Original model label gemini-2.5-pro-preview-06-05 Source version creative-writing-v3 Observed 2026-10-21T16:35:01.421Z Evidence SHA-256 `722ddb132e8d3a5e5c39b8d445f8475f3f7e24893a007260c6f3e3cce5c1ee18` Source locator `/leaderboardDataCreativeWritingV3/73` | | | | | | | | [VISTA](https://benchize.com/benchmarks/scale%3Avisual_language_understanding.md) | 54.63source score | CI 54.08–55.18 | 1 / 16 | — | [scale](https://labs.scale.com/leaderboard/visual_language_understanding) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 54.63 \| source_score \| reported \| Higher is better \| ### Configuration Reasoning effort unknown Model configuration gemini-2.5-pro-preview-06-05 sourceModelVersion Not reported thinkingEnabled Not reported ### Reported statistics Uncertainty Confidence interval: 54.08–55.18 contaminationWarning Not reported rank 2 reportedConfidenceHalfWidth 0.55 ### Source [Original source](https://labs.scale.com/leaderboard/visual_language_understanding) Source scale Original model label gemini-2.5-pro-preview-06-05 Observed 2026-10-21T16:35:38.974Z Evidence SHA-256 `469e2d64808796dc35f1a8b8b0abe7daefeb7c5ee06fa9b6ba8b34c42d4b19b5` Source locator `/rows/1` | | | | | | | | [MultiNRC](https://benchize.com/benchmarks/scale%3Amultinrc.md) | 45.12source score | CI 42.12–48.12 | 4 / 15 | — | [scale](https://labs.scale.com/leaderboard/multinrc) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 45.12 \| source_score \| reported \| Higher is better \| ### Configuration Reasoning effort unknown Model configuration Gemini-2.5-Pro-Preview-06-05 sourceModelVersion Not reported thinkingEnabled Not reported ### Reported statistics Uncertainty Confidence interval: 42.12–48.12 contaminationWarning Not reported rank 15 reportedConfidenceHalfWidth 3 ### Source [Original source](https://labs.scale.com/leaderboard/multinrc) Source scale Original model label Gemini-2.5-Pro-Preview-06-05 Observed 2026-10-21T16:35:36.736Z Evidence SHA-256 `a4931a13575ec92cd4993e96d4e87f8ef58149c485b7b54bb8558d7762620f8a` Source locator `/rows/14` | | | | | | | | [MASK](https://benchize.com/benchmarks/scale%3Amask.md) | 55.67source score | CI 51.16–60.17 | 12 / 25 | — | [scale](https://labs.scale.com/leaderboard/mask) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 55.666 \| source_score \| reported \| Higher is better \| ### Configuration Reasoning effort unknown Model configuration gemini-2.5-pro-preview-06-05 sourceModelVersion gemini-2.5-pro-preview-06-05 thinkingEnabled Not reported ### Reported statistics Uncertainty Confidence interval: 51.16–60.17 contaminationWarning Potential contamination warning: This model was evaluated after the public release of MASK, allowing model builder access to the prompts and solutions. rank 45 reportedConfidenceHalfWidth 4.508 ### Source [Original source](https://labs.scale.com/leaderboard/mask) Source scale Original model label gemini-2.5-pro-preview-06-05 Observed 2026-10-21T16:35:38.046Z Evidence SHA-256 `506198f10b9789b267cc2a11dcdfedc27067703da430d78b374b2c5dffb8ec7d` Source locator `/rows/44` | | | | | | | | [ARC-AGI-1](https://benchize.com/benchmarks/arc-prize%3Av1_Semi_Private.md) | 33% | — | 164 / 213 | 0.57usd per task | [arc prize · v1](https://arcprize.org/media/data/leaderboard/v1.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.33 \| score_fraction \| v1_Semi_Private \| Higher is better \| \| `cost_per_task` \| 0.5694 \| usd_per_task \| v1_Semi_Private \| Lower is better \| ### Configuration evaluationSplit v1_Semi_Private harness Not reported modelGroup Not reported modelType CoT sourceModelVersion gemini-2-5-pro-preview-openrouter ### Source [Original source](https://arcprize.org/media/data/leaderboard/v1.json) Source arc prize Original model label Gemini 2.5 Pro (Preview) Source version v1 Observed 2026-10-21T16:34:20.378Z Evidence SHA-256 `302d8267c0522bf450ec1deeac4d060e2cf2fb444ba0a4269014d9535de0bd1f` Source locator `/evaluations/45` | | | | | | | | [TutorBench](https://benchize.com/benchmarks/scale%3Atutorbench.md) | 55.65source score | CI 54.54–56.76 | 1 / 5 | — | [scale](https://labs.scale.com/leaderboard/tutorbench) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 55.65 \| source_score \| reported \| Higher is better \| ### Configuration Reasoning effort unknown Model configuration gemini-2.5-pro-preview-06-05 sourceModelVersion Not reported thinkingEnabled Not reported ### Reported statistics Uncertainty Confidence interval: 54.54–56.76 contaminationWarning Not reported rank 3 reportedConfidenceHalfWidth 1.11 ### Source [Original source](https://labs.scale.com/leaderboard/tutorbench) Source scale Original model label gemini-2.5-pro-preview-06-05 Observed 2026-10-21T16:35:39.395Z Evidence SHA-256 `3b52113d689cb5847cb39e84b957de8a2eab854c12eef25eedee4751268a6361` Source locator `/rows/2` | | | | | | | | [Longform Creative Writing](https://benchize.com/benchmarks/eq-bench%3Alongform-writing.md) | 53.6% | — | 66 / 93 | — | [eq bench · longform-writing](https://eqbench.com/creative_writing_longform.js) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `overall_score_100` \| 53.6 \| percent \| overall \| Higher is better \| \| `chapter1_avg` \| 12.62 \| rubric_score \| overall \| Higher is better \| \| `chapter2_avg` \| 11.83 \| rubric_score \| overall \| Higher is better \| \| `chapter3_avg` \| 12.03 \| rubric_score \| overall \| Higher is better \| \| `chapter4_avg` \| 11.64 \| rubric_score \| overall \| Higher is better \| \| `chapter5_avg` \| 11.48 \| rubric_score \| overall \| Higher is better \| \| `chapter6_avg` \| 11.16 \| rubric_score \| overall \| Higher is better \| \| `chapter7_avg` \| 10.82 \| rubric_score \| overall \| Higher is better \| \| `chapter8_avg` \| 10.57 \| rubric_score \| overall \| Higher is better \| \| `final_judgement_avg` \| 10.77 \| rubric_score \| overall \| Higher is better \| ### Configuration interactiveAdjustments none protocol longform-writing sourceModelVersion gemini-2.5-pro-preview-06-05 ### Source [Original source](https://eqbench.com/creative_writing_longform.js) Source eq bench Original model label gemini-2.5-pro-preview-06-05 Source version longform-writing Observed 2026-10-21T16:35:02.575Z Evidence SHA-256 `3ba283ce357ac7620e16db640a961879c30fe3ddc50a27de9a8ed4290784825c` Source locator `/leaderboardDataLongformV3/41` | | | | | | | | [GPQA Diamond](https://benchize.com/benchmarks/gpqa-diamond.md) | 84.85% | SE ±2.55 pp | 51 / 125 | — | [epoch ai · GPQA diamond](https://epoch.ai/data/benchmark_data.zip#file=gpqa_diamond.csv) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.8484848484848485 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.8484848484848485 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion GPQA diamond reasoningBudget Not reported Reasoning effort Not reported sourceModelVersion gemini-2.5-pro-preview-06-05 ### Reported statistics Uncertainty Standard error: ±2.55 pp standardError 0.02554565042660364 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=gpqa_diamond.csv) Source epoch ai Original model label gemini-2.5-pro-preview-06-05 Source version GPQA diamond Evaluated 2025-06-05T16:07:50.021Z Observed 2026-10-21T16:30:24.199Z Evidence SHA-256 `4b2dd8376cdd249a2c3065603575208fa726c15eabbb1622689a9abc146ba29a` Source locator `/rows/215` | | | | | | | | [VisualToolBench (VTB)](https://benchize.com/benchmarks/scale%3Avtb.md) | 11.75source score | CI 10.61–12.89 | 3 / 5 | — | [scale](https://labs.scale.com/leaderboard/vtb) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 11.75 \| source_score \| reported \| Higher is better \| ### Configuration Reasoning effort unknown Model configuration gemini-2.5-pro-preview-06-05 sourceModelVersion Not reported thinkingEnabled Not reported ### Reported statistics Uncertainty Confidence interval: 10.61–12.89 contaminationWarning Not reported rank 9 reportedConfidenceHalfWidth 1.14 ### Source [Original source](https://labs.scale.com/leaderboard/vtb) Source scale Original model label gemini-2.5-pro-preview-06-05 Observed 2026-10-21T16:35:36.362Z Evidence SHA-256 `70c39c91bb42d31fb0581b426c57134d54c74cc00ac658f5bd00694f52418c45` Source locator `/rows/8` | | | | | | | | [Remote Labor Index (RLI)](https://benchize.com/benchmarks/scale%3Arli.md) | 0.83source score | CI 0.83–0.83 | 4 / 4 | — | [scale](https://labs.scale.com/leaderboard/rli) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.83 \| source_score \| reported \| Higher is better \| ### Configuration Reasoning effort unknown Model configuration gemini-2.5-pro-preview-06-05 sourceModelVersion Not reported thinkingEnabled Not reported ### Reported statistics Uncertainty Confidence interval: 0.83–0.83 contaminationWarning Not reported rank 20 reportedConfidenceHalfWidth 0 ### Source [Original source](https://labs.scale.com/leaderboard/rli) Source scale Original model label gemini-2.5-pro-preview-06-05 Observed 2026-10-21T16:35:35.546Z Evidence SHA-256 `d08c60517bef10b77b75d2b765ba3f22d2457693fb4bdf28a6e5d89e7e2b50a8` Source locator `/rows/19` | | | | | | | | [FrontierMath (2025-02-28 private)](https://benchize.com/benchmarks/epoch-ai%3Afrontiermath.md) | 10.34% | SE ±1.79 pp | 12 / 18 | — | [epoch ai · FrontierMath-2025-02-28-Private](https://epoch.ai/data/benchmark_data.zip#file=frontiermath.csv) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.10344827586206896 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.10344827586206896 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion FrontierMath-2025-02-28-Private reasoningBudget Not reported Reasoning effort Not reported sourceModelVersion gemini-2.5-pro-preview-06-05 ### Reported statistics Uncertainty Standard error: ±1.79 pp standardError 0.01791432224407271 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=frontiermath.csv) Source epoch ai Original model label gemini-2.5-pro-preview-06-05 Source version FrontierMath-2025-02-28-Private Evaluated 2025-07-03T13:57:21.637Z Observed 2026-10-21T16:30:24.199Z Evidence SHA-256 `f5c92f0f0b9103abb02308fd428c0806e7c21b91e8a14d43edb8af77ce941598` Source locator `/rows/70` | | | | | | | | [Humanity's Last Exam (Text Only)](https://benchize.com/benchmarks/scale%3Ahumanitys_last_exam_text_only.md) | 22.06source score | CI 20.31–23.81 | 4 / 25 | — | [scale](https://labs.scale.com/leaderboard/humanitys_last_exam_text_only) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 22.06 \| source_score \| reported \| Higher is better \| ### Configuration Reasoning effort unknown Model configuration gemini-2.5-pro-preview-06-05 sourceModelVersion Not reported thinkingEnabled Not reported ### Reported statistics Uncertainty Confidence interval: 20.31–23.81 contaminationWarning Potential contamination warning: This model was evaluated after the public release of HLE, allowing model builder access to the prompts and solutions. Sampled at temperature 0.3. rank 17 reportedConfidenceHalfWidth 1.75 ### Source [Original source](https://labs.scale.com/leaderboard/humanitys_last_exam_text_only) Source scale Original model label gemini-2.5-pro-preview-06-05 Observed 2026-10-21T16:35:33.193Z Evidence SHA-256 `4004825ae58bdcc249c0d26dab811842c6d172b2a67bc35e69949fbf12ead757` Source locator `/rows/16` | | | | | | | | [Humanity’s Last Exam (HLE)](https://benchize.com/benchmarks/hle.md) | 21.64source score | CI 20.03–23.25 | 5 / 17 | — | [scale](https://labs.scale.com/leaderboard/humanitys_last_exam) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 21.64 \| source_score \| reported \| Higher is better \| ### Configuration Reasoning effort unknown Model configuration gemini-2.5-pro-preview-06-05 sourceModelVersion Not reported thinkingEnabled Not reported ### Reported statistics Uncertainty Confidence interval: 20.03–23.25 contaminationWarning Potential contamination warning: This model was evaluated after the public release of HLE, allowing model builder access to the prompts and solutions. rank 19 reportedConfidenceHalfWidth 1.61 ### Source [Original source](https://labs.scale.com/leaderboard/humanitys_last_exam) Source scale Original model label gemini-2.5-pro-preview-06-05 Observed 2026-10-21T16:35:32.694Z Evidence SHA-256 `9970bf9ee4f6b6b167633a94634adae7ac9c906447d6db087a8dc9877c1b71e0` Source locator `/rows/18` | | | | | | | | [FrontierMath Tier 4 (2025-07-01 private)](https://benchize.com/benchmarks/epoch-ai%3Afrontiermath_tier_4.md) | 2.08% | SE ±2.08 pp | 12 / 15 | — | [epoch ai · FrontierMath-Tier-4-2025-07-01-Private](https://epoch.ai/data/benchmark_data.zip#file=frontiermath_tier_4.csv) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.020833333333333332 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.020833333333333332 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion FrontierMath-Tier-4-2025-07-01-Private reasoningBudget Not reported Reasoning effort Not reported sourceModelVersion gemini-2.5-pro-preview-06-05 ### Reported statistics Uncertainty Standard error: ±2.08 pp standardError 0.020833333333333332 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=frontiermath_tier_4.csv) Source epoch ai Original model label gemini-2.5-pro-preview-06-05 Source version FrontierMath-Tier-4-2025-07-01-Private Evaluated 2025-07-03T13:56:46.043Z Observed 2026-10-21T16:30:24.199Z Evidence SHA-256 `c928e5adccd6e0995d50ede183fb99728d6c5be01951434a3077429ffb5802b2` Source locator `/rows/60` | | | | | | | --- Cite as: Gemini 2.5 Pro Preview 06-05 — Benchize, https://benchize.com/models/gemini-2-5-pro-preview (retrieved 2026-10-21)