# GPT-4o (2024-11-20)

> Source: Benchize (https://benchize.com) — https://benchize.com/models/gpt-4o-2024-11-20. When citing or reusing this content, credit "Benchize" and link to https://benchize.com/models/gpt-4o-2024-11-20.

OpenAI

Canonical URL: https://benchize.com/models/gpt-4o-2024-11-20
Last updated: Wed, 21 Oct 2026 18:52:20 GMT

Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations.

OpenAI

## Benchmarks

| Benchmark | Score | ± | Rank | Source |  |
| --- | --- | --- | --- | --- | --- |
| [GPQA Diamond](https://benchize.com/benchmarks/gpqa-diamond.md) | 47.89% | SE ±2.63 pp | 110 / 125 | [epoch ai · GPQA diamond](https://epoch.ai/data/benchmark_data.zip#file=gpqa_diamond.csv) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.4788510101010101 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.4788510101010101 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion GPQA diamond reasoningBudget Not reported Reasoning effort Not reported sourceModelVersion gpt-4o-2024-11-20 ### Reported statistics Uncertainty Standard error: ±2.63 pp standardError 0.026336972178726107 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=gpqa_diamond.csv) Source epoch ai Original model label gpt-4o-2024-11-20 Source version GPQA diamond Evaluated 2025-02-05T08:31:15.914Z Observed 2026-10-21T16:30:24.199Z Evidence SHA-256 `4b2dd8376cdd249a2c3065603575208fa726c15eabbb1622689a9abc146ba29a` Source locator `/rows/261` |  |  |  |  |  |
| [PropensityBench](https://benchize.com/benchmarks/scale%3Apropensitybench.md) | 46.1source score | CI 45.7–46.5 | 5 / 5 | [scale](https://labs.scale.com/leaderboard/propensitybench) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 46.1 \| source_score \| reported \| Higher is better \| ### Configuration Reasoning effort unknown Model configuration gpt-4o-2024-11-20 sourceModelVersion Not reported thinkingEnabled Not reported ### Reported statistics Uncertainty Confidence interval: 45.7–46.5 contaminationWarning Not reported rank 7 reportedConfidenceHalfWidth 0.4 ### Source [Original source](https://labs.scale.com/leaderboard/propensitybench) Source scale Original model label gpt-4o-2024-11-20 Observed 2026-10-21T16:35:35.949Z Evidence SHA-256 `e65bbee55f6a735247cf59c5746c7850ce3413b5c0686e4c5b71a8cd641ec37f` Source locator `/rows/6` |  |  |  |  |  |
| [DiploBench exploratory games](https://benchize.com/benchmarks/eq-bench%3Adiplobench.md) | 0% | — | 4 / 6 | [eq bench · diplobench](https://eqbench.com/diplobench.js) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `win` \| 0 \| score_fraction \| single_game \| Higher is better \| ### Configuration country Austria experimental true opponent gemini-2-flash-001 outcome stalemate runNumber 1.56 runPrefix gpt-4o-2024-11-20 ### Reported statistics finalYear 31 ### Source [Original source](https://eqbench.com/diplobench.js) Source eq bench Original model label gpt-4o-2024-11-20 Source version diplobench Observed 2026-10-21T16:35:03.245Z Evidence SHA-256 `bb1ef1753d9db30c735e8c2d4a20d6e00b34c09cfb488291e065b5ce8f6822a1` Source locator `/leaderboardData/6/games/0` |  |  |  |  |  |
| [SVGBench Arena](https://benchize.com/benchmarks/svgbench%3Aarena.md) | 1,294 | — | 123 / 191 | [svgbench](https://svgbench.ai/api/leaderboard?shape=2) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1294 \| rating \| reported \| Higher is better \| ### Configuration Reasoning effort unknown sourceModelId model_openai_gpt_4o_2024_11_20 ### Reported statistics coverageCount 27 draws 0 judged 11 losses 10 rank 194 ratingDeviation 111 wins 1 ### Source [Original source](https://svgbench.ai/api/leaderboard?shape=2) Source svgbench Original model label GPT-4o (2024-11-20) Observed 2026-10-21T16:32:23.388Z Evidence SHA-256 `5c0a9c869593820d57d2c05f6d416e1b44a740b4835e66c66e9ad8b8edc59e2c` Source locator `/rows/184` |  |  |  |  |  |
| [Creative Writing v2](https://benchize.com/benchmarks/eq-bench%3Acreative-writing-v2.md) | 84.59% | CI 84.17–85.01% | 3 / 18 | [eq bench · creative-writing-v2](https://eqbench.com/creative_writing_v2.js) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 84.59 \| percent \| overall \| Higher is better \| ### Configuration interactiveAdjustments none protocol creative-writing-v2 sourceModelVersion gpt-4o-2024-11-20 ### Reported statistics Uncertainty Confidence interval: 84.17–85.01% confidenceIntervalHigh 85.01 confidenceIntervalLow 84.17 ### Source [Original source](https://eqbench.com/creative_writing_v2.js) Source eq bench Original model label gpt-4o-2024-11-20 Source version creative-writing-v2 Observed 2026-10-21T16:35:01.751Z Evidence SHA-256 `264c33d486559c25267ca29861754404dadb674022dcdf6530388cd9951af31a` Source locator `/leaderboardDataCreativeWriting/12` |  |  |  |  |  |
| [MATH Level 5](https://benchize.com/benchmarks/epoch-ai%3Amath_level_5.md) | 49.77% | SE ±1.11 pp | 16 / 21 | [epoch ai · MATH level 5](https://epoch.ai/data/benchmark_data.zip#file=math_level_5.csv) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.49773413897280966 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.49773413897280966 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion MATH level 5 reasoningBudget Not reported Reasoning effort Not reported sourceModelVersion gpt-4o-2024-11-20 ### Reported statistics Uncertainty Standard error: ±1.11 pp standardError 0.011102819618096572 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=math_level_5.csv) Source epoch ai Original model label gpt-4o-2024-11-20 Source version MATH level 5 Evaluated 2025-02-05T08:31:16.384Z Observed 2026-10-21T16:30:24.199Z Evidence SHA-256 `041b4bcb991a81d66152327113ef6d38e64cd8cce93d1e6ec821d1b9e47c1de3` Source locator `/rows/49` |  |  |  |  |  |
| [FrontierMath (2025-02-28 private)](https://benchize.com/benchmarks/epoch-ai%3Afrontiermath.md) | 0.34% | SE ±0.34 pp | 16 / 18 | [epoch ai · FrontierMath-2025-02-28-Private](https://epoch.ai/data/benchmark_data.zip#file=frontiermath.csv) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.0034482758620689655 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.0034482758620689655 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion FrontierMath-2025-02-28-Private reasoningBudget Not reported Reasoning effort Not reported sourceModelVersion gpt-4o-2024-11-20 ### Reported statistics Uncertainty Standard error: ±0.34 pp standardError 0.003448275862068965 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=frontiermath.csv) Source epoch ai Original model label gpt-4o-2024-11-20 Source version FrontierMath-2025-02-28-Private Evaluated 2025-03-06T18:03:58.731Z Observed 2026-10-21T16:30:24.199Z Evidence SHA-256 `f5c92f0f0b9103abb02308fd428c0806e7c21b91e8a14d43edb8af77ce941598` Source locator `/rows/99` |  |  |  |  |  |
| [SWE-bench Verified (Epoch AI)](https://benchize.com/benchmarks/epoch-ai%3Aswe_bench_verified.md) | 30.99% | SE ±2.1 pp | 10 / 10 | [epoch ai · SWE-Bench verified](https://epoch.ai/data/benchmark_data.zip#file=swe_bench_verified.csv) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.30991735537190085 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.30991735537190085 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion SWE-Bench verified reasoningBudget Not reported Reasoning effort Not reported sourceModelVersion gpt-4o-2024-11-20 ### Reported statistics Uncertainty Standard error: ±2.1 pp standardError 0.021042625979133336 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=swe_bench_verified.csv) Source epoch ai Original model label gpt-4o-2024-11-20 Source version SWE-Bench verified Evaluated 2026-02-11T15:05:15.089Z Observed 2026-10-21T16:30:24.199Z Evidence SHA-256 `6480176a5d9b1573676fcacc5df5e8c58f9e5fce34025600a19b3bf60617561c` Source locator `/rows/25` |  |  |  |  |  |
| [OTIS Mock AIME 2024–2025](https://benchize.com/benchmarks/epoch-ai%3Aotis_mock_aime_2024_2025.md) | 6.25% | SE ±2.42 pp | 118 / 123 | [epoch ai · OTIS Mock AIME 2024-2025](https://epoch.ai/data/benchmark_data.zip#file=otis_mock_aime_2024_2025.csv) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.0625 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.0625 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion OTIS Mock AIME 2024-2025 reasoningBudget Not reported Reasoning effort Not reported sourceModelVersion gpt-4o-2024-11-20 ### Reported statistics Uncertainty Standard error: ±2.42 pp standardError 0.024165360466267546 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=otis_mock_aime_2024_2025.csv) Source epoch ai Original model label gpt-4o-2024-11-20 Source version OTIS Mock AIME 2024-2025 Evaluated 2025-02-25T13:10:02.200Z Observed 2026-10-21T16:30:24.199Z Evidence SHA-256 `5b411612f91e155dff4b09d09b548b42f7936482ea8b3c00b510bd46e2f6bc2c` Source locator `/rows/300` |  |  |  |  |  |

---
Cite as: GPT-4o (2024-11-20) — Benchize, https://benchize.com/models/gpt-4o-2024-11-20 (retrieved 2026-10-21)