# Claude Opus 4.8Low > Source: Benchize (https://benchize.com) — https://benchize.com/models/claude-opus-4-8-low. When citing or reusing this content, credit "Benchize" and link to https://benchize.com/models/claude-opus-4-8-low. Anthropic Canonical URL: https://benchize.com/models/claude-opus-4-8-low Last updated: Thu, 22 Oct 2026 05:40:11 GMT Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations. Anthropic ## Benchmarks | Benchmark | Score | ± | Rank | Cost | Latency | Source | | | --- | --- | --- | --- | --- | --- | --- | --- | | [FrontierCode 1 main](https://benchize.com/benchmarks/frontiercode%3Av1%3Amain.md) | 25.28% | — | 12 / 39 | $2.68 | — | [frontiercode](https://cognition.com/data/frontiercode-leaderboard/data.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.2528 \| score_fraction \| blocking_criteria_adjusted \| Higher is better \| \| `correct` \| 0.2767 \| score_fraction \| raw_rubric \| Higher is better \| \| `cost` \| 2.6811 \| USD \| per_rollout \| Lower is better \| ### Configuration harness claude-code Reasoning effort low sourceVersion v1 subset main ### Reported statistics flaggedRate Not reported sampleSize 100 ### Source [Original source](https://cognition.com/data/frontiercode-leaderboard/data.json) Source frontiercode Original model label Claude Opus 4.8 Observed 2026-10-22T05:40:03.220Z Evidence SHA-256 `ff0040778b7bdf69c705ad7474f771fb5e53cfaf5cf8573b3a4614153543d75f` Source locator `/v1/data/Claude%20Opus%204.8/low/main` | | | | | | | | | [FrontierCode 1.1 extended](https://benchize.com/benchmarks/frontiercode%3Av1_1%3Aextended.md) | 50.83% | — | 86 / 125 | $2.27 | — | [frontiercode](https://cognition.com/data/frontiercode-leaderboard/data.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.5083 \| score_fraction \| blocking_criteria_adjusted \| Higher is better \| \| `correct` \| 0.5601 \| score_fraction \| raw_rubric \| Higher is better \| \| `cost` \| 2.2736 \| USD \| per_rollout \| Lower is better \| ### Configuration harness claude-code Reasoning effort low sourceVersion v1_1 subset extended ### Reported statistics flaggedRate 0.0013 sampleSize 150 ### Source [Original source](https://cognition.com/data/frontiercode-leaderboard/data.json) Source frontiercode Original model label Claude Opus 4.8 Observed 2026-10-22T05:40:03.220Z Evidence SHA-256 `ff0040778b7bdf69c705ad7474f771fb5e53cfaf5cf8573b3a4614153543d75f` Source locator `/v1_1/data/Claude%20Opus%204.8/low/extended` | | | | | | | | | [ARC-AGI-1](https://benchize.com/benchmarks/arc-prize%3Av1_Semi_Private.md) | 88% | — | 84 / 245 | 0.67usd per task | — | [arc prize · v1](https://arcprize.org/media/data/leaderboard/v1.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.88 \| score_fraction \| v1_Semi_Private \| Higher is better \| \| `cost_per_task` \| 0.6711 \| usd_per_task \| v1_Semi_Private \| Lower is better \| ### Configuration evaluationSplit v1_Semi_Private harness Not reported modelGroup anthropic-opus-4-8 modelType CoT Reasoning effort low sourceModelVersion anthropic-opus-4-8-low thinkingEnabled true ### Source [Original source](https://arcprize.org/media/data/leaderboard/v1.json) Source arc prize Original model label Claude Opus 4.8 (Low) Source version v1 Observed 2026-10-22T05:20:04.066Z Evidence SHA-256 `2bf68d22dafba37047d07ad833ebc0e8199c9aa2f9eeaed50c75c1b704462836` Source locator `/evaluations/117` | | | | | | | | | [OTIS Mock AIME 2024–2025](https://benchize.com/benchmarks/epoch-ai%3Aotis_mock_aime_2024_2025.md) | 97.78% | SE ±2.22 pp | 23 / 124 | — | — | [epoch ai · OTIS Mock AIME 2024-2025](https://epoch.ai/data/benchmark_data.zip#file=otis_mock_aime_2024_2025.csv) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.9777777777777777 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.9777777777777777 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion OTIS Mock AIME 2024-2025 reasoningBudget Not reported Reasoning effort low sourceModelVersion claude-opus-4-8_low ### Reported statistics Uncertainty Standard error: ±2.22 pp standardError 0.022222222222222223 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=otis_mock_aime_2024_2025.csv) Source epoch ai Original model label claude-opus-4-8 Source version OTIS Mock AIME 2024-2025 Evaluated 2026-08-06T22:20:24.000Z Observed 2026-10-22T03:00:05.281Z Evidence SHA-256 `b7c9da8c0587c82f1e0d814ceb496c24308380b997a16203b6e5d39eb07f4f50` Source locator `/rows/134` | | | | | | | | | [GPQA Diamond](https://benchize.com/benchmarks/gpqa-diamond.md) | 88.38% | SE ±2.28 pp | 37 / 126 | — | — | [epoch ai · GPQA diamond](https://epoch.ai/data/benchmark_data.zip#file=gpqa_diamond.csv) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.8838383838383839 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.8838383838383839 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion GPQA diamond reasoningBudget Not reported Reasoning effort low sourceModelVersion claude-opus-4-8_low ### Reported statistics Uncertainty Standard error: ±2.28 pp standardError 0.022828881775249357 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=gpqa_diamond.csv) Source epoch ai Original model label claude-opus-4-8 Source version GPQA diamond Evaluated 2026-08-06T22:19:23.000Z Observed 2026-10-22T03:00:05.281Z Evidence SHA-256 `9ef0b938bdd8406b029d595983ee8ad3a80bd9d64b82605b91b5ce39ba650c39` Source locator `/rows/126` | | | | | | | | | [FrontierCode 1 extended](https://benchize.com/benchmarks/frontiercode%3Av1%3Aextended.md) | 43.06% | — | 14 / 39 | $2.2 | — | [frontiercode](https://cognition.com/data/frontiercode-leaderboard/data.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.4306 \| score_fraction \| blocking_criteria_adjusted \| Higher is better \| \| `correct` \| 0.4678 \| score_fraction \| raw_rubric \| Higher is better \| \| `cost` \| 2.2 \| USD \| per_rollout \| Lower is better \| ### Configuration harness claude-code Reasoning effort low sourceVersion v1 subset extended ### Reported statistics flaggedRate Not reported sampleSize 150 ### Source [Original source](https://cognition.com/data/frontiercode-leaderboard/data.json) Source frontiercode Original model label Claude Opus 4.8 Observed 2026-10-22T05:40:03.220Z Evidence SHA-256 `ff0040778b7bdf69c705ad7474f771fb5e53cfaf5cf8573b3a4614153543d75f` Source locator `/v1/data/Claude%20Opus%204.8/low/extended` | | | | | | | | | [ARC-AGI-2](https://benchize.com/benchmarks/arc-prize%3Av2_Semi_Private.md) | 62.22% | — | 72 / 243 | 1.68usd per task | — | [arc prize · v2](https://arcprize.org/media/data/leaderboard/v2.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.6222 \| score_fraction \| v2_Semi_Private \| Higher is better \| \| `cost_per_task` \| 1.6818 \| usd_per_task \| v2_Semi_Private \| Lower is better \| ### Configuration evaluationSplit v2_Semi_Private harness Not reported modelGroup anthropic-opus-4-8 modelType CoT Reasoning effort low sourceModelVersion anthropic-opus-4-8-low thinkingEnabled true ### Source [Original source](https://arcprize.org/media/data/leaderboard/v2.json) Source arc prize Original model label Claude Opus 4.8 (Low) Source version v2 Observed 2026-10-22T05:20:04.306Z Evidence SHA-256 `4351eb696e78113b0459e9bb5f0258318b905efef34f473dcea51ce641b0d94d` Source locator `/evaluations/119` | | | | | | | | | [FrontierCode 1.1 main](https://benchize.com/benchmarks/frontiercode%3Av1_1%3Amain.md) | 35.14% | — | 91 / 125 | $2.68 | — | [frontiercode](https://cognition.com/data/frontiercode-leaderboard/data.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.3514 \| score_fraction \| blocking_criteria_adjusted \| Higher is better \| \| `correct` \| 0.3923 \| score_fraction \| raw_rubric \| Higher is better \| \| `cost` \| 2.6827 \| USD \| per_rollout \| Lower is better \| ### Configuration harness claude-code Reasoning effort low sourceVersion v1_1 subset main ### Reported statistics flaggedRate 0.001 sampleSize 100 ### Source [Original source](https://cognition.com/data/frontiercode-leaderboard/data.json) Source frontiercode Original model label Claude Opus 4.8 Observed 2026-10-22T05:40:03.220Z Evidence SHA-256 `ff0040778b7bdf69c705ad7474f771fb5e53cfaf5cf8573b3a4614153543d75f` Source locator `/v1_1/data/Claude%20Opus%204.8/low/main` | | | | | | | | | [Chess Puzzles](https://benchize.com/benchmarks/epoch-ai%3Achess_puzzles.md) | 29% | SE ±4.56 pp | 40 / 64 | — | — | [epoch ai · Chess Puzzles](https://epoch.ai/data/benchmark_data.zip#file=chess_puzzles.csv) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.29 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.29 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion Chess Puzzles reasoningBudget Not reported Reasoning effort low sourceModelVersion claude-opus-4-8_low ### Reported statistics Uncertainty Standard error: ±4.56 pp standardError 0.045604802157206865 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=chess_puzzles.csv) Source epoch ai Original model label claude-opus-4-8 Source version Chess Puzzles Evaluated 2026-10-13T13:35:16.000Z Observed 2026-10-22T03:00:05.281Z Evidence SHA-256 `a5b99d6d35252907b04e9a802873a9754ecc0248be92a1ebbd2ef0450e4bb015` Source locator `/rows/107` | | | | | | | | | [NC Bench](https://benchize.com/benchmarks/nc-bench%3Aoverall.md) | 91.89% | — | 40 / 144 | — | — | [nc bench](https://www.nc-bench.com/models) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 91.89 \| percent \| reported \| Higher is better \| \| `tooling` \| 99.48 \| percent \| category \| Higher is better \| \| `creative_writing` \| 85.86 \| percent \| category \| Higher is better \| \| `language` \| 96.31 \| percent \| category \| Higher is better \| \| `utility` \| 98 \| percent \| category \| Higher is better \| \| `reasoning` \| 88.83 \| percent \| category \| Higher is better \| \| `text_editing` \| 98.71 \| percent \| category \| Higher is better \| \| `rule_following` \| 70.56 \| percent \| category \| Higher is better \| \| `hallucination` \| 97.33 \| percent \| category \| Higher is better \| ### Configuration Reasoning effort low Model configuration Claude Opus 4.8 (Reasoning, Low) thinkingEnabled true ### Source [Original source](https://www.nc-bench.com/models) Source nc bench Original model label Claude Opus 4.8 (Reasoning, Low) Observed 2026-10-21T16:31:48.370Z Evidence SHA-256 `ec261022458543624b08a136d01f5a2f0666cd52ffb49c64d6ca983e8543d1b5` Source locator `/rows/50` | | | | | | | | | [AutomationBench](https://benchize.com/benchmarks/zapier%3Aautomationbench.md) | 13.55% | — | 55 / 113 | $1.2 | — | [zapier](https://framerusercontent.com/sites/4WTSl4BNjd1q9QFEFibC6h/lOvLnhItj8S8-1vyjH_s33Jn-WmUXPmiJ5Diajl0Q38.CMutaHYl.mjs) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 13.55 \| percent \| reported \| Higher is better \| \| `cost` \| 1.2 \| USD \| per_task \| Lower is better \| ### Configuration benchmarkVersion 1.0.6 costFootnote false Fallback policy Not reported Reasoning effort low Model configuration Claude Opus 4.8 (Low) thinkingEnabled true ### Reported statistics rank 60 ### Source [Original source](https://framerusercontent.com/sites/4WTSl4BNjd1q9QFEFibC6h/lOvLnhItj8S8-1vyjH_s33Jn-WmUXPmiJ5Diajl0Q38.CMutaHYl.mjs) Source zapier Original model label Claude Opus 4.8 (Low) Observed 2026-10-21T16:34:56.783Z Evidence SHA-256 `43978e38f018789fa59c11de5328abe9e5905bfa9a5a4d601fa3aa4d9c153b0d` Source locator `/rows/59` | | | | | | | | | [DeepSWE](https://benchize.com/benchmarks/deepswe%3Av1.1.md) | 40.8% | Range 39.33–42.26% | 58 / 70 | $2.29 | 651.83s | [deepswe](https://deepswe.datacurve.ai/artifacts/v1.1/leaderboard-live.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `pass_at_1` \| 0.4079822616407982 \| score_fraction \| scored_rollout_attempts \| Higher is better \| \| `pass_at_4` \| 0.6814159292035398 \| score_fraction \| tasks_with_one_passing_rollout \| Higher is better \| \| `cost_per_attempt` \| 2.293369216740577 \| USD \| scored_attempt \| Lower is better \| \| `duration` \| 651.8271712993347 \| seconds \| scored_attempt \| Lower is better \| ### Configuration harness mini-swe-agent Reasoning effort low sourceConfiguration mini_swe_agent_claude_opus_4_8_low ### Reported statistics Uncertainty Reported interval: 39.33–42.26% interval [0.3933464140551067,0.42261810922648974] intervalMethod 95% run-to-run: SE across repeated whole-benchmark passes (1.96 * std(runs)/sqrt(R)) runCount 4 sampleSize 451 taskCount 113 ### Source [Original source](https://deepswe.datacurve.ai/artifacts/v1.1/leaderboard-live.json) Source deepswe Original model label claude-opus-4-8 Observed 2026-10-22T03:50:05.889Z Evidence SHA-256 `a7c15d66288fd249c020b9931c017b92d1a3b90e480b3ff34974b752bd030019` Source locator `/rows/57` | | | | | | | | --- Cite as: Claude Opus 4.8Low — Benchize, https://benchize.com/models/claude-opus-4-8-low (retrieved 2026-10-22)