# Claude Opus 4.8Extra high

> Source: Benchize (https://benchize.com) — https://benchize.com/models/claude-opus-4-8-xhigh. When citing or reusing this content, credit "Benchize" and link to https://benchize.com/models/claude-opus-4-8-xhigh.

Anthropic

Canonical URL: https://benchize.com/models/claude-opus-4-8-xhigh
Last updated: Thu, 22 Oct 2026 09:10:07 GMT

Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations.

Anthropic

## Benchmarks

| Benchmark | Score | ± | Rank | Cost | Latency | Source |  |
| --- | --- | --- | --- | --- | --- | --- | --- |
| [FrontierCode 1.1 extended](https://benchize.com/benchmarks/frontiercode%3Av1_1%3Aextended.md) | 59.45% | — | 35 / 125 | $5.58 | — | [frontiercode](https://cognition.com/data/frontiercode-leaderboard/data.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.5945 \| score_fraction \| blocking_criteria_adjusted \| Higher is better \| \| `correct` \| 0.6504 \| score_fraction \| raw_rubric \| Higher is better \| \| `cost` \| 5.5793 \| USD \| per_rollout \| Lower is better \| ### Configuration harness claude-code Reasoning effort xhigh sourceVersion v1_1 subset extended ### Reported statistics flaggedRate 0.0033 sampleSize 150 ### Source [Original source](https://cognition.com/data/frontiercode-leaderboard/data.json) Source frontiercode Original model label Claude Opus 4.8 Observed 2026-10-22T05:40:03.220Z Evidence SHA-256 `ff0040778b7bdf69c705ad7474f771fb5e53cfaf5cf8573b3a4614153543d75f` Source locator `/v1_1/data/Claude%20Opus%204.8/xhigh/extended` |  |  |  |  |  |  |  |
| [BullshitBench v2](https://benchize.com/benchmarks/bullshitbench%3Av2.md) | 94% | — | 3 / 191 | — | — | [bullshitbench · v2](https://api.github.com/repos/petergpt/bullshit-benchmark/contents/data/v2/latest/leaderboard.csv?ref=3c655234d15967738f95da696e3f938d4862dcf7) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `green_rate` \| 0.94 \| score_fraction \| all_attempts \| Higher is better \| \| `red_rate` \| 0.01 \| score_fraction \| all_attempts \| Lower is better \| \| `refusal_rate` \| 0.0 \| score_fraction \| all_attempts \| Lower is better \| \| `avg_score` \| 1.9233 \| score \| judge_grade_0_to_2 \| Higher is better \| ### Configuration Reasoning effort xhigh suite v2 thinkingEnabled true ### Reported statistics acceptedCount 1 answeredCount 100 clearCount 94 errorCount 0 partialCount 5 rank 2 refusalCount 0 sampleSize 100 ### Source [Original source](https://api.github.com/repos/petergpt/bullshit-benchmark/contents/data/v2/latest/leaderboard.csv?ref=3c655234d15967738f95da696e3f938d4862dcf7) Source bullshitbench Original model label anthropic/claude-opus-4.8 Source version v2 Observed 2026-10-22T03:10:12.603Z Evidence SHA-256 `98b485e08764d1c97144bc4f7b28ced1a96d50850947c775870dfda0e5d749b5` Source locator `/rows/1` |  |  |  |  |  |  |  |
| [FrontierCode 1 extended](https://benchize.com/benchmarks/frontiercode%3Av1%3Aextended.md) | 51.79% | — | 6 / 39 | $5.41 | — | [frontiercode](https://cognition.com/data/frontiercode-leaderboard/data.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.5179 \| score_fraction \| blocking_criteria_adjusted \| Higher is better \| \| `correct` \| 0.5607 \| score_fraction \| raw_rubric \| Higher is better \| \| `cost` \| 5.405 \| USD \| per_rollout \| Lower is better \| ### Configuration harness claude-code Reasoning effort xhigh sourceVersion v1 subset extended ### Reported statistics flaggedRate Not reported sampleSize 150 ### Source [Original source](https://cognition.com/data/frontiercode-leaderboard/data.json) Source frontiercode Original model label Claude Opus 4.8 Observed 2026-10-22T05:40:03.220Z Evidence SHA-256 `ff0040778b7bdf69c705ad7474f771fb5e53cfaf5cf8573b3a4614153543d75f` Source locator `/v1/data/Claude%20Opus%204.8/xhigh/extended` |  |  |  |  |  |  |  |
| [AutomationBench](https://benchize.com/benchmarks/zapier%3Aautomationbench.md) | 16.89% | — | 46 / 113 | $1.91 | — | [zapier](https://framerusercontent.com/sites/4WTSl4BNjd1q9QFEFibC6h/MBpMAlj5k_Qpj1iTRcXO7kAjUP_VB-QuD3gMvxxThCQ.C6QAp2jN.mjs) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 16.89 \| percent \| reported \| Higher is better \| \| `cost` \| 1.91 \| USD \| per_task \| Lower is better \| ### Configuration benchmarkVersion 1.0.6 costFootnote false Fallback policy Not reported Reasoning effort xhigh Model configuration Claude Opus 4.8 (XHigh) thinkingEnabled true ### Reported statistics rank 48 ### Source [Original source](https://framerusercontent.com/sites/4WTSl4BNjd1q9QFEFibC6h/MBpMAlj5k_Qpj1iTRcXO7kAjUP_VB-QuD3gMvxxThCQ.C6QAp2jN.mjs) Source zapier Original model label Claude Opus 4.8 (XHigh) Observed 2026-10-22T08:20:03.209Z Evidence SHA-256 `6f5ef9e0d3799e2bac5ae924407ac89f608f18c17f3ef238887356808b094579` Source locator `/rows/47` |  |  |  |  |  |  |  |
| [DeepSWE](https://benchize.com/benchmarks/deepswe%3Av1.1.md) | 54.36% | Range 50.65–58.08% | 40 / 70 | $8.01 | 2,198.77s | [deepswe](https://deepswe.datacurve.ai/artifacts/v1.1/leaderboard-live.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `pass_at_1` \| 0.5436241610738255 \| score_fraction \| scored_rollout_attempts \| Higher is better \| \| `pass_at_4` \| 0.8053097345132744 \| score_fraction \| tasks_with_one_passing_rollout \| Higher is better \| \| `cost_per_attempt` \| 8.006355704138702 \| USD \| scored_attempt \| Lower is better \| \| `duration` \| 2198.774075261745 \| seconds \| scored_attempt \| Lower is better \| ### Configuration harness mini-swe-agent Reasoning effort xhigh sourceConfiguration mini_swe_agent_claude_opus_4_8_xhigh ### Reported statistics Uncertainty Reported interval: 50.65–58.08% interval [0.5064898547928808,0.5807584673547702] intervalMethod 95% run-to-run: SE across repeated whole-benchmark passes (1.96 * std(runs)/sqrt(R)) runCount 4 sampleSize 447 taskCount 113 ### Source [Original source](https://deepswe.datacurve.ai/artifacts/v1.1/leaderboard-live.json) Source deepswe Original model label claude-opus-4-8 Observed 2026-10-22T03:50:05.889Z Evidence SHA-256 `a7c15d66288fd249c020b9931c017b92d1a3b90e480b3ff34974b752bd030019` Source locator `/rows/39` |  |  |  |  |  |  |  |
| [Mystery Game Puzzles](https://benchize.com/benchmarks/epoch-ai%3Amystery_game_puzzles.md) | 31% | SE ±4.65 pp | 27 / 72 | — | — | [epoch ai · Mystery Game Puzzles](https://epoch.ai/data/benchmark_data.zip#file=mystery_game_puzzles.csv) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.31 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.31 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion Mystery Game Puzzles reasoningBudget Not reported Reasoning effort xhigh sourceModelVersion claude-opus-4-8_xhigh ### Reported statistics Uncertainty Standard error: ±4.65 pp standardError 0.04648231987117317 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=mystery_game_puzzles.csv) Source epoch ai Original model label claude-opus-4-8 Source version Mystery Game Puzzles Evaluated 2026-07-26T17:43:35.000Z Observed 2026-10-22T03:00:05.281Z Evidence SHA-256 `f66941ed5e9520190b66af57d2b6fd62a9582077dd25ab8764ce651bc0eca00a` Source locator `/rows/130` |  |  |  |  |  |  |  |
| [Short Story Writing — Pairwise Comparison](https://benchize.com/benchmarks/lechmazur-short-story%3Apairwise.md) | 0.76 | 95% CI 0.65–0.86 | 20 / 50 | — | — | [lechmazur short story · 8ba548d1cffefa5c472d3832e05f64e119a88fa4](https://api.github.com/repos/lechmazur/writing/contents/data/writing_gemini_argon_20261013/ratings.csv?ref=8ba548d1cffefa5c472d3832e05f64e119a88fa4) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `thurstone_rating` \| 0.7594311754943414 \| index \| pooled_observed_panel \| Higher is better \| \| `win_probability` \| 0.6130392888797267 \| score_fraction \| comparison_pool \| Higher is better \| ### Configuration benchmarkScope data/writing_gemini_argon_20261013 Reasoning effort xhigh thinkingEnabled true ### Reported statistics Uncertainty 95% confidence interval: 0.65–0.86 bootstrapSamples 300 confidenceInterval95 ["0.6493780646751726","0.8616691120467034"] sourceRank 20 ### Source [Original source](https://api.github.com/repos/lechmazur/writing/contents/data/writing_gemini_argon_20261013/ratings.csv?ref=8ba548d1cffefa5c472d3832e05f64e119a88fa4) Source lechmazur short story Original model label Claude Opus 4.8 (xhigh) Source version 8ba548d1cffefa5c472d3832e05f64e119a88fa4 Observed 2026-10-22T07:10:06.634Z Evidence SHA-256 `c36baebed9f302ff7ad8fe97907d72e1757a015a39b6a3b23437597cf8e3bff6` Source locator `/rows/19` |  |  |  |  |  |  |  |
| [FrontierCode 1 main](https://benchize.com/benchmarks/frontiercode%3Av1%3Amain.md) | 34.27% | — | 6 / 39 | $6.69 | — | [frontiercode](https://cognition.com/data/frontiercode-leaderboard/data.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.3427 \| score_fraction \| blocking_criteria_adjusted \| Higher is better \| \| `correct` \| 0.373 \| score_fraction \| raw_rubric \| Higher is better \| \| `cost` \| 6.6881 \| USD \| per_rollout \| Lower is better \| ### Configuration harness claude-code Reasoning effort xhigh sourceVersion v1 subset main ### Reported statistics flaggedRate Not reported sampleSize 100 ### Source [Original source](https://cognition.com/data/frontiercode-leaderboard/data.json) Source frontiercode Original model label Claude Opus 4.8 Observed 2026-10-22T05:40:03.220Z Evidence SHA-256 `ff0040778b7bdf69c705ad7474f771fb5e53cfaf5cf8573b3a4614153543d75f` Source locator `/v1/data/Claude%20Opus%204.8/xhigh/main` |  |  |  |  |  |  |  |
| [FrontierCode 1.1 main](https://benchize.com/benchmarks/frontiercode%3Av1_1%3Amain.md) | 45.49% | — | 46 / 125 | $6.78 | — | [frontiercode](https://cognition.com/data/frontiercode-leaderboard/data.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.4549 \| score_fraction \| blocking_criteria_adjusted \| Higher is better \| \| `correct` \| 0.5027 \| score_fraction \| raw_rubric \| Higher is better \| \| `cost` \| 6.7803 \| USD \| per_rollout \| Lower is better \| ### Configuration harness claude-code Reasoning effort xhigh sourceVersion v1_1 subset main ### Reported statistics flaggedRate 0.005 sampleSize 100 ### Source [Original source](https://cognition.com/data/frontiercode-leaderboard/data.json) Source frontiercode Original model label Claude Opus 4.8 Observed 2026-10-22T05:40:03.220Z Evidence SHA-256 `ff0040778b7bdf69c705ad7474f771fb5e53cfaf5cf8573b3a4614153543d75f` Source locator `/v1_1/data/Claude%20Opus%204.8/xhigh/main` |  |  |  |  |  |  |  |

---
Cite as: Claude Opus 4.8Extra high — Benchize, https://benchize.com/models/claude-opus-4-8-xhigh (retrieved 2026-10-22)