# Claude Opus 4.8Non-thinking

> Source: Benchize (https://benchize.com) — https://benchize.com/models/claude-opus-4-8-off. When citing or reusing this content, credit "Benchize" and link to https://benchize.com/models/claude-opus-4-8-off.

Anthropic

Canonical URL: https://benchize.com/models/claude-opus-4-8-off
Last updated: Thu, 22 Oct 2026 05:40:11 GMT

Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations.

Anthropic

## Benchmarks

| Benchmark | Score | ± | Rank | Source |  |
| --- | --- | --- | --- | --- | --- |
| [BullshitBench v2](https://benchize.com/benchmarks/bullshitbench%3Av2.md) | 95% | — | 1 / 191 | [bullshitbench · v2](https://api.github.com/repos/petergpt/bullshit-benchmark/contents/data/v2/latest/leaderboard.csv?ref=3c655234d15967738f95da696e3f938d4862dcf7) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `green_rate` \| 0.95 \| score_fraction \| all_attempts \| Higher is better \| \| `red_rate` \| 0.01 \| score_fraction \| all_attempts \| Lower is better \| \| `refusal_rate` \| 0.0 \| score_fraction \| all_attempts \| Lower is better \| \| `avg_score` \| 1.93 \| score \| judge_grade_0_to_2 \| Higher is better \| ### Configuration Reasoning effort none suite v2 thinkingEnabled false ### Reported statistics acceptedCount 1 answeredCount 100 clearCount 95 errorCount 0 partialCount 4 rank 1 refusalCount 0 sampleSize 100 ### Source [Original source](https://api.github.com/repos/petergpt/bullshit-benchmark/contents/data/v2/latest/leaderboard.csv?ref=3c655234d15967738f95da696e3f938d4862dcf7) Source bullshitbench Original model label anthropic/claude-opus-4.8 Source version v2 Observed 2026-10-22T03:10:12.603Z Evidence SHA-256 `98b485e08764d1c97144bc4f7b28ced1a96d50850947c775870dfda0e5d749b5` Source locator `/rows/0` |  |  |  |  |  |
| [Chess Puzzles](https://benchize.com/benchmarks/epoch-ai%3Achess_puzzles.md) | 19% | SE ±3.94 pp | 49 / 64 | [epoch ai · Chess Puzzles](https://epoch.ai/data/benchmark_data.zip#file=chess_puzzles.csv) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.19 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.19 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion Chess Puzzles reasoningBudget Not reported Reasoning effort none sourceModelVersion claude-opus-4-8_none ### Reported statistics Uncertainty Standard error: ±3.94 pp standardError 0.039427724440366255 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=chess_puzzles.csv) Source epoch ai Original model label claude-opus-4-8 Source version Chess Puzzles Evaluated 2026-10-13T13:34:59.000Z Observed 2026-10-22T03:00:05.281Z Evidence SHA-256 `a5b99d6d35252907b04e9a802873a9754ecc0248be92a1ebbd2ef0450e4bb015` Source locator `/rows/108` |  |  |  |  |  |
| [GPQA Diamond](https://benchize.com/benchmarks/gpqa-diamond.md) | 85.35% | SE ±2.52 pp | 50 / 126 | [epoch ai · GPQA diamond](https://epoch.ai/data/benchmark_data.zip#file=gpqa_diamond.csv) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.8535353535353535 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.8535353535353535 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion GPQA diamond reasoningBudget Not reported Reasoning effort none sourceModelVersion claude-opus-4-8_none ### Reported statistics Uncertainty Standard error: ±2.52 pp standardError 0.025190921114603887 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=gpqa_diamond.csv) Source epoch ai Original model label claude-opus-4-8 Source version GPQA diamond Evaluated 2026-08-06T22:19:27.000Z Observed 2026-10-22T03:00:05.281Z Evidence SHA-256 `9ef0b938bdd8406b029d595983ee8ad3a80bd9d64b82605b91b5ce39ba650c39` Source locator `/rows/125` |  |  |  |  |  |
| [OTIS Mock AIME 2024–2025](https://benchize.com/benchmarks/epoch-ai%3Aotis_mock_aime_2024_2025.md) | 84.44% | SE ±5.46 pp | 56 / 124 | [epoch ai · OTIS Mock AIME 2024-2025](https://epoch.ai/data/benchmark_data.zip#file=otis_mock_aime_2024_2025.csv) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.8444444444444444 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.8444444444444444 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion OTIS Mock AIME 2024-2025 reasoningBudget Not reported Reasoning effort none sourceModelVersion claude-opus-4-8_none ### Reported statistics Uncertainty Standard error: ±5.46 pp standardError 0.05463890236888291 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=otis_mock_aime_2024_2025.csv) Source epoch ai Original model label claude-opus-4-8 Source version OTIS Mock AIME 2024-2025 Evaluated 2026-08-06T22:21:06.000Z Observed 2026-10-22T03:00:05.281Z Evidence SHA-256 `b7c9da8c0587c82f1e0d814ceb496c24308380b997a16203b6e5d39eb07f4f50` Source locator `/rows/133` |  |  |  |  |  |

---
Cite as: Claude Opus 4.8Non-thinking — Benchize, https://benchize.com/models/claude-opus-4-8-off (retrieved 2026-10-22)
