# Claude Sonnet 4.6High > Source: Benchize (https://benchize.com) — https://benchize.com/models/claude-sonnet-4-6-high. When citing or reusing this content, credit "Benchize" and link to https://benchize.com/models/claude-sonnet-4-6-high. Anthropic Canonical URL: https://benchize.com/models/claude-sonnet-4-6-high Last updated: Thu, 22 Oct 2026 06:30:09 GMT Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations. Anthropic ## Benchmarks | Benchmark | Score | ± | Rank | Cost | Latency | Source | | | --- | --- | --- | --- | --- | --- | --- | --- | | [Chess Puzzles](https://benchize.com/benchmarks/epoch-ai%3Achess_puzzles.md) | 19% | SE ±3.94 pp | 49 / 64 | — | — | [epoch ai · Chess Puzzles](https://epoch.ai/data/benchmark_data.zip#file=chess_puzzles.csv) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.19 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.19 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion Chess Puzzles reasoningBudget Not reported Reasoning effort high sourceModelVersion claude-sonnet-4-6_high ### Reported statistics Uncertainty Standard error: ±3.94 pp standardError 0.039427724440366255 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=chess_puzzles.csv) Source epoch ai Original model label claude-sonnet-4-6 Source version Chess Puzzles Evaluated 2026-10-13T13:36:50.000Z Observed 2026-10-22T03:00:05.281Z Evidence SHA-256 `a5b99d6d35252907b04e9a802873a9754ecc0248be92a1ebbd2ef0450e4bb015` Source locator `/rows/101` | | | | | | | | | [ARC-AGI-1](https://benchize.com/benchmarks/arc-prize%3Av1_Semi_Private.md) | 86.5% | — | 97 / 245 | 1.19usd per task | — | [arc prize · v1](https://arcprize.org/media/data/leaderboard/v1.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.865 \| score_fraction \| v1_Semi_Private \| Higher is better \| \| `cost_per_task` \| 1.1908 \| usd_per_task \| v1_Semi_Private \| Lower is better \| ### Configuration evaluationSplit v1_Semi_Private harness Not reported modelGroup claude-sonnet-4-6 modelType CoT Reasoning effort high sourceModelVersion claude_sonnet_4_6_high thinkingEnabled true ### Source [Original source](https://arcprize.org/media/data/leaderboard/v1.json) Source arc prize Original model label Claude Sonnet 4.6 (High) Source version v1 Observed 2026-10-22T05:20:04.066Z Evidence SHA-256 `2bf68d22dafba37047d07ad833ebc0e8199c9aa2f9eeaed50c75c1b704462836` Source locator `/evaluations/123` | | | | | | | | | [SimpleQA Verified](https://benchize.com/benchmarks/epoch-ai%3Asimpleqa_verified.md) | 35.5% | SE ±1.51 pp | 30 / 40 | — | — | [epoch ai · SimpleQA Verified](https://epoch.ai/data/benchmark_data.zip#file=simpleqa_verified.csv) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.355 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.355 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion SimpleQA Verified reasoningBudget Not reported Reasoning effort high sourceModelVersion claude-sonnet-4-6_high ### Reported statistics Uncertainty Standard error: ±1.51 pp standardError 0.015139491543780595 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=simpleqa_verified.csv) Source epoch ai Original model label claude-sonnet-4-6 Source version SimpleQA Verified Evaluated 2026-08-10T22:42:23.000Z Observed 2026-10-22T03:00:05.281Z Evidence SHA-256 `e2d3fae377f0ddd3d079bcc3971b9b9388a0a950289effe7b521177ea2e988cc` Source locator `/rows/85` | | | | | | | | | [DeepSWE](https://benchize.com/benchmarks/deepswe%3Av1.1.md) | 29.93% | Range 25.84–34.03% | 65 / 70 | $5.52 | 2,815.01s | [deepswe](https://deepswe.datacurve.ai/artifacts/v1.1/leaderboard-live.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `pass_at_1` \| 0.29933481152993346 \| score_fraction \| scored_rollout_attempts \| Higher is better \| \| `pass_at_4` \| 0.5663716814159292 \| score_fraction \| tasks_with_one_passing_rollout \| Higher is better \| \| `cost_per_attempt` \| 5.5223517987804875 \| USD \| scored_attempt \| Lower is better \| \| `duration` \| 2815.01307943459 \| seconds \| scored_attempt \| Lower is better \| ### Configuration harness mini-swe-agent Reasoning effort high sourceConfiguration mini_swe_agent_claude_sonnet_4_6_high ### Reported statistics Uncertainty Reported interval: 25.84–34.03% interval [0.2584133988380421,0.34025622422182483] intervalMethod 95% run-to-run: SE across repeated whole-benchmark passes (1.96 * std(runs)/sqrt(R)) runCount 4 sampleSize 451 taskCount 113 ### Source [Original source](https://deepswe.datacurve.ai/artifacts/v1.1/leaderboard-live.json) Source deepswe Original model label claude-sonnet-4-6 Observed 2026-10-22T03:50:05.889Z Evidence SHA-256 `a7c15d66288fd249c020b9931c017b92d1a3b90e480b3ff34974b752bd030019` Source locator `/rows/64` | | | | | | | | | [GPQA Diamond](https://benchize.com/benchmarks/gpqa-diamond.md) | 83.33% | SE ±2.66 pp | 59 / 126 | — | — | [epoch ai · GPQA diamond](https://epoch.ai/data/benchmark_data.zip#file=gpqa_diamond.csv) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.8333333333333334 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.8333333333333334 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion GPQA diamond reasoningBudget Not reported Reasoning effort high sourceModelVersion claude-sonnet-4-6_high ### Reported statistics Uncertainty Standard error: ±2.66 pp standardError 0.026552207828215258 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=gpqa_diamond.csv) Source epoch ai Original model label claude-sonnet-4-6 Source version GPQA diamond Evaluated 2026-07-13T17:28:15.000Z Observed 2026-10-22T03:00:05.281Z Evidence SHA-256 `9ef0b938bdd8406b029d595983ee8ad3a80bd9d64b82605b91b5ce39ba650c39` Source locator `/rows/150` | | | | | | | | | [FrontierCode 1 main](https://benchize.com/benchmarks/frontiercode%3Av1%3Amain.md) | 15.07% | — | 26 / 39 | $2.41 | — | [frontiercode](https://cognition.com/data/frontiercode-leaderboard/data.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.1507 \| score_fraction \| blocking_criteria_adjusted \| Higher is better \| \| `correct` \| 0.1685 \| score_fraction \| raw_rubric \| Higher is better \| \| `cost` \| 2.4053 \| USD \| per_rollout \| Lower is better \| ### Configuration harness claude-code Reasoning effort high sourceVersion v1 subset main ### Reported statistics flaggedRate Not reported sampleSize 100 ### Source [Original source](https://cognition.com/data/frontiercode-leaderboard/data.json) Source frontiercode Original model label Claude Sonnet 4.6 Observed 2026-10-22T05:40:03.220Z Evidence SHA-256 `ff0040778b7bdf69c705ad7474f771fb5e53cfaf5cf8573b3a4614153543d75f` Source locator `/v1/data/Claude%20Sonnet%204.6/high/main` | | | | | | | | | [AutomationBench](https://benchize.com/benchmarks/zapier%3Aautomationbench.md) | 5.02% | — | 87 / 113 | $0.84 | — | [zapier](https://framerusercontent.com/sites/4WTSl4BNjd1q9QFEFibC6h/lOvLnhItj8S8-1vyjH_s33Jn-WmUXPmiJ5Diajl0Q38.CMutaHYl.mjs) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 5.02 \| percent \| reported \| Higher is better \| \| `cost` \| 0.84 \| USD \| per_task \| Lower is better \| ### Configuration benchmarkVersion 1.0.6 costFootnote false Fallback policy Not reported Reasoning effort high Model configuration Claude Sonnet 4.6 (High) thinkingEnabled true ### Reported statistics rank 98 ### Source [Original source](https://framerusercontent.com/sites/4WTSl4BNjd1q9QFEFibC6h/lOvLnhItj8S8-1vyjH_s33Jn-WmUXPmiJ5Diajl0Q38.CMutaHYl.mjs) Source zapier Original model label Claude Sonnet 4.6 (High) Observed 2026-10-21T16:34:56.783Z Evidence SHA-256 `43978e38f018789fa59c11de5328abe9e5905bfa9a5a4d601fa3aa4d9c153b0d` Source locator `/rows/97` | | | | | | | | | [FrontierCode 1.1 extended](https://benchize.com/benchmarks/frontiercode%3Av1_1%3Aextended.md) | 39.86% | — | 110 / 125 | $2.27 | — | [frontiercode](https://cognition.com/data/frontiercode-leaderboard/data.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.3986 \| score_fraction \| blocking_criteria_adjusted \| Higher is better \| \| `correct` \| 0.4412 \| score_fraction \| raw_rubric \| Higher is better \| \| `cost` \| 2.2694 \| USD \| per_rollout \| Lower is better \| ### Configuration harness claude-code Reasoning effort high sourceVersion v1_1 subset extended ### Reported statistics flaggedRate 0 sampleSize 150 ### Source [Original source](https://cognition.com/data/frontiercode-leaderboard/data.json) Source frontiercode Original model label Claude Sonnet 4.6 Observed 2026-10-22T05:40:03.220Z Evidence SHA-256 `ff0040778b7bdf69c705ad7474f771fb5e53cfaf5cf8573b3a4614153543d75f` Source locator `/v1_1/data/Claude%20Sonnet%204.6/high/extended` | | | | | | | | | [BullshitBench v2](https://benchize.com/benchmarks/bullshitbench%3Av2.md) | 91% | — | 4 / 191 | — | — | [bullshitbench · v2](https://api.github.com/repos/petergpt/bullshit-benchmark/contents/data/v2/latest/leaderboard.csv?ref=3c655234d15967738f95da696e3f938d4862dcf7) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `green_rate` \| 0.91 \| score_fraction \| all_attempts \| Higher is better \| \| `red_rate` \| 0.02 \| score_fraction \| all_attempts \| Lower is better \| \| `refusal_rate` \| 0.0 \| score_fraction \| all_attempts \| Lower is better \| \| `avg_score` \| 1.8717 \| score \| judge_grade_0_to_2 \| Higher is better \| ### Configuration Reasoning effort high suite v2 thinkingEnabled true ### Reported statistics acceptedCount 2 answeredCount 100 clearCount 91 errorCount 0 partialCount 7 rank 4 refusalCount 0 sampleSize 100 ### Source [Original source](https://api.github.com/repos/petergpt/bullshit-benchmark/contents/data/v2/latest/leaderboard.csv?ref=3c655234d15967738f95da696e3f938d4862dcf7) Source bullshitbench Original model label anthropic/claude-sonnet-4.6 Source version v2 Observed 2026-10-22T03:10:12.603Z Evidence SHA-256 `98b485e08764d1c97144bc4f7b28ced1a96d50850947c775870dfda0e5d749b5` Source locator `/rows/3` | | | | | | | | | [FrontierCode 1.1 main](https://benchize.com/benchmarks/frontiercode%3Av1_1%3Amain.md) | 23.47% | — | 113 / 125 | $2.7 | — | [frontiercode](https://cognition.com/data/frontiercode-leaderboard/data.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.2347 \| score_fraction \| blocking_criteria_adjusted \| Higher is better \| \| `correct` \| 0.265 \| score_fraction \| raw_rubric \| Higher is better \| \| `cost` \| 2.6993 \| USD \| per_rollout \| Lower is better \| ### Configuration harness claude-code Reasoning effort high sourceVersion v1_1 subset main ### Reported statistics flaggedRate 0 sampleSize 100 ### Source [Original source](https://cognition.com/data/frontiercode-leaderboard/data.json) Source frontiercode Original model label Claude Sonnet 4.6 Observed 2026-10-22T05:40:03.220Z Evidence SHA-256 `ff0040778b7bdf69c705ad7474f771fb5e53cfaf5cf8573b3a4614153543d75f` Source locator `/v1_1/data/Claude%20Sonnet%204.6/high/main` | | | | | | | | | [OTIS Mock AIME 2024–2025](https://benchize.com/benchmarks/epoch-ai%3Aotis_mock_aime_2024_2025.md) | 75.56% | SE ±6.48 pp | 68 / 124 | — | — | [epoch ai · OTIS Mock AIME 2024-2025](https://epoch.ai/data/benchmark_data.zip#file=otis_mock_aime_2024_2025.csv) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.7555555555555555 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.7555555555555555 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion OTIS Mock AIME 2024-2025 reasoningBudget Not reported Reasoning effort high sourceModelVersion claude-sonnet-4-6_high ### Reported statistics Uncertainty Standard error: ±6.48 pp standardError 0.06478835438717 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=otis_mock_aime_2024_2025.csv) Source epoch ai Original model label claude-sonnet-4-6 Source version OTIS Mock AIME 2024-2025 Evaluated 2026-07-13T17:28:15.000Z Observed 2026-10-22T03:00:05.281Z Evidence SHA-256 `b7c9da8c0587c82f1e0d814ceb496c24308380b997a16203b6e5d39eb07f4f50` Source locator `/rows/158` | | | | | | | | | [ToneBench Scriptwriting](https://benchize.com/benchmarks/tonebench%3Ascripts.md) | 1,529.8 | Range 1,485.8–1,572.6 | 76 / 126 | — | — | [tonebench](https://benchmark.towardsai.com/data/leaderboard.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 1529.8 \| rating \| reported \| Higher is better \| \| `overall` \| 75.99 \| percent \| reported \| Higher is better \| \| `anti_slop_numbers` \| 67.04 \| source_score \| rubric \| Higher is better \| \| `continuity_emotion` \| 75.25 \| source_score \| rubric \| Higher is better \| \| `cue_quality` \| 72.76 \| source_score \| rubric \| Higher is better \| \| `hook_strength` \| 75.32 \| source_score \| rubric \| Higher is better \| \| `length_adherence` \| 90.64 \| source_score \| rubric \| Higher is better \| \| `slop` \| 80.31 \| source_score \| rubric \| Higher is better \| \| `slop_score` \| 93.58 \| source_score \| rubric \| Higher is better \| \| `substance_accuracy` \| 78.16 \| source_score \| rubric \| Higher is better \| \| `tone_voice` \| 71.49 \| source_score \| rubric \| Higher is better \| \| `writing_quality` \| 73.69 \| source_score \| rubric \| Higher is better \| \| `youtube_best_practices` \| 73.85 \| source_score \| rubric \| Higher is better \| ### Configuration provider claude-code Reasoning effort unknown scoreScope 10_task_current sourceConfiguration claude-sonnet-4-6 thinkingEnabled true ### Reported statistics Uncertainty Reported interval: 1,485.8–1,572.6 interval [1485.8,1572.6] rank 77 runCount 5 ### Source [Original source](https://benchmark.towardsai.com/data/leaderboard.json) Source tonebench Original model label Claude Sonnet 4.6 (high) Evaluated 2026-10-10 Observed 2026-10-22T04:40:14.102Z Evidence SHA-256 `4264338337f418d3ded7ace250cad64fe12cacbd4b79a312bfaf0ae9268a01c3` Source locator `/rows/76` | | | | | | | | | [ARC-AGI-2](https://benchize.com/benchmarks/arc-prize%3Av2_Semi_Private.md) | 60.42% | — | 79 / 243 | 2.7usd per task | — | [arc prize · v2](https://arcprize.org/media/data/leaderboard/v2.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.6042 \| score_fraction \| v2_Semi_Private \| Higher is better \| \| `cost_per_task` \| 2.6966 \| usd_per_task \| v2_Semi_Private \| Lower is better \| ### Configuration evaluationSplit v2_Semi_Private harness Not reported modelGroup claude-sonnet-4-6 modelType CoT Reasoning effort high sourceModelVersion claude_sonnet_4_6_high thinkingEnabled true ### Source [Original source](https://arcprize.org/media/data/leaderboard/v2.json) Source arc prize Original model label Claude Sonnet 4.6 (High) Source version v2 Observed 2026-10-22T05:20:04.306Z Evidence SHA-256 `4351eb696e78113b0459e9bb5f0258318b905efef34f473dcea51ce641b0d94d` Source locator `/evaluations/124` | | | | | | | | | [FrontierCode 1 extended](https://benchize.com/benchmarks/frontiercode%3Av1%3Aextended.md) | 33.56% | — | 25 / 39 | $2.04 | — | [frontiercode](https://cognition.com/data/frontiercode-leaderboard/data.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.3356 \| score_fraction \| blocking_criteria_adjusted \| Higher is better \| \| `correct` \| 0.3683 \| score_fraction \| raw_rubric \| Higher is better \| \| `cost` \| 2.04 \| USD \| per_rollout \| Lower is better \| ### Configuration harness claude-code Reasoning effort high sourceVersion v1 subset extended ### Reported statistics flaggedRate Not reported sampleSize 150 ### Source [Original source](https://cognition.com/data/frontiercode-leaderboard/data.json) Source frontiercode Original model label Claude Sonnet 4.6 Observed 2026-10-22T05:40:03.220Z Evidence SHA-256 `ff0040778b7bdf69c705ad7474f771fb5e53cfaf5cf8573b3a4614153543d75f` Source locator `/v1/data/Claude%20Sonnet%204.6/high/extended` | | | | | | | | --- Cite as: Claude Sonnet 4.6High — Benchize, https://benchize.com/models/claude-sonnet-4-6-high (retrieved 2026-10-22)