# Claude Sonnet 4.6Non-thinking

> Source: Benchize (https://benchize.com) — https://benchize.com/models/claude-sonnet-4-6-off. When citing or reusing this content, credit "Benchize" and link to https://benchize.com/models/claude-sonnet-4-6-off.

Anthropic

Canonical URL: https://benchize.com/models/claude-sonnet-4-6-off
Last updated: Wed, 21 Oct 2026 18:05:10 GMT

Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations.

Anthropic

## Benchmarks

| Benchmark | Score | ± | Rank | Cost | Latency | Source |  |
| --- | --- | --- | --- | --- | --- | --- | --- |
| [Terminal-Bench 2.1 / easy](https://benchize.com/benchmarks/vals-ai%3Aterminal-bench-2-1%3Aeasy.md) | 100% | SE ±0 pp | 1 / 43 | $12.74 | 15,669source duration | [Vals AI · 2.1](https://www.vals.ai/_astro/benchmark_view_terminal_bench_2_1.CdyoObsA.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 100 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 12.735719 \| USD \| per_test \| Lower is better \| \| `latency` \| 15669.003 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort max harness Not reported maxOutputTokens 128000 provider Anthropic reasoning false Reasoning effort max Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0 pp sourcePopulation 76 stderr 0 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_terminal_bench_2_1.CdyoObsA.json) Source Vals AI Original model label anthropic/claude-sonnet-4-6 Source version 2.1 Observed 2026-10-21T16:46:13.216Z Evidence SHA-256 `a5306805cdf86495bdcceff6b2c8534a3768b9853f5077895dab975b809b054f` Source locator `/tasks/easy/anthropic~1claude-sonnet-4-6` |  |  |  |  |  |  |  |
| [Terminal-Bench 2.1 / hard](https://benchize.com/benchmarks/vals-ai%3Aterminal-bench-2-1%3Ahard.md) | 34.44% | SE ±2.94 pp | 31 / 43 | $1.7 | 2,089.2source duration | [Vals AI · 2.1](https://www.vals.ai/_astro/benchmark_view_terminal_bench_2_1.CdyoObsA.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 34.444 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 1.698096 \| USD \| per_test \| Lower is better \| \| `latency` \| 2089.2 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort max harness Not reported maxOutputTokens 128000 provider Anthropic reasoning false Reasoning effort max Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±2.94 pp sourcePopulation 76 stderr 2.94 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_terminal_bench_2_1.CdyoObsA.json) Source Vals AI Original model label anthropic/claude-sonnet-4-6 Source version 2.1 Observed 2026-10-21T16:46:13.216Z Evidence SHA-256 `a5306805cdf86495bdcceff6b2c8534a3768b9853f5077895dab975b809b054f` Source locator `/tasks/hard/anthropic~1claude-sonnet-4-6` |  |  |  |  |  |  |  |
| [Terminal-Bench 2.0 / hard](https://benchize.com/benchmarks/vals-ai%3Aterminal-bench-2%3Ahard.md) | 40% | SE ±9.1 pp | 8 / 23 | $1.54 | 1,825.98source duration | [Vals AI · 2.0](https://www.vals.ai/_astro/benchmark_view_terminal_bench_2.T48tPR4O.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 40 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 1.539598 \| USD \| per_test \| Lower is better \| \| `latency` \| 1825.982 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort max harness Not reported maxOutputTokens 128000 provider Anthropic reasoning false Reasoning effort max Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±9.1 pp sourcePopulation 67 stderr 9.097 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_terminal_bench_2.T48tPR4O.json) Source Vals AI Original model label anthropic/claude-sonnet-4-6 Source version 2.0 Observed 2026-10-21T16:46:14.732Z Evidence SHA-256 `38e640d995259778e531f048b2f2c7b3b281cb05b56be643ddc9dc53eb85adf7` Source locator `/tasks/hard/anthropic~1claude-sonnet-4-6` |  |  |  |  |  |  |  |
| [Terminal-Bench 2.0 / overall](https://benchize.com/benchmarks/vals-ai%3Aterminal-bench-2%3Aoverall.md) | 59.55% | SE ±5.23 pp | 7 / 23 | $0.52 | 615.5source duration | [Vals AI · 2.0](https://www.vals.ai/_astro/benchmark_view_terminal_bench_2.T48tPR4O.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 59.551 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.518966 \| USD \| per_test \| Lower is better \| \| `latency` \| 615.5 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort max harness Not reported maxOutputTokens 128000 provider Anthropic reasoning false Reasoning effort max Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±5.23 pp sourcePopulation 67 stderr 5.232 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_terminal_bench_2.T48tPR4O.json) Source Vals AI Original model label anthropic/claude-sonnet-4-6 Source version 2.0 Observed 2026-10-21T16:46:14.732Z Evidence SHA-256 `38e640d995259778e531f048b2f2c7b3b281cb05b56be643ddc9dc53eb85adf7` Source locator `/tasks/overall/anthropic~1claude-sonnet-4-6` |  |  |  |  |  |  |  |
| [BullshitBench v2](https://benchize.com/benchmarks/bullshitbench%3Av2.md) | 89% | — | 6 / 191 | — | — | [bullshitbench · v2](https://api.github.com/repos/petergpt/bullshit-benchmark/contents/data/v2/latest/leaderboard.csv?ref=3c655234d15967738f95da696e3f938d4862dcf7) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `green_rate` \| 0.89 \| score_fraction \| all_attempts \| Higher is better \| \| `red_rate` \| 0.02 \| score_fraction \| all_attempts \| Lower is better \| \| `refusal_rate` \| 0.0 \| score_fraction \| all_attempts \| Lower is better \| \| `avg_score` \| 1.86 \| score \| judge_grade_0_to_2 \| Higher is better \| ### Configuration Reasoning effort none suite v2 thinkingEnabled false ### Reported statistics acceptedCount 2 answeredCount 100 clearCount 89 errorCount 0 partialCount 9 rank 5 refusalCount 0 sampleSize 100 ### Source [Original source](https://api.github.com/repos/petergpt/bullshit-benchmark/contents/data/v2/latest/leaderboard.csv?ref=3c655234d15967738f95da696e3f938d4862dcf7) Source bullshitbench Original model label anthropic/claude-sonnet-4.6 Source version v2 Observed 2026-10-21T16:33:56.675Z Evidence SHA-256 `98b485e08764d1c97144bc4f7b28ced1a96d50850947c775870dfda0e5d749b5` Source locator `/rows/4` |  |  |  |  |  |  |  |
| [Terminal-Bench 2.1 / medium](https://benchize.com/benchmarks/vals-ai%3Aterminal-bench-2-1%3Amedium.md) | 66.67% | SE ±1.6 pp | 30 / 43 | $0.93 | 1,139.56source duration | [Vals AI · 2.1](https://www.vals.ai/_astro/benchmark_view_terminal_bench_2_1.CdyoObsA.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 66.667 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.926234 \| USD \| per_test \| Lower is better \| \| `latency` \| 1139.564 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort max harness Not reported maxOutputTokens 128000 provider Anthropic reasoning false Reasoning effort max Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.6 pp sourcePopulation 76 stderr 1.603 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_terminal_bench_2_1.CdyoObsA.json) Source Vals AI Original model label anthropic/claude-sonnet-4-6 Source version 2.1 Observed 2026-10-21T16:46:13.216Z Evidence SHA-256 `a5306805cdf86495bdcceff6b2c8534a3768b9853f5077895dab975b809b054f` Source locator `/tasks/medium/anthropic~1claude-sonnet-4-6` |  |  |  |  |  |  |  |
| [Terminal-Bench 2.0 / easy](https://benchize.com/benchmarks/vals-ai%3Aterminal-bench-2%3Aeasy.md) | 75% | SE ±25 pp | 9 / 23 | $11.55 | 13,694.87source duration | [Vals AI · 2.0](https://www.vals.ai/_astro/benchmark_view_terminal_bench_2.T48tPR4O.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 75 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 11.546985 \| USD \| per_test \| Lower is better \| \| `latency` \| 13694.866 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort max harness Not reported maxOutputTokens 128000 provider Anthropic reasoning false Reasoning effort max Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±25 pp sourcePopulation 67 stderr 25 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_terminal_bench_2.T48tPR4O.json) Source Vals AI Original model label anthropic/claude-sonnet-4-6 Source version 2.0 Observed 2026-10-21T16:46:14.732Z Evidence SHA-256 `38e640d995259778e531f048b2f2c7b3b281cb05b56be643ddc9dc53eb85adf7` Source locator `/tasks/easy/anthropic~1claude-sonnet-4-6` |  |  |  |  |  |  |  |
| [Vals Multimodal Index / terminal bench 2 1](https://benchize.com/benchmarks/vals-ai%3Avals_multimodal_index%3Aterminal_bench_2_1.md) | 57.3% | SE ±0.65 pp | 16 / 20 | $0.57 | 704.23source duration | [Vals AI · 1.2](https://www.vals.ai/_astro/benchmark_view_vals_multimodal_index.virVpWMs.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 57.303 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.572392 \| USD \| per_test \| Lower is better \| \| `latency` \| 704.225 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort max harness Not reported maxOutputTokens 128000 provider Anthropic reasoning false Reasoning effort max Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.65 pp sourcePopulation 33 stderr 0.649 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_vals_multimodal_index.virVpWMs.json) Source Vals AI Original model label anthropic/claude-sonnet-4-6 Source version 1.2 Observed 2026-10-21T16:45:51.881Z Evidence SHA-256 `077b22575f6e075b7b78157d000ec8f94d7ead409c7dcbcf04887630ed572a2d` Source locator `/tasks/terminal_bench_2_1/anthropic~1claude-sonnet-4-6` |  |  |  |  |  |  |  |
| [Terminal-Bench 2.0 / medium](https://benchize.com/benchmarks/vals-ai%3Aterminal-bench-2%3Amedium.md) | 69.09% | SE ±6.29 pp | 6 / 23 | $0.84 | 995.99source duration | [Vals AI · 2.0](https://www.vals.ai/_astro/benchmark_view_terminal_bench_2.T48tPR4O.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 69.091 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.839781 \| USD \| per_test \| Lower is better \| \| `latency` \| 995.99 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort max harness Not reported maxOutputTokens 128000 provider Anthropic reasoning false Reasoning effort max Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±6.29 pp sourcePopulation 67 stderr 6.289 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_terminal_bench_2.T48tPR4O.json) Source Vals AI Original model label anthropic/claude-sonnet-4-6 Source version 2.0 Observed 2026-10-21T16:46:14.732Z Evidence SHA-256 `38e640d995259778e531f048b2f2c7b3b281cb05b56be643ddc9dc53eb85adf7` Source locator `/tasks/medium/anthropic~1claude-sonnet-4-6` |  |  |  |  |  |  |  |
| [Terminal-Bench 2.1 / overall](https://benchize.com/benchmarks/vals-ai%3Aterminal-bench-2-1%3Aoverall.md) | 57.3% | SE ±0.65 pp | 29 / 43 | $0.57 | 704.23source duration | [Vals AI · 2.1](https://www.vals.ai/_astro/benchmark_view_terminal_bench_2_1.CdyoObsA.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 57.303 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.572392 \| USD \| per_test \| Lower is better \| \| `latency` \| 704.225 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort max harness Not reported maxOutputTokens 128000 provider Anthropic reasoning false Reasoning effort max Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.65 pp sourcePopulation 76 stderr 0.649 tokenTotals {"cache_read_tokens":49128739,"cache_write_tokens":3211949,"input_tokens":52390316,"output_tokens":1600704,"reasoning_tokens":0} ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_terminal_bench_2_1.CdyoObsA.json) Source Vals AI Original model label anthropic/claude-sonnet-4-6 Source version 2.1 Observed 2026-10-21T16:46:13.216Z Evidence SHA-256 `a5306805cdf86495bdcceff6b2c8534a3768b9853f5077895dab975b809b054f` Source locator `/tasks/overall/anthropic~1claude-sonnet-4-6` |  |  |  |  |  |  |  |

---
Cite as: Claude Sonnet 4.6Non-thinking — Benchize, https://benchize.com/models/claude-sonnet-4-6-off (retrieved 2026-10-21)