# DeepSeek V4 Flash 0731Non-thinking

> Source: Benchize (https://benchize.com) — https://benchize.com/models/deepseek-v4-flash-0731-off. When citing or reusing this content, credit "Benchize" and link to https://benchize.com/models/deepseek-v4-flash-0731-off.

DeepSeek

Canonical URL: https://benchize.com/models/deepseek-v4-flash-0731-off
Last updated: Thu, 22 Oct 2026 05:40:11 GMT

Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations.

DeepSeek

## Benchmarks

| Benchmark | Score | ± | Rank | Cost | Latency | Source |  |
| --- | --- | --- | --- | --- | --- | --- | --- |
| [BullshitBench v2](https://benchize.com/benchmarks/bullshitbench%3Av2.md) | 20% | — | 133 / 191 | — | — | [bullshitbench · v2](https://api.github.com/repos/petergpt/bullshit-benchmark/contents/data/v2/latest/leaderboard.csv?ref=3c655234d15967738f95da696e3f938d4862dcf7) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `green_rate` \| 0.2 \| score_fraction \| all_attempts \| Higher is better \| \| `red_rate` \| 0.56 \| score_fraction \| all_attempts \| Lower is better \| \| `refusal_rate` \| 0.0 \| score_fraction \| all_attempts \| Lower is better \| \| `avg_score` \| 0.6617 \| score \| judge_grade_0_to_2 \| Higher is better \| ### Configuration Reasoning effort none suite v2 thinkingEnabled false ### Reported statistics acceptedCount 56 answeredCount 100 clearCount 20 errorCount 0 partialCount 24 rank 159 refusalCount 0 sampleSize 100 ### Source [Original source](https://api.github.com/repos/petergpt/bullshit-benchmark/contents/data/v2/latest/leaderboard.csv?ref=3c655234d15967738f95da696e3f938d4862dcf7) Source bullshitbench Original model label deepseek/deepseek-v4-flash-0731 Source version v2 Observed 2026-10-22T03:10:12.603Z Evidence SHA-256 `98b485e08764d1c97144bc4f7b28ced1a96d50850947c775870dfda0e5d749b5` Source locator `/rows/158` |  |  |  |  |  |  |  |
| [Terminal-Bench 2.1 / easy](https://benchize.com/benchmarks/vals-ai%3Aterminal-bench-2-1%3Aeasy.md) | 91.67% | SE ±8.33 pp | 15 / 43 | $0.47 | 15,197.41source duration | [Vals AI · 2.1](https://www.vals.ai/_astro/benchmark_view_terminal_bench_2_1.CdyoObsA.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 91.667 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.46877 \| USD \| per_test \| Lower is better \| \| `latency` \| 15197.407 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider DeepSeek reasoning false Reasoning effort unknown Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±8.33 pp sourcePopulation 76 stderr 8.333 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_terminal_bench_2_1.CdyoObsA.json) Source Vals AI Original model label deepseek/deepseek-v4-flash-0731 Source version 2.1 Observed 2026-10-22T02:10:27.811Z Evidence SHA-256 `a5306805cdf86495bdcceff6b2c8534a3768b9853f5077895dab975b809b054f` Source locator `/tasks/easy/deepseek~1deepseek-v4-flash-0731` |  |  |  |  |  |  |  |
| [Terminal-Bench 2.1 / medium](https://benchize.com/benchmarks/vals-ai%3Aterminal-bench-2-1%3Amedium.md) | 79.39% | SE ±1.6 pp | 17 / 43 | $0.03 | 1,105.27source duration | [Vals AI · 2.1](https://www.vals.ai/_astro/benchmark_view_terminal_bench_2_1.CdyoObsA.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 79.394 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.034092 \| USD \| per_test \| Lower is better \| \| `latency` \| 1105.266 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider DeepSeek reasoning false Reasoning effort unknown Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.6 pp sourcePopulation 76 stderr 1.603 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_terminal_bench_2_1.CdyoObsA.json) Source Vals AI Original model label deepseek/deepseek-v4-flash-0731 Source version 2.1 Observed 2026-10-22T02:10:27.811Z Evidence SHA-256 `a5306805cdf86495bdcceff6b2c8534a3768b9853f5077895dab975b809b054f` Source locator `/tasks/medium/deepseek~1deepseek-v4-flash-0731` |  |  |  |  |  |  |  |
| [Terminal-Bench 2.1 / hard](https://benchize.com/benchmarks/vals-ai%3Aterminal-bench-2-1%3Ahard.md) | 41.11% | SE ±2.22 pp | 26 / 43 | $0.06 | 2,026.32source duration | [Vals AI · 2.1](https://www.vals.ai/_astro/benchmark_view_terminal_bench_2_1.CdyoObsA.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 41.111 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.062503 \| USD \| per_test \| Lower is better \| \| `latency` \| 2026.321 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider DeepSeek reasoning false Reasoning effort unknown Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±2.22 pp sourcePopulation 76 stderr 2.222 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_terminal_bench_2_1.CdyoObsA.json) Source Vals AI Original model label deepseek/deepseek-v4-flash-0731 Source version 2.1 Observed 2026-10-22T02:10:27.811Z Evidence SHA-256 `a5306805cdf86495bdcceff6b2c8534a3768b9853f5077895dab975b809b054f` Source locator `/tasks/hard/deepseek~1deepseek-v4-flash-0731` |  |  |  |  |  |  |  |
| [ARC-AGI-1](https://benchize.com/benchmarks/arc-prize%3Av1_Semi_Private.md) | 11.83% | — | 227 / 245 | 0.00233usd per task | — | [arc prize · v1](https://arcprize.org/media/data/leaderboard/v1.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.11833333333333335 \| score_fraction \| v1_Semi_Private \| Higher is better \| \| `cost_per_task` \| 0.0023310715999999994 \| usd_per_task \| v1_Semi_Private \| Lower is better \| ### Configuration evaluationSplit v1_Semi_Private harness Not reported modelGroup deepseek-v4-flash-0731 modelType CoT sourceModelVersion deepseek-v4-flash-0731-none thinkingEnabled false ### Source [Original source](https://arcprize.org/media/data/leaderboard/v1.json) Source arc prize Original model label DeepSeek V4 Flash 0731 (None) Source version v1 Observed 2026-10-22T05:20:04.066Z Evidence SHA-256 `2bf68d22dafba37047d07ad833ebc0e8199c9aa2f9eeaed50c75c1b704462836` Source locator `/evaluations/193` |  |  |  |  |  |  |  |
| [ARC-AGI-2](https://benchize.com/benchmarks/arc-prize%3Av2_Semi_Private.md) | 2.08% | — | 191 / 243 | 0.00376usd per task | — | [arc prize · v2](https://arcprize.org/media/data/leaderboard/v2.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.020833333333333332 \| score_fraction \| v2_Semi_Private \| Higher is better \| \| `cost_per_task` \| 0.0037609368333333336 \| usd_per_task \| v2_Semi_Private \| Lower is better \| ### Configuration evaluationSplit v2_Semi_Private harness Not reported modelGroup deepseek-v4-flash-0731 modelType CoT sourceModelVersion deepseek-v4-flash-0731-none thinkingEnabled false ### Source [Original source](https://arcprize.org/media/data/leaderboard/v2.json) Source arc prize Original model label DeepSeek V4 Flash 0731 (None) Source version v2 Observed 2026-10-22T05:20:04.306Z Evidence SHA-256 `4351eb696e78113b0459e9bb5f0258318b905efef34f473dcea51ce641b0d94d` Source locator `/evaluations/194` |  |  |  |  |  |  |  |
| [Terminal-Bench 2.1 / overall](https://benchize.com/benchmarks/vals-ai%3Aterminal-bench-2-1%3Aoverall.md) | 67.04% | SE ±1.35 pp | 27 / 43 | $0.02 | 683.03source duration | [Vals AI · 2.1](https://www.vals.ai/_astro/benchmark_view_terminal_bench_2_1.CdyoObsA.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 67.041 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.021068 \| USD \| per_test \| Lower is better \| \| `latency` \| 683.03 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider DeepSeek reasoning false Reasoning effort unknown Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.35 pp sourcePopulation 76 stderr 1.35 tokenTotals {"cache_read_tokens":51580757,"cache_write_tokens":0,"input_tokens":54370624,"output_tokens":4785981,"reasoning_tokens":3945320} ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_terminal_bench_2_1.CdyoObsA.json) Source Vals AI Original model label deepseek/deepseek-v4-flash-0731 Source version 2.1 Observed 2026-10-22T02:10:27.811Z Evidence SHA-256 `a5306805cdf86495bdcceff6b2c8534a3768b9853f5077895dab975b809b054f` Source locator `/tasks/overall/deepseek~1deepseek-v4-flash-0731` |  |  |  |  |  |  |  |

---
Cite as: DeepSeek V4 Flash 0731Non-thinking — Benchize, https://benchize.com/models/deepseek-v4-flash-0731-off (retrieved 2026-10-22)