# Mistral Small 4High

> Source: Benchize (https://benchize.com) — https://benchize.com/models/mistral-small-2603-high. When citing or reusing this content, credit "Benchize" and link to https://benchize.com/models/mistral-small-2603-high.

Mistral AI

Canonical URL: https://benchize.com/models/mistral-small-2603-high
Last updated: Thu, 22 Oct 2026 05:30:58 GMT

Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations.

Mistral AI

## Benchmarks

| Benchmark | Score | ± | Rank | Cost | Latency | Source |  |
| --- | --- | --- | --- | --- | --- | --- | --- |
| [Terminal-Bench 2.0 / hard](https://benchize.com/benchmarks/vals-ai%3Aterminal-bench-2%3Ahard.md) | 3.33% | SE ±3.33 pp | 19 / 23 | $0.31 | 1,210source duration | [Vals AI · 2.0](https://www.vals.ai/_astro/benchmark_view_terminal_bench_2.T48tPR4O.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 3.333 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.313759 \| USD \| per_test \| Lower is better \| \| `latency` \| 1210 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort high Temperature 0.7 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±3.33 pp sourcePopulation 67 stderr 3.333 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_terminal_bench_2.T48tPR4O.json) Source Vals AI Original model label mistralai/mistral-small-2603 Source version 2.0 Observed 2026-10-22T02:10:29.313Z Evidence SHA-256 `38e640d995259778e531f048b2f2c7b3b281cb05b56be643ddc9dc53eb85adf7` Source locator `/tasks/hard/mistralai~1mistral-small-2603` |  |  |  |  |  |  |  |
| [Terminal-Bench 2.0 / overall](https://benchize.com/benchmarks/vals-ai%3Aterminal-bench-2%3Aoverall.md) | 16.85% | SE ±3.99 pp | 21 / 23 | $0.11 | 407.87source duration | [Vals AI · 2.0](https://www.vals.ai/_astro/benchmark_view_terminal_bench_2.T48tPR4O.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 16.854 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.105762 \| USD \| per_test \| Lower is better \| \| `latency` \| 407.865 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort high Temperature 0.7 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±3.99 pp sourcePopulation 67 stderr 3.991 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_terminal_bench_2.T48tPR4O.json) Source Vals AI Original model label mistralai/mistral-small-2603 Source version 2.0 Observed 2026-10-22T02:10:29.313Z Evidence SHA-256 `38e640d995259778e531f048b2f2c7b3b281cb05b56be643ddc9dc53eb85adf7` Source locator `/tasks/overall/mistralai~1mistral-small-2603` |  |  |  |  |  |  |  |
| [Terminal-Bench 2.0 / easy](https://benchize.com/benchmarks/vals-ai%3Aterminal-bench-2%3Aeasy.md) | 50% | SE ±28.87 pp | 17 / 23 | $2.35 | 9,075source duration | [Vals AI · 2.0](https://www.vals.ai/_astro/benchmark_view_terminal_bench_2.T48tPR4O.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 50 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 2.353195 \| USD \| per_test \| Lower is better \| \| `latency` \| 9074.999 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort high Temperature 0.7 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±28.87 pp sourcePopulation 67 stderr 28.868 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_terminal_bench_2.T48tPR4O.json) Source Vals AI Original model label mistralai/mistral-small-2603 Source version 2.0 Observed 2026-10-22T02:10:29.313Z Evidence SHA-256 `38e640d995259778e531f048b2f2c7b3b281cb05b56be643ddc9dc53eb85adf7` Source locator `/tasks/easy/mistralai~1mistral-small-2603` |  |  |  |  |  |  |  |
| [Vibe Code Bench v1.1 / overall](https://benchize.com/benchmarks/vals-ai%3Avibe-code%3Aoverall.md) | 0% | SE ±0 pp | 58 / 59 | $6.47 | 1,814.68source duration | [Vals AI · 1.1](https://www.vals.ai/_astro/benchmark_view_vibe_code_bench.DcEBMbCA.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 0 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 6.473001 \| USD \| per_test \| Lower is better \| \| `latency` \| 1814.681 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness OpenHands maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort high Temperature 0.7 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0 pp sourcePopulation 116 stderr 0 tokenTotals {"cache_read_tokens":null,"cache_write_tokens":null,"input_tokens":2145609935,"output_tokens":3014270,"reasoning_tokens":null} ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_vibe_code_bench.DcEBMbCA.json) Source Vals AI Original model label mistralai/mistral-small-2603 Source version 1.1 Observed 2026-10-22T02:10:23.531Z Evidence SHA-256 `0e8c23f521a0f751c5592952620e197b376cade41c78578461b7aa5740a173e7` Source locator `/tasks/overall/mistralai~1mistral-small-2603` |  |  |  |  |  |  |  |
| [BullshitBench v2](https://benchize.com/benchmarks/bullshitbench%3Av2.md) | 6% | — | 179 / 191 | — | — | [bullshitbench · v2](https://api.github.com/repos/petergpt/bullshit-benchmark/contents/data/v2/latest/leaderboard.csv?ref=3c655234d15967738f95da696e3f938d4862dcf7) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `green_rate` \| 0.06 \| score_fraction \| all_attempts \| Higher is better \| \| `red_rate` \| 0.7 \| score_fraction \| all_attempts \| Lower is better \| \| `refusal_rate` \| 0.0 \| score_fraction \| all_attempts \| Lower is better \| \| `avg_score` \| 0.3267 \| score \| judge_grade_0_to_2 \| Higher is better \| ### Configuration Reasoning effort high suite v2 thinkingEnabled true ### Reported statistics acceptedCount 70 answeredCount 100 clearCount 6 errorCount 0 partialCount 24 rank 216 refusalCount 0 sampleSize 100 ### Source [Original source](https://api.github.com/repos/petergpt/bullshit-benchmark/contents/data/v2/latest/leaderboard.csv?ref=3c655234d15967738f95da696e3f938d4862dcf7) Source bullshitbench Original model label mistralai/mistral-small-2603 Source version v2 Observed 2026-10-22T03:10:12.603Z Evidence SHA-256 `98b485e08764d1c97144bc4f7b28ced1a96d50850947c775870dfda0e5d749b5` Source locator `/rows/215` |  |  |  |  |  |  |  |
| [Terminal-Bench 2.0 / medium](https://benchize.com/benchmarks/vals-ai%3Aterminal-bench-2%3Amedium.md) | 21.82% | SE ±5.62 pp | 20 / 23 | $0.17 | 660source duration | [Vals AI · 2.0](https://www.vals.ai/_astro/benchmark_view_terminal_bench_2.T48tPR4O.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 21.818 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.171141 \| USD \| per_test \| Lower is better \| \| `latency` \| 660 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort high Temperature 0.7 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±5.62 pp sourcePopulation 67 stderr 5.62 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_terminal_bench_2.T48tPR4O.json) Source Vals AI Original model label mistralai/mistral-small-2603 Source version 2.0 Observed 2026-10-22T02:10:29.313Z Evidence SHA-256 `38e640d995259778e531f048b2f2c7b3b281cb05b56be643ddc9dc53eb85adf7` Source locator `/tasks/medium/mistralai~1mistral-small-2603` |  |  |  |  |  |  |  |

---
Cite as: Mistral Small 4High — Benchize, https://benchize.com/models/mistral-small-2603-high (retrieved 2026-10-22)