# Vals Index / vibe code bench > Source: Benchize (https://benchize.com) — https://benchize.com/benchmarks/vals-ai%3Avals_index%3Avibe_code_bench. When citing or reusing this content, credit "Benchize" and link to https://benchize.com/benchmarks/vals-ai%3Avals_index%3Avibe_code_bench. A single measure of AI's potential economic impact — agentic model performance across finance, coding, legal, and tax tasks, weighted by each sector's share of U.S. GDP. Canonical URL: https://benchize.com/benchmarks/vals-ai%3Avals_index%3Avibe_code_bench Last updated: Wed, 21 Oct 2026 18:52:20 GMT Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations. A single measure of AI's potential economic impact — agentic model performance across finance, coding, legal, and tax tasks, weighted by each sector's share of U.S. GDP. Composite indexes · Models tested: 14 · Score publishers: Vals AI ## Model results | # | Model | Score | ± | Cost | Latency | | | --- | --- | --- | --- | --- | --- | --- | | 1 | [Claude Sonnet 5.5](https://benchize.com/models/claude-sonnet-5-5-max.md)Max | 92.39% | SE ±1.26 pp | $31.25 | 3,672.11source duration | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 92.392 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 31.250578 \| USD \| per_test \| Lower is better \| \| `latency` \| 3672.106 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort max harness OpenHands maxOutputTokens 128000 provider Anthropic reasoning Not reported Reasoning effort max Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.26 pp sourcePopulation 23 stderr 1.26 tokenTotals {"cache_read_tokens":5760733058,"cache_write_tokens":62167153,"input_tokens":5822927217,"output_tokens":25491041,"reasoning_tokens":11893204} ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_vals_index.ye6C1wH2.json) Source Vals AI Original model label anthropic/claude-sonnet-5-5 Source version 2.2 Observed 2026-10-21T16:45:49.430Z Evidence SHA-256 `0e95aee94cd2bf34bc4b43a8f4bb16c7817de138613c21011873fea4e0786b45` Source locator `/tasks/vibe_code_bench/anthropic~1claude-sonnet-5-5` | | | | | | | | 2 | [Gemini 4 Argon](https://benchize.com/models/gemini-4-argon-high.md)High | 91.91% | SE ±1.9 pp | $8.11 | 2,247.68source duration | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 91.906 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 8.10797 \| USD \| per_test \| Lower is better \| \| `latency` \| 2247.675 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness OpenHands maxOutputTokens 262144 provider Google reasoning Not reported Reasoning effort high Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.9 pp sourcePopulation 23 stderr 1.899 tokenTotals {"cache_read_tokens":397575696,"cache_write_tokens":null,"input_tokens":451864686,"output_tokens":5436370,"reasoning_tokens":849287} ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_vals_index.ye6C1wH2.json) Source Vals AI Original model label google/gemini-4-argon Source version 2.2 Observed 2026-10-21T16:45:49.430Z Evidence SHA-256 `0e95aee94cd2bf34bc4b43a8f4bb16c7817de138613c21011873fea4e0786b45` Source locator `/tasks/vibe_code_bench/google~1gemini-4-argon` | | | | | | | | 3 | [Claude Haiku 5.5](https://benchize.com/models/claude-haiku-5-5-max.md)Max | 90.44% | SE ±1.73 pp | $6.07 | 2,075.72source duration | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 90.444 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 6.071856 \| USD \| per_test \| Lower is better \| \| `latency` \| 2075.723 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort max harness OpenHands maxOutputTokens 128000 provider Anthropic reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.73 pp sourcePopulation 23 stderr 1.725 tokenTotals {"cache_read_tokens":4559642564,"cache_write_tokens":40996929,"input_tokens":4600663825,"output_tokens":23863970,"reasoning_tokens":13235182} ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_vals_index.ye6C1wH2.json) Source Vals AI Original model label anthropic/claude-haiku-5-5 Source version 2.2 Observed 2026-10-21T16:45:49.430Z Evidence SHA-256 `0e95aee94cd2bf34bc4b43a8f4bb16c7817de138613c21011873fea4e0786b45` Source locator `/tasks/vibe_code_bench/anthropic~1claude-haiku-5-5` | | | | | | | | 4 | [Claude Opus 5.5](https://benchize.com/models/claude-opus-5-5-max.md)Max | 90.29% | SE ±1.53 pp | $57.92 | 5,766.52source duration | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 90.294 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 57.922811 \| USD \| per_test \| Lower is better \| \| `latency` \| 5766.524 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort max harness OpenHands maxOutputTokens 128000 provider Anthropic reasoning Not reported Reasoning effort max Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.53 pp sourcePopulation 23 stderr 1.526 tokenTotals {"cache_read_tokens":5539450465,"cache_write_tokens":57102136,"input_tokens":5596583425,"output_tokens":19722501,"reasoning_tokens":7457724} ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_vals_index.ye6C1wH2.json) Source Vals AI Original model label anthropic/claude-opus-5-5 Source version 2.2 Observed 2026-10-21T16:45:49.430Z Evidence SHA-256 `0e95aee94cd2bf34bc4b43a8f4bb16c7817de138613c21011873fea4e0786b45` Source locator `/tasks/vibe_code_bench/anthropic~1claude-opus-5-5` | | | | | | | | 5 | [GPT-6 Astra](https://benchize.com/models/gpt-6-astra-max.md)Max | 89.59% | SE ±2.17 pp | $38.51 | 2,344.13source duration | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 89.594 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 38.512323 \| USD \| per_test \| Lower is better \| \| `latency` \| 2344.127 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness OpenHands maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±2.17 pp sourcePopulation 23 stderr 2.174 tokenTotals {"cache_read_tokens":762745769,"cache_write_tokens":null,"input_tokens":813962842,"output_tokens":7672087,"reasoning_tokens":3013580} ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_vals_index.ye6C1wH2.json) Source Vals AI Original model label openai/gpt-6-astra Source version 2.2 Observed 2026-10-21T16:45:49.430Z Evidence SHA-256 `0e95aee94cd2bf34bc4b43a8f4bb16c7817de138613c21011873fea4e0786b45` Source locator `/tasks/vibe_code_bench/openai~1gpt-6-astra` | | | | | | | | 6 | [GPT-6.1 Sol](https://benchize.com/models/gpt-6-1-sol-max.md)Max | 88.93% | SE ±1.89 pp | $6.23 | 4,489.76source duration | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 88.931 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 6.234794 \| USD \| per_test \| Lower is better \| \| `latency` \| 4489.755 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness OpenHands maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.89 pp sourcePopulation 23 stderr 1.893 tokenTotals {"cache_read_tokens":1056860976,"cache_write_tokens":16623336,"input_tokens":1073502468,"output_tokens":10186788,"reasoning_tokens":5383848} ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_vals_index.ye6C1wH2.json) Source Vals AI Original model label openai/gpt-6.1-sol Source version 2.2 Observed 2026-10-21T16:45:49.430Z Evidence SHA-256 `0e95aee94cd2bf34bc4b43a8f4bb16c7817de138613c21011873fea4e0786b45` Source locator `/tasks/vibe_code_bench/openai~1gpt-6.1-sol` | | | | | | | | 7 | [DeepSeek V4.1 Flash 1017](https://benchize.com/models/deepseek-v4-1-flash-1017-max.md)Max | 87.73% | SE ±2.75 pp | $0.58 | 973.83source duration | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 87.73 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.579984 \| USD \| per_test \| Lower is better \| \| `latency` \| 973.834 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness OpenHands maxOutputTokens 384000 provider DeepSeek reasoning Not reported Reasoning effort max Temperature 1 topP 1 verbosity Not reported ### Reported statistics Uncertainty Standard error: ±2.75 pp sourcePopulation 23 stderr 2.752 tokenTotals {"cache_read_tokens":2156782720,"cache_write_tokens":null,"input_tokens":2173326299,"output_tokens":9246207,"reasoning_tokens":3107112} ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_vals_index.ye6C1wH2.json) Source Vals AI Original model label deepseek/deepseek-v4.1-flash-1017 Source version 2.2 Observed 2026-10-21T16:45:49.430Z Evidence SHA-256 `0e95aee94cd2bf34bc4b43a8f4bb16c7817de138613c21011873fea4e0786b45` Source locator `/tasks/vibe_code_bench/deepseek~1deepseek-v4.1-flash-1017` | | | | | | | | 8 | [MiMo-V2.6-Pro](https://benchize.com/models/mimo-v2-6-pro.md) | 85.22% | SE ±3.39 pp | $1.04 | 3,646.57source duration | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 85.223 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 1.043846 \| USD \| per_test \| Lower is better \| \| `latency` \| 3646.574 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness OpenHands maxOutputTokens 128000 provider Xiaomi reasoning Not reported Reasoning effort unknown Temperature 1 topP 0.95 verbosity Not reported ### Reported statistics Uncertainty Standard error: ±3.39 pp sourcePopulation 23 stderr 3.392 tokenTotals {"cache_read_tokens":979676672,"cache_write_tokens":null,"input_tokens":1076595168,"output_tokens":7478091,"reasoning_tokens":2852217} ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_vals_index.ye6C1wH2.json) Source Vals AI Original model label xiaomi/mimo-v2.6-pro Source version 2.2 Observed 2026-10-21T16:45:49.430Z Evidence SHA-256 `0e95aee94cd2bf34bc4b43a8f4bb16c7817de138613c21011873fea4e0786b45` Source locator `/tasks/vibe_code_bench/xiaomi~1mimo-v2.6-pro` | | | | | | | | 9 | [Muse Wonder](https://benchize.com/models/muse-wonder-max.md)Max | 83.09% | SE ±2.49 pp | $1.8 | 350.08source duration | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 83.089 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 1.802723 \| USD \| per_test \| Lower is better \| \| `latency` \| 350.076 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness OpenHands maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort max Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±2.49 pp sourcePopulation 23 stderr 2.49 tokenTotals {"cache_read_tokens":138037760,"cache_write_tokens":0,"input_tokens":144518172,"output_tokens":1830347,"reasoning_tokens":114242} ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_vals_index.ye6C1wH2.json) Source Vals AI Original model label meta/muse-wonder Source version 2.2 Observed 2026-10-21T16:45:49.430Z Evidence SHA-256 `0e95aee94cd2bf34bc4b43a8f4bb16c7817de138613c21011873fea4e0786b45` Source locator `/tasks/vibe_code_bench/meta~1muse-wonder` | | | | | | | | 10 | [DeepSeek V4 Pro 0813](https://benchize.com/models/deepseek-v4-pro-0813-max.md)Max | 82.3% | SE ±3.15 pp | $0.36 | 3,982.6source duration | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 82.297 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.356023 \| USD \| per_test \| Lower is better \| \| `latency` \| 3982.6 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness OpenHands maxOutputTokens 384000 provider DeepSeek reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±3.15 pp sourcePopulation 23 stderr 3.148 tokenTotals {"cache_read_tokens":1820296320,"cache_write_tokens":0,"input_tokens":1830028483,"output_tokens":7746431,"reasoning_tokens":2336919} ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_vals_index.ye6C1wH2.json) Source Vals AI Original model label deepseek/deepseek-v4-pro-0813 Source version 2.2 Observed 2026-10-21T16:45:49.430Z Evidence SHA-256 `0e95aee94cd2bf34bc4b43a8f4bb16c7817de138613c21011873fea4e0786b45` Source locator `/tasks/vibe_code_bench/deepseek~1deepseek-v4-pro-0813` | | | | | | | | 11 | [GPT-6 Luna](https://benchize.com/models/gpt-6-luna-max.md)Max | 81.65% | SE ±3.38 pp | $1.35 | 2,219.52source duration | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 81.649 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 1.345703 \| USD \| per_test \| Lower is better \| \| `latency` \| 2219.515 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness OpenHands maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±3.38 pp sourcePopulation 23 stderr 3.377 tokenTotals {"cache_read_tokens":3158117507,"cache_write_tokens":28566327,"input_tokens":3186713261,"output_tokens":9004550,"reasoning_tokens":3632878} ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_vals_index.ye6C1wH2.json) Source Vals AI Original model label openai/gpt-6-luna Source version 2.2 Observed 2026-10-21T16:45:49.430Z Evidence SHA-256 `0e95aee94cd2bf34bc4b43a8f4bb16c7817de138613c21011873fea4e0786b45` Source locator `/tasks/vibe_code_bench/openai~1gpt-6-luna` | | | | | | | | 12 | [MiMo-V2.6-Flash](https://benchize.com/models/mimo-v2-6-flash.md) | 78.96% | SE ±4.05 pp | $0.56 | 3,013.01source duration | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 78.96 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.563041 \| USD \| per_test \| Lower is better \| \| `latency` \| 3013.012 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness OpenHands maxOutputTokens 128000 provider Xiaomi reasoning Not reported Reasoning effort unknown Temperature 1 topP 0.95 verbosity Not reported ### Reported statistics Uncertainty Standard error: ±4.05 pp sourcePopulation 23 stderr 4.045 tokenTotals {"cache_read_tokens":1157695808,"cache_write_tokens":null,"input_tokens":1311689878,"output_tokens":7947370,"reasoning_tokens":3093850} ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_vals_index.ye6C1wH2.json) Source Vals AI Original model label xiaomi/mimo-v2.6-flash Source version 2.2 Observed 2026-10-21T16:45:49.430Z Evidence SHA-256 `0e95aee94cd2bf34bc4b43a8f4bb16c7817de138613c21011873fea4e0786b45` Source locator `/tasks/vibe_code_bench/xiaomi~1mimo-v2.6-flash` | | | | | | | | 13 | [Gemini 3.8 Flash](https://benchize.com/models/gemini-3-8-flash-high.md)High | 78.65% | SE ±3.88 pp | $6.87 | 519.1source duration | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 78.651 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 6.865141 \| USD \| per_test \| Lower is better \| \| `latency` \| 519.104 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness OpenHands maxOutputTokens 65536 provider Google reasoning Not reported Reasoning effort high Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±3.88 pp sourcePopulation 23 stderr 3.884 tokenTotals {"cache_read_tokens":1057116240,"cache_write_tokens":null,"input_tokens":1149521706,"output_tokens":6144190,"reasoning_tokens":1439332} ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_vals_index.ye6C1wH2.json) Source Vals AI Original model label google/gemini-3.8-flash Source version 2.2 Observed 2026-10-21T16:45:49.430Z Evidence SHA-256 `0e95aee94cd2bf34bc4b43a8f4bb16c7817de138613c21011873fea4e0786b45` Source locator `/tasks/vibe_code_bench/google~1gemini-3.8-flash` | | | | | | | | 14 | [MiniMax M3.1 Flash](https://benchize.com/models/minimax-m3-1-flash-max.md)Max | 73.94% | SE ±4.25 pp | $1.15 | 1,263.92source duration | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 73.944 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 1.146649 \| USD \| per_test \| Lower is better \| \| `latency` \| 1263.916 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort max harness OpenHands maxOutputTokens 262144 provider MiniMax reasoning Not reported Reasoning effort max Temperature 1 topP 0.95 verbosity Not reported ### Reported statistics Uncertainty Standard error: ±4.25 pp sourcePopulation 23 stderr 4.249 tokenTotals {"cache_read_tokens":3318290676,"cache_write_tokens":0,"input_tokens":3334725307,"output_tokens":8488142,"reasoning_tokens":2462335} ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_vals_index.ye6C1wH2.json) Source Vals AI Original model label minimax/MiniMax-M3.1-flash Source version 2.2 Observed 2026-10-21T16:45:49.430Z Evidence SHA-256 `0e95aee94cd2bf34bc4b43a8f4bb16c7817de138613c21011873fea4e0786b45` Source locator `/tasks/vibe_code_bench/minimax~1MiniMax-M3.1-flash` | | | | | | | --- Cite as: Vals Index / vibe code bench — Benchize, https://benchize.com/benchmarks/vals-ai%3Avals_index%3Avibe_code_bench (retrieved 2026-10-21)