# Vals Multimodal Index / finance agent > Source: Benchize (https://benchize.com) — https://benchize.com/benchmarks/vals-ai%3Avals_multimodal_index%3Afinance_agent. When citing or reusing this content, credit "Benchize" and link to https://benchize.com/benchmarks/vals-ai%3Avals_multimodal_index%3Afinance_agent. Benchmark consisting of a weighted performance across finance, coding, and education tasks. Showing the potential impact that LLM's can have on the economy. Canonical URL: https://benchize.com/benchmarks/vals-ai%3Avals_multimodal_index%3Afinance_agent Last updated: Wed, 21 Oct 2026 18:52:20 GMT Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations. Benchmark consisting of a weighted performance across finance, coding, and education tasks. Showing the potential impact that LLM's can have on the economy. Multimodal · Models tested: 20 · Score publishers: Vals AI ## Model results | # | Model | Score | ± | Cost | Latency | | | --- | --- | --- | --- | --- | --- | --- | | 1 | [Muse Spark 1.2](https://benchize.com/models/muse-spark-1-2.md) | 59.42% | SE ±1.47 pp | $0.73 | 304.04source duration | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 59.422 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.725022 \| USD \| per_test \| Lower is better \| \| `latency` \| 304.037 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens Not reported provider Meta reasoning Not reported Reasoning effort unknown Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.47 pp sourcePopulation 33 stderr 1.467 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_vals_multimodal_index.virVpWMs.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1.2 Observed 2026-10-21T16:45:51.881Z Evidence SHA-256 `077b22575f6e075b7b78157d000ec8f94d7ead409c7dcbcf04887630ed572a2d` Source locator `/tasks/finance_agent/meta~1muse_spark_1_2` | | | | | | | | 2 | [Gemini 3.5 Flash](https://benchize.com/models/gemini-3-5-flash-high.md)High | 58.1% | SE ±0.87 pp | $2.51 | 316.09source duration | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 58.101 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 2.505488 \| USD \| per_test \| Lower is better \| \| `latency` \| 316.094 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 65536 provider Google reasoning Not reported Reasoning effort high Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.87 pp sourcePopulation 33 stderr 0.874 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_vals_multimodal_index.virVpWMs.json) Source Vals AI Original model label google/gemini-3.5-flash Source version 1.2 Observed 2026-10-21T16:45:51.881Z Evidence SHA-256 `077b22575f6e075b7b78157d000ec8f94d7ead409c7dcbcf04887630ed572a2d` Source locator `/tasks/finance_agent/google~1gemini-3.5-flash` | | | | | | | | 3 | [Muse Spark 1.1](https://benchize.com/models/muse-spark-1-1-xhigh.md)Extra high | 57.11% | SE ±1.09 pp | $0.71 | 438.87source duration | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 57.109 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.71378 \| USD \| per_test \| Lower is better \| \| `latency` \| 438.872 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Meta reasoning Not reported Reasoning effort xhigh Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.09 pp sourcePopulation 33 stderr 1.089 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_vals_multimodal_index.virVpWMs.json) Source Vals AI Original model label meta/muse_spark_1_1 Source version 1.2 Observed 2026-10-21T16:45:51.881Z Evidence SHA-256 `077b22575f6e075b7b78157d000ec8f94d7ead409c7dcbcf04887630ed572a2d` Source locator `/tasks/finance_agent/meta~1muse_spark_1_1` | | | | | | | | 4 | [Claude Opus 5](https://benchize.com/models/claude-opus-5.md) | 56.57% | SE ±0.44 pp | $5.46 | 563.72source duration | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 56.57 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 5.463988 \| USD \| per_test \| Lower is better \| \| `latency` \| 563.724 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens Not reported provider Anthropic reasoning Not reported Reasoning effort unknown Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.44 pp sourcePopulation 33 stderr 0.443 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_vals_multimodal_index.virVpWMs.json) Source Vals AI Original model label anthropic/claude-opus-5 Source version 1.2 Observed 2026-10-21T16:45:51.881Z Evidence SHA-256 `077b22575f6e075b7b78157d000ec8f94d7ead409c7dcbcf04887630ed572a2d` Source locator `/tasks/finance_agent/anthropic~1claude-opus-5` | | | | | | | | 5 | [Claude Fable 5](https://benchize.com/models/claude-fable-5-max.md)Max | 56.35% | SE ±0.83 pp | $8.06 | 537.75source duration | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 56.349 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 8.061563 \| USD \| per_test \| Lower is better \| \| `latency` \| 537.752 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort max harness Not reported maxOutputTokens 128000 provider Anthropic reasoning Not reported Reasoning effort max Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.83 pp sourcePopulation 33 stderr 0.831 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_vals_multimodal_index.virVpWMs.json) Source Vals AI Original model label anthropic/claude-fable-5 Source version 1.2 Observed 2026-10-21T16:45:51.881Z Evidence SHA-256 `077b22575f6e075b7b78157d000ec8f94d7ead409c7dcbcf04887630ed572a2d` Source locator `/tasks/finance_agent/anthropic~1claude-fable-5` | | | | | | | | 6 | [GPT-5.6 Luna](https://benchize.com/models/gpt-5-6-luna-max.md)Max | 55.56% | SE ±0.34 pp | $0.24 | 659.44source duration | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 55.555 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.241264 \| USD \| per_test \| Lower is better \| \| `latency` \| 659.443 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.34 pp sourcePopulation 33 stderr 0.335 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_vals_multimodal_index.virVpWMs.json) Source Vals AI Original model label openai/gpt-5.6-luna Source version 1.2 Observed 2026-10-21T16:45:51.881Z Evidence SHA-256 `077b22575f6e075b7b78157d000ec8f94d7ead409c7dcbcf04887630ed572a2d` Source locator `/tasks/finance_agent/openai~1gpt-5.6-luna` | | | | | | | | 7 | [Gemini 3.6 Flash](https://benchize.com/models/gemini-3-6-flash-high.md)High | 55.3% | SE ±1.29 pp | $1.39 | 295.32source duration | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 55.302 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 1.393912 \| USD \| per_test \| Lower is better \| \| `latency` \| 295.319 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 65536 provider Google reasoning Not reported Reasoning effort high Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.29 pp sourcePopulation 33 stderr 1.29 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_vals_multimodal_index.virVpWMs.json) Source Vals AI Original model label google/gemini-3.6-flash Source version 1.2 Observed 2026-10-21T16:45:51.881Z Evidence SHA-256 `077b22575f6e075b7b78157d000ec8f94d7ead409c7dcbcf04887630ed572a2d` Source locator `/tasks/finance_agent/google~1gemini-3.6-flash` | | | | | | | | 8 | [GPT-5.6 Sol](https://benchize.com/models/gpt-5-6-sol-max.md)Max | 54.96% | SE ±0.44 pp | $1.18 | 1,104.08source duration | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 54.955 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 1.180225 \| USD \| per_test \| Lower is better \| \| `latency` \| 1104.076 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort max Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.44 pp sourcePopulation 33 stderr 0.439 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_vals_multimodal_index.virVpWMs.json) Source Vals AI Original model label openai/gpt-5.6-sol Source version 1.2 Observed 2026-10-21T16:45:51.881Z Evidence SHA-256 `077b22575f6e075b7b78157d000ec8f94d7ead409c7dcbcf04887630ed572a2d` Source locator `/tasks/finance_agent/openai~1gpt-5.6-sol` | | | | | | | | 9 | [Claude Opus 4.8](https://benchize.com/models/claude-opus-4-8-max.md)Max | 53.95% | SE ±1.76 pp | $4.22 | 522.68source duration | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 53.949 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 4.218538 \| USD \| per_test \| Lower is better \| \| `latency` \| 522.678 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort max harness Not reported maxOutputTokens 128000 provider Anthropic reasoning Not reported Reasoning effort max Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.76 pp sourcePopulation 33 stderr 1.764 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_vals_multimodal_index.virVpWMs.json) Source Vals AI Original model label anthropic/claude-opus-4-8 Source version 1.2 Observed 2026-10-21T16:45:51.881Z Evidence SHA-256 `077b22575f6e075b7b78157d000ec8f94d7ead409c7dcbcf04887630ed572a2d` Source locator `/tasks/finance_agent/anthropic~1claude-opus-4-8` | | | | | | | | 10 | [GPT-5.6 Terra](https://benchize.com/models/gpt-5-6-terra-xhigh.md)Extra high | 52.63% | SE ±0.54 pp | $0.24 | 388.5source duration | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 52.626 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.239646 \| USD \| per_test \| Lower is better \| \| `latency` \| 388.501 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort xhigh Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.54 pp sourcePopulation 33 stderr 0.537 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_vals_multimodal_index.virVpWMs.json) Source Vals AI Original model label openai/gpt-5.6-terra Source version 1.2 Observed 2026-10-21T16:45:51.881Z Evidence SHA-256 `077b22575f6e075b7b78157d000ec8f94d7ead409c7dcbcf04887630ed572a2d` Source locator `/tasks/finance_agent/openai~1gpt-5.6-terra` | | | | | | | | 11 | [Claude Sonnet 5](https://benchize.com/models/claude-sonnet-5-max.md)Max | 51.98% | SE ±0.53 pp | $4.02 | 867.39source duration | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 51.979 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 4.021924 \| USD \| per_test \| Lower is better \| \| `latency` \| 867.393 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort max harness Not reported maxOutputTokens 128000 provider Anthropic reasoning Not reported Reasoning effort max Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.53 pp sourcePopulation 33 stderr 0.534 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_vals_multimodal_index.virVpWMs.json) Source Vals AI Original model label anthropic/claude-sonnet-5 Source version 1.2 Observed 2026-10-21T16:45:51.881Z Evidence SHA-256 `077b22575f6e075b7b78157d000ec8f94d7ead409c7dcbcf04887630ed572a2d` Source locator `/tasks/finance_agent/anthropic~1claude-sonnet-5` | | | | | | | | 12 | [GPT-5.5](https://benchize.com/models/gpt-5-5-xhigh.md)Extra high | 51.83% | SE ±0.46 pp | $3.82 | 629.77source duration | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 51.834 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 3.82068 \| USD \| per_test \| Lower is better \| \| `latency` \| 629.768 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider OpenAI reasoning Not reported Reasoning effort xhigh Temperature Not reported topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.46 pp sourcePopulation 33 stderr 0.461 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_vals_multimodal_index.virVpWMs.json) Source Vals AI Original model label openai/gpt-5.5 Source version 1.2 Observed 2026-10-21T16:45:51.881Z Evidence SHA-256 `077b22575f6e075b7b78157d000ec8f94d7ead409c7dcbcf04887630ed572a2d` Source locator `/tasks/finance_agent/openai~1gpt-5.5` | | | | | | | | 13 | [Claude Opus 4.7](https://benchize.com/models/claude-opus-4-7-high.md)High | 51.45% | SE ±0.25 pp | $3.64 | 322.28source duration | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 51.45 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 3.638017 \| USD \| per_test \| Lower is better \| \| `latency` \| 322.275 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort high harness Not reported maxOutputTokens 128000 provider Anthropic reasoning Not reported Reasoning effort high Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.25 pp sourcePopulation 33 stderr 0.251 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_vals_multimodal_index.virVpWMs.json) Source Vals AI Original model label anthropic/claude-opus-4-7 Source version 1.2 Observed 2026-10-21T16:45:51.881Z Evidence SHA-256 `077b22575f6e075b7b78157d000ec8f94d7ead409c7dcbcf04887630ed572a2d` Source locator `/tasks/finance_agent/anthropic~1claude-opus-4-7` | | | | | | | | 14 | [Claude Sonnet 4.6](https://benchize.com/models/claude-sonnet-4-6-max.md)Max | 51.03% | SE ±1.08 pp | $2.28 | 629.1source duration | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 51.033 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 2.284299 \| USD \| per_test \| Lower is better \| \| `latency` \| 629.1 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort max harness Not reported maxOutputTokens 128000 provider Anthropic reasoning true Reasoning effort max Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.08 pp sourcePopulation 33 stderr 1.076 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_vals_multimodal_index.virVpWMs.json) Source Vals AI Original model label anthropic/claude-sonnet-4-6 Source version 1.2 Observed 2026-10-21T16:45:51.881Z Evidence SHA-256 `077b22575f6e075b7b78157d000ec8f94d7ead409c7dcbcf04887630ed572a2d` Source locator `/tasks/finance_agent/anthropic~1claude-sonnet-4-6` | | | | | | | | 15 | [MiniMax M3](https://benchize.com/models/minimax-m3.md) | 48.01% | SE ±1.42 pp | $0.29 | 502.94source duration | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 48.008 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.291233 \| USD \| per_test \| Lower is better \| \| `latency` \| 502.942 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 512000 provider MiniMax reasoning Not reported Reasoning effort unknown Temperature 1 topP 0.95 verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.42 pp sourcePopulation 33 stderr 1.421 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_vals_multimodal_index.virVpWMs.json) Source Vals AI Original model label minimax/MiniMax-M3 Source version 1.2 Observed 2026-10-21T16:45:51.881Z Evidence SHA-256 `077b22575f6e075b7b78157d000ec8f94d7ead409c7dcbcf04887630ed572a2d` Source locator `/tasks/finance_agent/minimax~1MiniMax-M3` | | | | | | | | 16 | [Gemini 3.1 Pro Preview](https://benchize.com/models/gemini-3-1-pro-preview-high.md)High | 42.97% | SE ±1.93 pp | $1.38 | 196.07source duration | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 42.968 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 1.378409 \| USD \| per_test \| Lower is better \| \| `latency` \| 196.068 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 65536 provider Google reasoning Not reported Reasoning effort high Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.93 pp sourcePopulation 33 stderr 1.931 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_vals_multimodal_index.virVpWMs.json) Source Vals AI Original model label google/gemini-3.1-pro-preview Source version 1.2 Observed 2026-10-21T16:45:51.881Z Evidence SHA-256 `077b22575f6e075b7b78157d000ec8f94d7ead409c7dcbcf04887630ed572a2d` Source locator `/tasks/finance_agent/google~1gemini-3.1-pro-preview` | | | | | | | | 17 | [Gemini 3 Flash Preview](https://benchize.com/models/gemini-3-flash-preview-high.md)High | 42.48% | SE ±0.67 pp | $0.54 | 241.61source duration | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 42.476 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.543671 \| USD \| per_test \| Lower is better \| \| `latency` \| 241.608 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 65536 provider Google reasoning Not reported Reasoning effort high Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.67 pp sourcePopulation 33 stderr 0.666 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_vals_multimodal_index.virVpWMs.json) Source Vals AI Original model label google/gemini-3-flash-preview Source version 1.2 Observed 2026-10-21T16:45:51.881Z Evidence SHA-256 `077b22575f6e075b7b78157d000ec8f94d7ead409c7dcbcf04887630ed572a2d` Source locator `/tasks/finance_agent/google~1gemini-3-flash-preview` | | | | | | | | 18 | [MiMo-V2.5](https://benchize.com/models/mimo-v2-5.md) | 37.61% | SE ±1.2 pp | $0.09 | 267.32source duration | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 37.61 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.088638 \| USD \| per_test \| Lower is better \| \| `latency` \| 267.315 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 128000 provider Xiaomi reasoning Not reported Reasoning effort unknown Temperature 1 topP 0.95 verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.2 pp sourcePopulation 33 stderr 1.198 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_vals_multimodal_index.virVpWMs.json) Source Vals AI Original model label xiaomi/mimo-v2.5 Source version 1.2 Observed 2026-10-21T16:45:51.881Z Evidence SHA-256 `077b22575f6e075b7b78157d000ec8f94d7ead409c7dcbcf04887630ed572a2d` Source locator `/tasks/finance_agent/xiaomi~1mimo-v2.5` | | | | | | | | 19 | [Mistral Medium 3.5](https://benchize.com/models/mistral-medium-3-5-high.md)High | 31.51% | SE ±2.39 pp | $1.74 | 661.92source duration | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 31.511 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 1.736097 \| USD \| per_test \| Lower is better \| \| `latency` \| 661.916 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 80000 provider Mistral AI reasoning Not reported Reasoning effort high Temperature 0.7 topP 0.95 verbosity Not reported ### Reported statistics Uncertainty Standard error: ±2.39 pp sourcePopulation 33 stderr 2.394 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_vals_multimodal_index.virVpWMs.json) Source Vals AI Original model label mistralai/mistral-medium-3.5 Source version 1.2 Observed 2026-10-21T16:45:51.881Z Evidence SHA-256 `077b22575f6e075b7b78157d000ec8f94d7ead409c7dcbcf04887630ed572a2d` Source locator `/tasks/finance_agent/mistralai~1mistral-medium-3.5` | | | | | | | | 20 | [Gemini 3.1 Flash Lite Preview](https://benchize.com/models/gemini-3-1-flash-lite-preview-high.md)High | 30.07% | SE ±0.73 pp | $0.13 | 53.58source duration | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 30.068 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.133469 \| USD \| per_test \| Lower is better \| \| `latency` \| 53.577 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 65536 provider Google reasoning Not reported Reasoning effort high Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.73 pp sourcePopulation 33 stderr 0.727 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_vals_multimodal_index.virVpWMs.json) Source Vals AI Original model label google/gemini-3.1-flash-lite-preview Source version 1.2 Observed 2026-10-21T16:45:51.881Z Evidence SHA-256 `077b22575f6e075b7b78157d000ec8f94d7ead409c7dcbcf04887630ed572a2d` Source locator `/tasks/finance_agent/google~1gemini-3.1-flash-lite-preview` | | | | | | | --- Cite as: Vals Multimodal Index / finance agent — Benchize, https://benchize.com/benchmarks/vals-ai%3Avals_multimodal_index%3Afinance_agent (retrieved 2026-10-21)