# Muse Spark 1.2Extra high > Source: Benchize (https://benchize.com) — https://benchize.com/models/muse-spark-1-2-xhigh. When citing or reusing this content, credit "Benchize" and link to https://benchize.com/models/muse-spark-1-2-xhigh. Meta Canonical URL: https://benchize.com/models/muse-spark-1-2-xhigh Last updated: Wed, 21 Oct 2026 18:52:20 GMT Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations. Meta ## Benchmarks | Benchmark | Score | ± | Rank | Cost | Latency | Source | | | --- | --- | --- | --- | --- | --- | --- | --- | | [EMB / lbo](https://benchize.com/benchmarks/vals-ai%3Aemb%3Albo.md) | 45.77% | SE ±5.59 pp | 35 / 47 | $2.42 | 1,213.26source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_emb.BY1LXsAw.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 45.765 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 2.418215 \| USD \| per_test \| Lower is better \| \| `latency` \| 1213.262 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±5.59 pp sourcePopulation 76 stderr 5.589 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_emb.BY1LXsAw.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:45:57.495Z Evidence SHA-256 `d807aee620ea47152a1fca0257a8dd12a1be4512c76cc1744c1ae9e285180918` Source locator `/tasks/lbo/meta~1muse_spark_1_2` | | | | | | | | | [Arena text / math](https://benchize.com/benchmarks/lmarena%3Atext%3Amath.md) | 1,483.57 | — | 26 / 149 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1483.5727249917109 \| rating \| reported \| Higher is better \| ### Configuration category math config text Reasoning effort xhigh thinkingEnabled true ### Reported statistics lower 1457.4770436623076 rank 30 upper 1509.6684063211142 variance 177.27238943113855 votes 484 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Muse Spark 1.2 (xHigh) Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/8942/row` | | | | | | | | | [BioMysteryBench / human solvable](https://benchize.com/benchmarks/vals-ai%3Abiomysterybench%3Ahuman_solvable.md) | 73.97% | SE ±1.37 pp | 14 / 20 | $0.89 | 1,417.29source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_biomysterybench.Bley-WAP.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 73.973 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.889936 \| USD \| per_test \| Lower is better \| \| `latency` \| 1417.288 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Terminus 2 maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.37 pp sourcePopulation 27 stderr 1.37 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_biomysterybench.Bley-WAP.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:46:04.029Z Evidence SHA-256 `59bf79d38ec415a34ffb1c2901a16ecbbe101b7fa864e86104d2571fc7cfc23d` Source locator `/tasks/human_solvable/meta~1muse_spark_1_2` | | | | | | | | | [Harvey's Legal Agent Benchmark v1 / white collar defense investigations](https://benchize.com/benchmarks/vals-ai%3Ahlab-v1%3Awhite_collar_defense_investigations.md) | 0% | SE ±0 pp | 1 / 49 | $1.58 | 1,278.39source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 0 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 1.579724 \| USD \| per_test \| Lower is better \| \| `latency` \| 1278.39 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0 pp sourcePopulation 81 stderr 0 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:45:53.909Z Evidence SHA-256 `65e7cd51e83066a42c9d782635dba5f2e9e1b189bd8118d3510cd17d2ddcba3f` Source locator `/tasks/white_collar_defense_investigations/meta~1muse_spark_1_2` | | | | | | | | | [Code Migration / cobol](https://benchize.com/benchmarks/vals-ai%3Acode-migration%3Acobol.md) | 68.57% | SE ±15.03 pp | 19 / 47 | $2.38 | 1,439.67source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_code_migration.Dttzoqk3.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 68.571 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 2.380724 \| USD \| per_test \| Lower is better \| \| `latency` \| 1439.67 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±15.03 pp sourcePopulation 79 stderr 15.028 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_code_migration.Dttzoqk3.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:46:12.712Z Evidence SHA-256 `99194597f2c76c402195be47839409046e18bd30454616da6dd40b736a088fa4` Source locator `/tasks/cobol/meta~1muse_spark_1_2` | | | | | | | | | [MMLU Pro / philosophy](https://benchize.com/benchmarks/vals-ai%3Ammlu_pro%3Aphilosophy.md) | 87.38% | SE ±1.49 pp | 12 / 40 | $0.00864 | 34.78source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 87.375 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.008642 \| USD \| per_test \| Lower is better \| \| `latency` \| 34.78 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.49 pp sourcePopulation 138 stderr 1.487 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:46:06.503Z Evidence SHA-256 `dab025507f46c716dd8d145e90ec0a737d9c56219853f41e4b1cc3c5e8c222b4` Source locator `/tasks/philosophy/meta~1muse_spark_1_2` | | | | | | | | | [CorpFin v2 / overall](https://benchize.com/benchmarks/vals-ai%3Acorp_fin_v2%3Aoverall.md) | 70.94% | SE ±0.89 pp | 4 / 39 | $0.11 | 30.05source duration | [Vals AI · 2](https://www.vals.ai/_astro/benchmark_view_corp_fin_v2.CectKwl1.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 70.94 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.108223 \| USD \| per_test \| Lower is better \| \| `latency` \| 30.047 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.89 pp sourcePopulation 134 stderr 0.892 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_corp_fin_v2.CectKwl1.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 2 Observed 2026-10-21T16:45:57.998Z Evidence SHA-256 `7cf2217ab3728d5a84bffce82aab9fc52d7f810b0cbe8c65b387df47f3d31c9b` Source locator `/tasks/overall/meta~1muse_spark_1_2` | | | | | | | | | [SWE-bench / <15 min fix](https://benchize.com/benchmarks/vals-ai%3Aswebench%3A%3C15%20min%20fix.md) | 92.27% | SE ±1.92 pp | 8 / 39 | $0.4 | 350.73source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_swebench.Ae8ni7h0.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 92.268 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.397223 \| USD \| per_test \| Lower is better \| \| `latency` \| 350.726 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.92 pp sourcePopulation 88 stderr 1.923 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_swebench.Ae8ni7h0.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:46:13.711Z Evidence SHA-256 `7a4e2e8485283caac500127419f68ec4bd5414c837ade114fc6afa5b2d34ccaa` Source locator `/tasks/<15 min fix/meta~1muse_spark_1_2` | | | | | | | | | [Harvey's Legal Agent Benchmark v1 / intellectual property](https://benchize.com/benchmarks/vals-ai%3Ahlab-v1%3Aintellectual_property.md) | 0% | SE ±0 pp | 6 / 49 | $2.1 | 1,515.53source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 0 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 2.100924 \| USD \| per_test \| Lower is better \| \| `latency` \| 1515.528 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0 pp sourcePopulation 81 stderr 0 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:45:53.909Z Evidence SHA-256 `65e7cd51e83066a42c9d782635dba5f2e9e1b189bd8118d3510cd17d2ddcba3f` Source locator `/tasks/intellectual_property/meta~1muse_spark_1_2` | | | | | | | | | [Harvey's Legal Agent Benchmark v1 / bankruptcy restructuring](https://benchize.com/benchmarks/vals-ai%3Ahlab-v1%3Abankruptcy_restructuring.md) | 0% | SE ±0 pp | 3 / 49 | $1.98 | 1,146.54source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 0 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 1.980681 \| USD \| per_test \| Lower is better \| \| `latency` \| 1146.54 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0 pp sourcePopulation 81 stderr 0 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:45:53.909Z Evidence SHA-256 `65e7cd51e83066a42c9d782635dba5f2e9e1b189bd8118d3510cd17d2ddcba3f` Source locator `/tasks/bankruptcy_restructuring/meta~1muse_spark_1_2` | | | | | | | | | [Tax Agent Bench / controversy precedence analysis](https://benchize.com/benchmarks/vals-ai%3Atax_agent_bench%3Acontroversy_precedence_analysis.md) | 7% | SE ±3.9 pp | 22 / 46 | $0.3 | 142.43source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_tax_agent_bench.BFpexnpS.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 7 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.301074 \| USD \| per_test \| Lower is better \| \| `latency` \| 142.434 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±3.9 pp sourcePopulation 73 stderr 3.9 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_tax_agent_bench.BFpexnpS.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:45:55.958Z Evidence SHA-256 `446db182b67efb7923b3187a4040ec3a3ea492b8ad699a2b6d708d714cc063ac` Source locator `/tasks/controversy_precedence_analysis/meta~1muse_spark_1_2` | | | | | | | | | [Legal Research Bench / weighted pass civil litigation](https://benchize.com/benchmarks/vals-ai%3Alegal_research%3Aweighted_pass__civil_litigation.md) | 87.42% | SE ±3.57 pp | 24 / 50 | $0.6 | 304.1source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_research.DiuL0R8P.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 87.42 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.602276 \| USD \| per_test \| Lower is better \| \| `latency` \| 304.101 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±3.57 pp sourcePopulation 82 stderr 3.571 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_research.DiuL0R8P.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:45:52.389Z Evidence SHA-256 `26c58dfd47d0d2dc86f33c6d056f30309e0ee63570e7cd752c593b385f9d862e` Source locator `/tasks/weighted_pass__civil_litigation/meta~1muse_spark_1_2` | | | | | | | | | [Arena text / industry software and it services](https://benchize.com/benchmarks/lmarena%3Atext%3Aindustry_software_and_it_services.md) | 1,505.28 | — | 15 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1505.2790980163354 \| rating \| reported \| Higher is better \| ### Configuration category industry_software_and_it_services config text Reasoning effort xhigh thinkingEnabled true ### Reported statistics lower 1495.007995684281 rank 15 upper 1515.5502003483898 variance 27.46236470041641 votes 3594 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Muse Spark 1.2 (xHigh) Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/6715/row` | | | | | | | | | [TaxEval v2 / overall](https://benchize.com/benchmarks/vals-ai%3Atax_eval_v2%3Aoverall.md) | 80.38% | SE ±0.76 pp | 1 / 40 | $0.01 | 48.31source duration | [Vals AI · 2](https://www.vals.ai/_astro/benchmark_view_tax_eval_v2.B3yoffr8.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 80.376 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.014199 \| USD \| per_test \| Lower is better \| \| `latency` \| 48.313 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.76 pp sourcePopulation 145 stderr 0.763 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_tax_eval_v2.B3yoffr8.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 2 Observed 2026-10-21T16:45:59.000Z Evidence SHA-256 `8b354a6ae848f5bb25a2e8b061b5f576d5b9e0c11b941dc1e6bed078e6529cd6` Source locator `/tasks/overall/meta~1muse_spark_1_2` | | | | | | | | | [Arena text / industry business and management and financial operations](https://benchize.com/benchmarks/lmarena%3Atext%3Aindustry_business_and_management_and_financial_operations.md) | 1,484.43 | — | 10 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1484.4251835217108 \| rating \| reported \| Higher is better \| ### Configuration category industry_business_and_management_and_financial_operations config text Reasoning effort xhigh thinkingEnabled true ### Reported statistics lower 1469.8702299555432 rank 10 upper 1498.9801370878781 variance 55.14745392351009 votes 1717 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Muse Spark 1.2 (xHigh) Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/4292/row` | | | | | | | | | [Arena text / expert](https://benchize.com/benchmarks/lmarena%3Atext%3Aexpert.md) | 1,475.2 | — | 44 / 148 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1475.2018833459156 \| rating \| reported \| Higher is better \| ### Configuration category expert config text Reasoning effort xhigh thinkingEnabled true ### Reported statistics lower 1456.8468153548417 rank 57 upper 1493.5569513369894 variance 87.70327541766179 votes 1014 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Muse Spark 1.2 (xHigh) Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/2527/row` | | | | | | | | | [Harvey's Legal Agent Benchmark v1 / capital markets](https://benchize.com/benchmarks/vals-ai%3Ahlab-v1%3Acapital_markets.md) | 60% | SE ±24.5 pp | 1 / 49 | $1.77 | 960.29source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 60 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 1.766404 \| USD \| per_test \| Lower is better \| \| `latency` \| 960.29 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±24.5 pp sourcePopulation 81 stderr 24.495 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:45:53.909Z Evidence SHA-256 `65e7cd51e83066a42c9d782635dba5f2e9e1b189bd8118d3510cd17d2ddcba3f` Source locator `/tasks/capital_markets/meta~1muse_spark_1_2` | | | | | | | | | [MMLU Pro / law](https://benchize.com/benchmarks/vals-ai%3Ammlu_pro%3Alaw.md) | 76.66% | SE ±1.28 pp | 16 / 40 | $0.01 | 63.77source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 76.658 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.014682 \| USD \| per_test \| Lower is better \| \| `latency` \| 63.765 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.28 pp sourcePopulation 138 stderr 1.28 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:46:06.503Z Evidence SHA-256 `dab025507f46c716dd8d145e90ec0a737d9c56219853f41e4b1cc3c5e8c222b4` Source locator `/tasks/law/meta~1muse_spark_1_2` | | | | | | | | | [TaxEval v2 / correctness](https://benchize.com/benchmarks/vals-ai%3Atax_eval_v2%3Acorrectness.md) | 68.03% | SE ±1.33 pp | 1 / 40 | $0.01 | 48.31source duration | [Vals AI · 2](https://www.vals.ai/_astro/benchmark_view_tax_eval_v2.B3yoffr8.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 68.029 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.014199 \| USD \| per_test \| Lower is better \| \| `latency` \| 48.313 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.33 pp sourcePopulation 145 stderr 1.334 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_tax_eval_v2.B3yoffr8.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 2 Observed 2026-10-21T16:45:59.000Z Evidence SHA-256 `8b354a6ae848f5bb25a2e8b061b5f576d5b9e0c11b941dc1e6bed078e6529cd6` Source locator `/tasks/correctness/meta~1muse_spark_1_2` | | | | | | | | | [Tax Agent Bench / overall](https://benchize.com/benchmarks/vals-ai%3Atax_agent_bench%3Aoverall.md) | 32.8% | SE ±2.75 pp | 10 / 46 | $0.27 | 119.91source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_tax_agent_bench.BFpexnpS.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 32.798 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.269212 \| USD \| per_test \| Lower is better \| \| `latency` \| 119.905 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±2.75 pp sourcePopulation 73 stderr 2.751 tokenTotals {"cache_read_tokens":63070995,"cache_write_tokens":0,"input_tokens":84100295,"output_tokens":3814259,"reasoning_tokens":1704398} ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_tax_agent_bench.BFpexnpS.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:45:55.958Z Evidence SHA-256 `446db182b67efb7923b3187a4040ec3a3ea492b8ad699a2b6d708d714cc063ac` Source locator `/tasks/overall/meta~1muse_spark_1_2` | | | | | | | | | [Harvey's Legal Agent Benchmark v1 / criteria pass rate employment labor](https://benchize.com/benchmarks/vals-ai%3Ahlab-v1%3Acriteria_pass_rate__employment_labor.md) | 89.51% | SE ±1.88 pp | 1 / 49 | $1.71 | 1,039.99source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 89.513 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 1.705269 \| USD \| per_test \| Lower is better \| \| `latency` \| 1039.986 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.88 pp sourcePopulation 81 stderr 1.879 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:45:53.909Z Evidence SHA-256 `65e7cd51e83066a42c9d782635dba5f2e9e1b189bd8118d3510cd17d2ddcba3f` Source locator `/tasks/criteria_pass_rate__employment_labor/meta~1muse_spark_1_2` | | | | | | | | | [Arena text / coding](https://benchize.com/benchmarks/lmarena%3Atext%3Acoding.md) | 1,505.16 | — | 16 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1505.1624253005014 \| rating \| reported \| Higher is better \| ### Configuration category coding config text Reasoning effort xhigh thinkingEnabled true ### Reported statistics lower 1492.9101785496305 rank 18 upper 1517.4146720513722 variance 39.07826621374527 votes 2474 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Muse Spark 1.2 (xHigh) Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/827/row` | | | | | | | | | [Legal Research Bench / family](https://benchize.com/benchmarks/vals-ai%3Alegal_research%3Afamily.md) | 27.27% | SE ±9.72 pp | 8 / 50 | $0.45 | 328.14source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_research.DiuL0R8P.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 27.273 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.452803 \| USD \| per_test \| Lower is better \| \| `latency` \| 328.141 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±9.72 pp sourcePopulation 82 stderr 9.719 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_research.DiuL0R8P.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:45:52.389Z Evidence SHA-256 `26c58dfd47d0d2dc86f33c6d056f30309e0ee63570e7cd752c593b385f9d862e` Source locator `/tasks/family/meta~1muse_spark_1_2` | | | | | | | | | [Legal Research Bench / weighted pass family](https://benchize.com/benchmarks/vals-ai%3Alegal_research%3Aweighted_pass__family.md) | 74.47% | SE ±5.02 pp | 20 / 50 | $0.45 | 328.14source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_research.DiuL0R8P.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 74.466 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.452803 \| USD \| per_test \| Lower is better \| \| `latency` \| 328.141 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±5.02 pp sourcePopulation 82 stderr 5.024 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_research.DiuL0R8P.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:45:52.389Z Evidence SHA-256 `26c58dfd47d0d2dc86f33c6d056f30309e0ee63570e7cd752c593b385f9d862e` Source locator `/tasks/weighted_pass__family/meta~1muse_spark_1_2` | | | | | | | | | [EMB / misc](https://benchize.com/benchmarks/vals-ai%3Aemb%3Amisc.md) | 50.69% | SE ±7.4 pp | 33 / 47 | $2.05 | 1,128.11source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_emb.BY1LXsAw.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 50.693 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 2.048008 \| USD \| per_test \| Lower is better \| \| `latency` \| 1128.107 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±7.4 pp sourcePopulation 76 stderr 7.401 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_emb.BY1LXsAw.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:45:57.495Z Evidence SHA-256 `d807aee620ea47152a1fca0257a8dd12a1be4512c76cc1744c1ae9e285180918` Source locator `/tasks/misc/meta~1muse_spark_1_2` | | | | | | | | | [CyberBench v1.1 / overall](https://benchize.com/benchmarks/benchmark%3Acyber%3Aoverall.md) | 69.52% | SE ±5.56 pp | 15 / 28 | $2.15 | 1,220.58source duration | [Vals AI · 1.1](https://www.vals.ai/_astro/benchmark_view_cyberbench.DS6UOlu0.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 69.524 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 2.149077 \| USD \| per_test \| Lower is better \| \| `latency` \| 1220.583 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±5.56 pp sourcePopulation 47 stderr 5.558 tokenTotals {"cache_read_tokens":626573058,"cache_write_tokens":0,"input_tokens":642905824,"output_tokens":2957384,"reasoning_tokens":1860750} ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_cyberbench.DS6UOlu0.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1.1 Observed 2026-10-21T16:46:15.238Z Evidence SHA-256 `943f593f929f8971a6b746269a2851b5febc2aad4e2f1066895f715033cdc7f1` Source locator `/tasks/overall/meta~1muse_spark_1_2` | | | | | | | | | [Arena text style control / instruction following](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Ainstruction_following.md) | 1,471.14 | — | 31 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1471.1409286398275 \| rating \| reported \| Higher is better \| ### Configuration category instruction_following config text_style_control Reasoning effort xhigh thinkingEnabled true ### Reported statistics lower 1460.5127316823955 rank 36 upper 1481.7691255972597 variance 29.40512337590503 votes 3379 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Muse Spark 1.2 (xHigh) Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/7569/row` | | | | | | | | | [Terminal-Bench 2.1 / overall](https://benchize.com/benchmarks/vals-ai%3Aterminal-bench-2-1%3Aoverall.md) | 69.66% | SE ±0.65 pp | 23 / 43 | $0.5 | 879.27source duration | [Vals AI · 2.1](https://www.vals.ai/_astro/benchmark_view_terminal_bench_2_1.CdyoObsA.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 69.663 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.499472 \| USD \| per_test \| Lower is better \| \| `latency` \| 879.273 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.65 pp sourcePopulation 76 stderr 0.649 tokenTotals {"cache_read_tokens":122415847,"cache_write_tokens":0,"input_tokens":131957427,"output_tokens":3332616,"reasoning_tokens":2186108} ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_terminal_bench_2_1.CdyoObsA.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 2.1 Observed 2026-10-21T16:46:13.216Z Evidence SHA-256 `a5306805cdf86495bdcceff6b2c8534a3768b9853f5077895dab975b809b054f` Source locator `/tasks/overall/meta~1muse_spark_1_2` | | | | | | | | | [Harvey's Legal Agent Benchmark v1 / criteria pass rate structured finance securitization](https://benchize.com/benchmarks/vals-ai%3Ahlab-v1%3Acriteria_pass_rate__structured_finance_securitization.md) | 88.89% | SE ±1.77 pp | 3 / 49 | $1.63 | 1,102.33source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 88.889 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 1.625328 \| USD \| per_test \| Lower is better \| \| `latency` \| 1102.334 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.77 pp sourcePopulation 81 stderr 1.774 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:45:53.909Z Evidence SHA-256 `65e7cd51e83066a42c9d782635dba5f2e9e1b189bd8118d3510cd17d2ddcba3f` Source locator `/tasks/criteria_pass_rate__structured_finance_securitization/meta~1muse_spark_1_2` | | | | | | | | | [Harvey's Legal Agent Benchmark v1 / criteria pass rate tax](https://benchize.com/benchmarks/vals-ai%3Ahlab-v1%3Acriteria_pass_rate__tax.md) | 92.98% | SE ±1.48 pp | 2 / 49 | $2.56 | 1,835.17source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 92.977 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 2.558771 \| USD \| per_test \| Lower is better \| \| `latency` \| 1835.168 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.48 pp sourcePopulation 81 stderr 1.48 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:45:53.909Z Evidence SHA-256 `65e7cd51e83066a42c9d782635dba5f2e9e1b189bd8118d3510cd17d2ddcba3f` Source locator `/tasks/criteria_pass_rate__tax/meta~1muse_spark_1_2` | | | | | | | | | [Harvey's Legal Agent Benchmark v1 / antitrust competition](https://benchize.com/benchmarks/vals-ai%3Ahlab-v1%3Aantitrust_competition.md) | 40% | SE ±24.5 pp | 1 / 49 | $1.84 | 1,432.75source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 40 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 1.84335 \| USD \| per_test \| Lower is better \| \| `latency` \| 1432.75 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±24.5 pp sourcePopulation 81 stderr 24.495 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:45:53.909Z Evidence SHA-256 `65e7cd51e83066a42c9d782635dba5f2e9e1b189bd8118d3510cd17d2ddcba3f` Source locator `/tasks/antitrust_competition/meta~1muse_spark_1_2` | | | | | | | | | [Arena text style control / industry medicine and healthcare](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aindustry_medicine_and_healthcare.md) | 1,513.76 | — | 6 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1513.7576459285863 \| rating \| reported \| Higher is better \| ### Configuration category industry_medicine_and_healthcare config text_style_control Reasoning effort xhigh thinkingEnabled true ### Reported statistics lower 1489.976188088844 rank 6 upper 1537.5391037683285 variance 147.22472981794047 votes 660 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Muse Spark 1.2 (xHigh) Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/6318/row` | | | | | | | | | [Arena text style control / non english](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Anon_english.md) | 1,485.62 | — | 10 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1485.6155348036368 \| rating \| reported \| Higher is better \| ### Configuration category non_english config text_style_control Reasoning effort xhigh thinkingEnabled true ### Reported statistics lower 1477.1172567004771 rank 10 upper 1494.1138129067963 variance 18.800339685951187 votes 5780 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Muse Spark 1.2 (xHigh) Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/9740/row` | | | | | | | | | [LegalBench / issue tasks](https://benchize.com/benchmarks/vals-ai%3Alegal_bench%3Aissue_tasks.md) | 89.37% | SE ±0.58 pp | 14 / 44 | $0.00529 | 21.72source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_bench.D6uTgA3b.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 89.374 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.005294 \| USD \| per_test \| Lower is better \| \| `latency` \| 21.721 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.58 pp sourcePopulation 151 stderr 0.58 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_bench.D6uTgA3b.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:45:53.390Z Evidence SHA-256 `c8486ba756baa5cd3955d035edff67440e8db23e69d62ad1a9e18d15b8c4bc52` Source locator `/tasks/issue_tasks/meta~1muse_spark_1_2` | | | | | | | | | [Legal Research Bench / weighted pass criminal](https://benchize.com/benchmarks/vals-ai%3Alegal_research%3Aweighted_pass__criminal.md) | 83.13% | SE ±3.18 pp | 22 / 50 | $0.45 | 301.21source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_research.DiuL0R8P.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 83.127 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.446419 \| USD \| per_test \| Lower is better \| \| `latency` \| 301.211 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±3.18 pp sourcePopulation 82 stderr 3.178 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_research.DiuL0R8P.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:45:52.389Z Evidence SHA-256 `26c58dfd47d0d2dc86f33c6d056f30309e0ee63570e7cd752c593b385f9d862e` Source locator `/tasks/weighted_pass__criminal/meta~1muse_spark_1_2` | | | | | | | | | [Legal Research Bench / administrative regulatory](https://benchize.com/benchmarks/vals-ai%3Alegal_research%3Aadministrative_regulatory.md) | 48.49% | SE ±6.2 pp | 21 / 50 | $0.51 | 302.67source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_research.DiuL0R8P.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 48.485 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.506511 \| USD \| per_test \| Lower is better \| \| `latency` \| 302.672 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±6.2 pp sourcePopulation 82 stderr 6.199 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_research.DiuL0R8P.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:45:52.389Z Evidence SHA-256 `26c58dfd47d0d2dc86f33c6d056f30309e0ee63570e7cd752c593b385f9d862e` Source locator `/tasks/administrative_regulatory/meta~1muse_spark_1_2` | | | | | | | | | [Arena text / multi turn](https://benchize.com/benchmarks/lmarena%3Atext%3Amulti_turn.md) | 1,502.18 | — | 9 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1502.1822461714908 \| rating \| reported \| Higher is better \| ### Configuration category multi_turn config text Reasoning effort xhigh thinkingEnabled true ### Reported statistics lower 1485.660194302247 rank 9 upper 1518.7042980407348 variance 71.06107619830286 votes 1393 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Muse Spark 1.2 (xHigh) Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/9324/row` | | | | | | | | | [Arena vision style control / english](https://benchize.com/benchmarks/lmarena%3Avision_style_control%3Aenglish.md) | 1,275.19 | — | 27 / 82 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1275.1865798347173 \| rating \| reported \| Higher is better \| ### Configuration category english config vision_style_control Reasoning effort xhigh thinkingEnabled true ### Reported statistics lower 1251.7794274961116 rank 31 upper 1298.5937321733234 variance 142.62674837256233 votes 695 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) Source Arena Original model label Muse Spark 1.2 (xHigh) Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `38568936995f36625aae49e9ea05557d55c1b1df9b2954f5c50cee523f26fe92` Source locator `/rows/620/row` | | | | | | | | | [Harvey's Legal Agent Benchmark v1 / criteria pass rate trusts estates private client](https://benchize.com/benchmarks/vals-ai%3Ahlab-v1%3Acriteria_pass_rate__trusts_estates_private_client.md) | 93.51% | SE ±1.53 pp | 2 / 49 | $1.81 | 1,314.76source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 93.511 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 1.805781 \| USD \| per_test \| Lower is better \| \| `latency` \| 1314.758 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.53 pp sourcePopulation 81 stderr 1.525 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:45:53.909Z Evidence SHA-256 `65e7cd51e83066a42c9d782635dba5f2e9e1b189bd8118d3510cd17d2ddcba3f` Source locator `/tasks/criteria_pass_rate__trusts_estates_private_client/meta~1muse_spark_1_2` | | | | | | | | | [Harvey's Legal Agent Benchmark v1 / criteria pass rate emerging companies venture capital](https://benchize.com/benchmarks/vals-ai%3Ahlab-v1%3Acriteria_pass_rate__emerging_companies_venture_capital.md) | 95.22% | SE ±1.25 pp | 3 / 49 | $1.88 | 1,654.39source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 95.222 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 1.884283 \| USD \| per_test \| Lower is better \| \| `latency` \| 1654.386 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.25 pp sourcePopulation 81 stderr 1.248 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:45:53.909Z Evidence SHA-256 `65e7cd51e83066a42c9d782635dba5f2e9e1b189bd8118d3510cd17d2ddcba3f` Source locator `/tasks/criteria_pass_rate__emerging_companies_venture_capital/meta~1muse_spark_1_2` | | | | | | | | | [Finance Agent (v2) / all pass](https://benchize.com/benchmarks/vals-ai%3Afabv2%3Aall_pass.md) | 50.88% | SE ±0.61 pp | 2 / 50 | $0.77 | 304.21source duration | [Vals AI · 2](https://www.vals.ai/_astro/benchmark_view_finance_agent_v2.DypCOnwd.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 50.881 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.76972 \| USD \| per_test \| Lower is better \| \| `latency` \| 304.205 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.61 pp sourcePopulation 80 stderr 0.606 tokenTotals {"cache_read_tokens":null,"cache_write_tokens":null,"input_tokens":424942458,"output_tokens":12218400,"reasoning_tokens":6559929} ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_finance_agent_v2.DypCOnwd.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 2 Observed 2026-10-21T16:45:57.035Z Evidence SHA-256 `f731b20a26c126725d125519f2b5841aa45254656dba859a9570d7ce7e5d8191` Source locator `/tasks/all_pass/meta~1muse_spark_1_2` | | | | | | | | | [Harvey's Legal Agent Benchmark v1 / criteria pass rate environmental esg](https://benchize.com/benchmarks/vals-ai%3Ahlab-v1%3Acriteria_pass_rate__environmental_esg.md) | 93.68% | SE ±1.85 pp | 3 / 49 | $1.67 | 1,476.36source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 93.678 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 1.666729 \| USD \| per_test \| Lower is better \| \| `latency` \| 1476.363 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.85 pp sourcePopulation 81 stderr 1.85 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:45:53.909Z Evidence SHA-256 `65e7cd51e83066a42c9d782635dba5f2e9e1b189bd8118d3510cd17d2ddcba3f` Source locator `/tasks/criteria_pass_rate__environmental_esg/meta~1muse_spark_1_2` | | | | | | | | | [Arena text / hard prompts](https://benchize.com/benchmarks/lmarena%3Atext%3Ahard_prompts.md) | 1,489.44 | — | 18 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1489.441614715111 \| rating \| reported \| Higher is better \| ### Configuration category hard_prompts config text Reasoning effort xhigh thinkingEnabled true ### Reported statistics lower 1481.217042711356 rank 21 upper 1497.6661867188664 variance 17.608827219636378 votes 6116 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Muse Spark 1.2 (xHigh) Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/3471/row` | | | | | | | | | [LegalBench / interpretation tasks](https://benchize.com/benchmarks/vals-ai%3Alegal_bench%3Ainterpretation_tasks.md) | 82.54% | SE ±0.2 pp | 18 / 44 | $0.00536 | 27.91source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_bench.D6uTgA3b.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 82.542 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.005359 \| USD \| per_test \| Lower is better \| \| `latency` \| 27.908 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.2 pp sourcePopulation 151 stderr 0.197 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_bench.D6uTgA3b.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:45:53.390Z Evidence SHA-256 `c8486ba756baa5cd3955d035edff67440e8db23e69d62ad1a9e18d15b8c4bc52` Source locator `/tasks/interpretation_tasks/meta~1muse_spark_1_2` | | | | | | | | | [Harvey's Legal Agent Benchmark v1 / criteria pass rate international trade sanctions](https://benchize.com/benchmarks/vals-ai%3Ahlab-v1%3Acriteria_pass_rate__international_trade_sanctions.md) | 93.07% | SE ±1.79 pp | 4 / 49 | $2.12 | 2,085.61source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 93.069 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 2.123477 \| USD \| per_test \| Lower is better \| \| `latency` \| 2085.605 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.79 pp sourcePopulation 81 stderr 1.791 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:45:53.909Z Evidence SHA-256 `65e7cd51e83066a42c9d782635dba5f2e9e1b189bd8118d3510cd17d2ddcba3f` Source locator `/tasks/criteria_pass_rate__international_trade_sanctions/meta~1muse_spark_1_2` | | | | | | | | | [Arena text / hard prompts english](https://benchize.com/benchmarks/lmarena%3Atext%3Ahard_prompts_english.md) | 1,487.44 | — | 21 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1487.439451178288 \| rating \| reported \| Higher is better \| ### Configuration category hard_prompts_english config text Reasoning effort xhigh thinkingEnabled true ### Reported statistics lower 1475.249307233366 rank 24 upper 1499.62959512321 variance 38.683119183110435 votes 2442 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Muse Spark 1.2 (xHigh) Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/3891/row` | | | | | | | | | [MMMU Pro / overall](https://benchize.com/benchmarks/vals-ai%3Ammmu%3Aoverall.md) | 86.13% | SE ±0.83 pp | 15 / 28 | $0.02 | 73.84source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_mmmu.BBln8x5x.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 86.127 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.018022 \| USD \| per_test \| Lower is better \| \| `latency` \| 73.839 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.83 pp sourcePopulation 93 stderr 0.831 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_mmmu.BBln8x5x.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:46:07.000Z Evidence SHA-256 `29395186eddd2c70601228c584a14b3c1d8f9dba4b68256561b46b0dd03c635a` Source locator `/tasks/overall/meta~1muse_spark_1_2` | | | | | | | | | [EMB / operating](https://benchize.com/benchmarks/vals-ai%3Aemb%3Aoperating.md) | 59.42% | SE ±6.67 pp | 28 / 47 | $2.94 | 1,023.14source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_emb.BY1LXsAw.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 59.424 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 2.944004 \| USD \| per_test \| Lower is better \| \| `latency` \| 1023.138 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±6.67 pp sourcePopulation 76 stderr 6.665 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_emb.BY1LXsAw.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:45:57.495Z Evidence SHA-256 `d807aee620ea47152a1fca0257a8dd12a1be4512c76cc1744c1ae9e285180918` Source locator `/tasks/operating/meta~1muse_spark_1_2` | | | | | | | | | [MortgageTax / overall](https://benchize.com/benchmarks/vals-ai%3Amortgage_tax%3Aoverall.md) | 65.42% | SE ±0.93 pp | 22 / 31 | $0.03 | 44.62source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_mortgage_tax.DCd-oO5Y.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 65.422 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.026128 \| USD \| per_test \| Lower is better \| \| `latency` \| 44.623 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.93 pp sourcePopulation 98 stderr 0.934 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_mortgage_tax.DCd-oO5Y.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:45:58.500Z Evidence SHA-256 `e5c844561f97d119d66d70269e726ecfb68be79eae39acf14ead3e95422e648c` Source locator `/tasks/overall/meta~1muse_spark_1_2` | | | | | | | | | [Finance Agent (v2) / market analysis](https://benchize.com/benchmarks/vals-ai%3Afabv2%3Amarket_analysis.md) | 66.2% | SE ±1.23 pp | 14 / 50 | $0.55 | 295.59source duration | [Vals AI · 2](https://www.vals.ai/_astro/benchmark_view_finance_agent_v2.DypCOnwd.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 66.201 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.549348 \| USD \| per_test \| Lower is better \| \| `latency` \| 295.587 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.23 pp sourcePopulation 80 stderr 1.233 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_finance_agent_v2.DypCOnwd.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 2 Observed 2026-10-21T16:45:57.035Z Evidence SHA-256 `f731b20a26c126725d125519f2b5841aa45254656dba859a9570d7ce7e5d8191` Source locator `/tasks/market_analysis/meta~1muse_spark_1_2` | | | | | | | | | [MortgageTax / semantic extraction](https://benchize.com/benchmarks/vals-ai%3Amortgage_tax%3Asemantic_extraction.md) | 57.23% | SE ±1.4 pp | 24 / 31 | $0.02 | 34.2source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_mortgage_tax.DCd-oO5Y.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 57.234 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.020691 \| USD \| per_test \| Lower is better \| \| `latency` \| 34.203 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.4 pp sourcePopulation 98 stderr 1.395 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_mortgage_tax.DCd-oO5Y.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:45:58.500Z Evidence SHA-256 `e5c844561f97d119d66d70269e726ecfb68be79eae39acf14ead3e95422e648c` Source locator `/tasks/semantic_extraction/meta~1muse_spark_1_2` | | | | | | | | | [Harvey's Legal Agent Benchmark v1 / criteria pass rate healthcare life sciences](https://benchize.com/benchmarks/vals-ai%3Ahlab-v1%3Acriteria_pass_rate__healthcare_life_sciences.md) | 95.38% | SE ±1.21 pp | 1 / 49 | $2.6 | 1,815.46source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 95.38 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 2.602242 \| USD \| per_test \| Lower is better \| \| `latency` \| 1815.46 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.21 pp sourcePopulation 81 stderr 1.208 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:45:53.909Z Evidence SHA-256 `65e7cd51e83066a42c9d782635dba5f2e9e1b189bd8118d3510cd17d2ddcba3f` Source locator `/tasks/criteria_pass_rate__healthcare_life_sciences/meta~1muse_spark_1_2` | | | | | | | | | [Arena vision style control / overall](https://benchize.com/benchmarks/lmarena%3Avision_style_control%3Aoverall.md) | 1,292.67 | — | 10 / 82 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1292.6700985345547 \| rating \| reported \| Higher is better \| ### Configuration category overall config vision_style_control Reasoning effort xhigh thinkingEnabled true ### Reported statistics lower 1278.3336811337774 rank 11 upper 1307.0065159353317 variance 53.50385712378052 votes 1948 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/vision_style_control/latest) Source Arena Original model label Muse Spark 1.2 (xHigh) Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `38568936995f36625aae49e9ea05557d55c1b1df9b2954f5c50cee523f26fe92` Source locator `/rows/10/row` | | | | | | | | | [Legal Research Bench / weighted pass immigration](https://benchize.com/benchmarks/vals-ai%3Alegal_research%3Aweighted_pass__immigration.md) | 84.08% | SE ±7.19 pp | 6 / 50 | $1.01 | 372.58source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_research.DiuL0R8P.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 84.075 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 1.011872 \| USD \| per_test \| Lower is better \| \| `latency` \| 372.58 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±7.19 pp sourcePopulation 82 stderr 7.185 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_research.DiuL0R8P.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:45:52.389Z Evidence SHA-256 `26c58dfd47d0d2dc86f33c6d056f30309e0ee63570e7cd752c593b385f9d862e` Source locator `/tasks/weighted_pass__immigration/meta~1muse_spark_1_2` | | | | | | | | | [Arena text / industry life and physical and social science](https://benchize.com/benchmarks/lmarena%3Atext%3Aindustry_life_and_physical_and_social_science.md) | 1,499.91 | — | 16 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1499.9100264795609 \| rating \| reported \| Higher is better \| ### Configuration category industry_life_and_physical_and_social_science config text Reasoning effort xhigh thinkingEnabled true ### Reported statistics lower 1484.731531734237 rank 17 upper 1515.0885212248847 variance 59.9737530681625 votes 1537 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Muse Spark 1.2 (xHigh) Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/5514/row` | | | | | | | | | [Arena text style control / hard prompts english](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Ahard_prompts_english.md) | 1,507.48 | — | 20 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1507.4774265393735 \| rating \| reported \| Higher is better \| ### Configuration category hard_prompts_english config text_style_control Reasoning effort xhigh thinkingEnabled true ### Reported statistics lower 1495.1996238721035 rank 23 upper 1519.755229206644 variance 39.241456272903605 votes 2442 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Muse Spark 1.2 (xHigh) Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/3890/row` | | | | | | | | | [Arena text style control / industry life and physical and social science](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aindustry_life_and_physical_and_social_science.md) | 1,511.01 | — | 15 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1511.0053255878045 \| rating \| reported \| Higher is better \| ### Configuration category industry_life_and_physical_and_social_science config text_style_control Reasoning effort xhigh thinkingEnabled true ### Reported statistics lower 1495.6748220285047 rank 16 upper 1526.3358291471043 variance 61.18101230595456 votes 1537 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Muse Spark 1.2 (xHigh) Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/5513/row` | | | | | | | | | [MMLU Pro / chemistry](https://benchize.com/benchmarks/vals-ai%3Ammlu_pro%3Achemistry.md) | 92.85% | SE ±0.77 pp | 8 / 40 | $0.01 | 45.05source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 92.845 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.011447 \| USD \| per_test \| Lower is better \| \| `latency` \| 45.052 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.77 pp sourcePopulation 138 stderr 0.766 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:46:06.503Z Evidence SHA-256 `dab025507f46c716dd8d145e90ec0a737d9c56219853f41e4b1cc3c5e8c222b4` Source locator `/tasks/chemistry/meta~1muse_spark_1_2` | | | | | | | | | [Arena text style control / industry legal and government](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aindustry_legal_and_government.md) | 1,526.66 | — | 2 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1526.6580378786564 \| rating \| reported \| Higher is better \| ### Configuration category industry_legal_and_government config text_style_control Reasoning effort xhigh thinkingEnabled true ### Reported statistics lower 1505.0050239094933 rank 2 upper 1548.3110518478193 variance 122.05077181174893 votes 757 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Muse Spark 1.2 (xHigh) Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/5109/row` | | | | | | | | | [Arena text / industry mathematical](https://benchize.com/benchmarks/lmarena%3Atext%3Aindustry_mathematical.md) | 1,479.81 | — | 35 / 148 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1479.8053441891961 \| rating \| reported \| Higher is better \| ### Configuration category industry_mathematical config text Reasoning effort xhigh thinkingEnabled true ### Reported statistics lower 1453.9452628264376 rank 43 upper 1505.665425551955 variance 174.0858979109566 votes 520 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Muse Spark 1.2 (xHigh) Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/5955/row` | | | | | | | | | [MMLU Pro / math](https://benchize.com/benchmarks/vals-ai%3Ammlu_pro%3Amath.md) | 96% | SE ±0.53 pp | 6 / 40 | $0.00848 | 31.83source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 96.003 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.008477 \| USD \| per_test \| Lower is better \| \| `latency` \| 31.834 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.53 pp sourcePopulation 138 stderr 0.533 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:46:06.503Z Evidence SHA-256 `dab025507f46c716dd8d145e90ec0a737d9c56219853f41e4b1cc3c5e8c222b4` Source locator `/tasks/math/meta~1muse_spark_1_2` | | | | | | | | | [Harvey's Legal Agent Benchmark v1 / criteria pass rate](https://benchize.com/benchmarks/vals-ai%3Ahlab-v1%3Acriteria_pass_rate.md) | 94.52% | SE ±0.28 pp | 1 / 49 | $2.09 | 1,456.3source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 94.522 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 2.08555 \| USD \| per_test \| Lower is better \| \| `latency` \| 1456.298 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.28 pp sourcePopulation 81 stderr 0.278 tokenTotals {"cache_read_tokens":512433248,"cache_write_tokens":null,"input_tokens":608754402,"output_tokens":10507621,"reasoning_tokens":826686} ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:45:53.909Z Evidence SHA-256 `65e7cd51e83066a42c9d782635dba5f2e9e1b189bd8118d3510cd17d2ddcba3f` Source locator `/tasks/criteria_pass_rate/meta~1muse_spark_1_2` | | | | | | | | | [LegalBench / overall](https://benchize.com/benchmarks/vals-ai%3Alegal_bench%3Aoverall.md) | 85.26% | SE ±0.45 pp | 13 / 44 | $0.00637 | 30.1source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_bench.D6uTgA3b.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 85.262 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.00637 \| USD \| per_test \| Lower is better \| \| `latency` \| 30.102 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.45 pp sourcePopulation 151 stderr 0.446 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_bench.D6uTgA3b.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:45:53.390Z Evidence SHA-256 `c8486ba756baa5cd3955d035edff67440e8db23e69d62ad1a9e18d15b8c4bc52` Source locator `/tasks/overall/meta~1muse_spark_1_2` | | | | | | | | | [Harvey's Legal Agent Benchmark v1 / criteria pass rate banking finance](https://benchize.com/benchmarks/vals-ai%3Ahlab-v1%3Acriteria_pass_rate__banking_finance.md) | 97.77% | SE ±0.9 pp | 1 / 49 | $1.82 | 1,239.68source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 97.77 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 1.815007 \| USD \| per_test \| Lower is better \| \| `latency` \| 1239.682 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.9 pp sourcePopulation 81 stderr 0.902 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:45:53.909Z Evidence SHA-256 `65e7cd51e83066a42c9d782635dba5f2e9e1b189bd8118d3510cd17d2ddcba3f` Source locator `/tasks/criteria_pass_rate__banking_finance/meta~1muse_spark_1_2` | | | | | | | | | [Harvey's Legal Agent Benchmark v1 / criteria pass rate energy natural resources](https://benchize.com/benchmarks/vals-ai%3Ahlab-v1%3Acriteria_pass_rate__energy_natural_resources.md) | 98.68% | SE ±0.66 pp | 1 / 49 | $3.51 | 2,031.21source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 98.68 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 3.505056 \| USD \| per_test \| Lower is better \| \| `latency` \| 2031.21 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.66 pp sourcePopulation 81 stderr 0.657 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:45:53.909Z Evidence SHA-256 `65e7cd51e83066a42c9d782635dba5f2e9e1b189bd8118d3510cd17d2ddcba3f` Source locator `/tasks/criteria_pass_rate__energy_natural_resources/meta~1muse_spark_1_2` | | | | | | | | | [Harvey's Legal Agent Benchmark v1 / employment labor](https://benchize.com/benchmarks/vals-ai%3Ahlab-v1%3Aemployment_labor.md) | 0% | SE ±0 pp | 1 / 49 | $1.71 | 1,039.99source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 0 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 1.705269 \| USD \| per_test \| Lower is better \| \| `latency` \| 1039.986 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0 pp sourcePopulation 81 stderr 0 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:45:53.909Z Evidence SHA-256 `65e7cd51e83066a42c9d782635dba5f2e9e1b189bd8118d3510cd17d2ddcba3f` Source locator `/tasks/employment_labor/meta~1muse_spark_1_2` | | | | | | | | | [Arena text style control / english](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aenglish.md) | 1,492 | — | 15 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1492.0028742783918 \| rating \| reported \| Higher is better \| ### Configuration category english config text_style_control Reasoning effort xhigh thinkingEnabled true ### Reported statistics lower 1482.0760462502597 rank 17 upper 1501.929702306524 variance 25.652211646590874 votes 3794 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Muse Spark 1.2 (xHigh) Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/1653/row` | | | | | | | | | [Terminal-Bench 4.0 / ml](https://benchize.com/benchmarks/vals-ai%3Aterminal-bench-4%3Aml.md) | 3.03% | SE ±3.03 pp | 30 / 36 | — | — | [Vals AI · 4.0](https://www.vals.ai/_astro/benchmark_view_terminal_bench_4.CAnGyzC_.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 3.03 \| percent \| reported \| Higher is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±3.03 pp sourcePopulation 52 stderr 3.03 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_terminal_bench_4.CAnGyzC_.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 4.0 Observed 2026-10-21T16:46:10.642Z Evidence SHA-256 `98f6964580e901f1aa143db664bd92aa558415f643569492545d67c47d7f519b` Source locator `/tasks/ml/meta~1muse_spark_1_2` | | | | | | | | | [Harvey's Legal Agent Benchmark v1 / structured finance securitization](https://benchize.com/benchmarks/vals-ai%3Ahlab-v1%3Astructured_finance_securitization.md) | 20% | SE ±20 pp | 1 / 49 | $1.63 | 1,102.33source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 20 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 1.625328 \| USD \| per_test \| Lower is better \| \| `latency` \| 1102.334 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±20 pp sourcePopulation 81 stderr 20 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:45:53.909Z Evidence SHA-256 `65e7cd51e83066a42c9d782635dba5f2e9e1b189bd8118d3510cd17d2ddcba3f` Source locator `/tasks/structured_finance_securitization/meta~1muse_spark_1_2` | | | | | | | | | [Legal Research Bench / weighted pass administrative regulatory](https://benchize.com/benchmarks/vals-ai%3Alegal_research%3Aweighted_pass__administrative_regulatory.md) | 88.15% | SE ±2.54 pp | 12 / 50 | $0.51 | 302.67source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_research.DiuL0R8P.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 88.147 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.506511 \| USD \| per_test \| Lower is better \| \| `latency` \| 302.672 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±2.54 pp sourcePopulation 82 stderr 2.538 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_research.DiuL0R8P.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:45:52.389Z Evidence SHA-256 `26c58dfd47d0d2dc86f33c6d056f30309e0ee63570e7cd752c593b385f9d862e` Source locator `/tasks/weighted_pass__administrative_regulatory/meta~1muse_spark_1_2` | | | | | | | | | [Harvey's Legal Agent Benchmark v1 / funds asset management](https://benchize.com/benchmarks/vals-ai%3Ahlab-v1%3Afunds_asset_management.md) | 0% | SE ±0 pp | 11 / 49 | $2.41 | 1,831.47source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 0 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 2.411987 \| USD \| per_test \| Lower is better \| \| `latency` \| 1831.468 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0 pp sourcePopulation 81 stderr 0 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:45:53.909Z Evidence SHA-256 `65e7cd51e83066a42c9d782635dba5f2e9e1b189bd8118d3510cd17d2ddcba3f` Source locator `/tasks/funds_asset_management/meta~1muse_spark_1_2` | | | | | | | | | [SWE-bench / 1-4 hours](https://benchize.com/benchmarks/vals-ai%3Aswebench%3A1-4%20hours.md) | 64.29% | SE ±7.48 pp | 10 / 39 | $1.04 | 1,011.19source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_swebench.Ae8ni7h0.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 64.286 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 1.038261 \| USD \| per_test \| Lower is better \| \| `latency` \| 1011.187 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±7.48 pp sourcePopulation 88 stderr 7.483 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_swebench.Ae8ni7h0.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:46:13.711Z Evidence SHA-256 `7a4e2e8485283caac500127419f68ec4bd5414c837ade114fc6afa5b2d34ccaa` Source locator `/tasks/1-4 hours/meta~1muse_spark_1_2` | | | | | | | | | [Tax Agent Bench / rule source lookup](https://benchize.com/benchmarks/vals-ai%3Atax_agent_bench%3Arule_source_lookup.md) | 43.67% | SE ±7.31 pp | 9 / 46 | $0.23 | 103.01source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_tax_agent_bench.BFpexnpS.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 43.667 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.228706 \| USD \| per_test \| Lower is better \| \| `latency` \| 103.014 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±7.31 pp sourcePopulation 73 stderr 7.311 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_tax_agent_bench.BFpexnpS.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:45:55.958Z Evidence SHA-256 `446db182b67efb7923b3187a4040ec3a3ea492b8ad699a2b6d708d714cc063ac` Source locator `/tasks/rule_source_lookup/meta~1muse_spark_1_2` | | | | | | | | | [Harvey's Legal Agent Benchmark v1 / criteria pass rate data privacy cybersecurity](https://benchize.com/benchmarks/vals-ai%3Ahlab-v1%3Acriteria_pass_rate__data_privacy_cybersecurity.md) | 95.76% | SE ±1.2 pp | 8 / 49 | $2.74 | 1,731.11source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 95.76 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 2.741491 \| USD \| per_test \| Lower is better \| \| `latency` \| 1731.114 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.2 pp sourcePopulation 81 stderr 1.2 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:45:53.909Z Evidence SHA-256 `65e7cd51e83066a42c9d782635dba5f2e9e1b189bd8118d3510cd17d2ddcba3f` Source locator `/tasks/criteria_pass_rate__data_privacy_cybersecurity/meta~1muse_spark_1_2` | | | | | | | | | [Tax Agent Bench / weighted pass fact pattern analysis](https://benchize.com/benchmarks/vals-ai%3Atax_agent_bench%3Aweighted_pass__fact_pattern_analysis.md) | 52.48% | SE ±4.82 pp | 31 / 46 | $0.26 | 125.37source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_tax_agent_bench.BFpexnpS.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 52.476 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.261785 \| USD \| per_test \| Lower is better \| \| `latency` \| 125.373 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±4.82 pp sourcePopulation 73 stderr 4.819 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_tax_agent_bench.BFpexnpS.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:45:55.958Z Evidence SHA-256 `446db182b67efb7923b3187a4040ec3a3ea492b8ad699a2b6d708d714cc063ac` Source locator `/tasks/weighted_pass__fact_pattern_analysis/meta~1muse_spark_1_2` | | | | | | | | | [Terminal-Bench 4.0 / security](https://benchize.com/benchmarks/vals-ai%3Aterminal-bench-4%3Asecurity.md) | 0% | SE ±0 pp | 29 / 36 | — | — | [Vals AI · 4.0](https://www.vals.ai/_astro/benchmark_view_terminal_bench_4.CAnGyzC_.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 0 \| percent \| reported \| Higher is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0 pp sourcePopulation 52 stderr 0 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_terminal_bench_4.CAnGyzC_.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 4.0 Observed 2026-10-21T16:46:10.642Z Evidence SHA-256 `98f6964580e901f1aa143db664bd92aa558415f643569492545d67c47d7f519b` Source locator `/tasks/security/meta~1muse_spark_1_2` | | | | | | | | | [Harvey's Legal Agent Benchmark v1 / arbitration international dispute resolution](https://benchize.com/benchmarks/vals-ai%3Ahlab-v1%3Aarbitration_international_dispute_resolution.md) | 20% | SE ±20 pp | 1 / 49 | $2.62 | 1,617.61source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 20 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 2.621978 \| USD \| per_test \| Lower is better \| \| `latency` \| 1617.612 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±20 pp sourcePopulation 81 stderr 20 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:45:53.909Z Evidence SHA-256 `65e7cd51e83066a42c9d782635dba5f2e9e1b189bd8118d3510cd17d2ddcba3f` Source locator `/tasks/arbitration_international_dispute_resolution/meta~1muse_spark_1_2` | | | | | | | | | [Terminal-Bench 4.0 / software](https://benchize.com/benchmarks/vals-ai%3Aterminal-bench-4%3Asoftware.md) | 11.11% | SE ±3.21 pp | 28 / 36 | — | — | [Vals AI · 4.0](https://www.vals.ai/_astro/benchmark_view_terminal_bench_4.CAnGyzC_.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 11.111 \| percent \| reported \| Higher is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±3.21 pp sourcePopulation 52 stderr 3.208 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_terminal_bench_4.CAnGyzC_.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 4.0 Observed 2026-10-21T16:46:10.642Z Evidence SHA-256 `98f6964580e901f1aa143db664bd92aa558415f643569492545d67c47d7f519b` Source locator `/tasks/software/meta~1muse_spark_1_2` | | | | | | | | | [CorpFin v2 / max fitting context](https://benchize.com/benchmarks/vals-ai%3Acorp_fin_v2%3Amax_fitting_context.md) | 74.01% | SE ±1.5 pp | 4 / 39 | $0.23 | 41.51source duration | [Vals AI · 2](https://www.vals.ai/_astro/benchmark_view_corp_fin_v2.CectKwl1.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 74.009 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.230884 \| USD \| per_test \| Lower is better \| \| `latency` \| 41.511 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.5 pp sourcePopulation 134 stderr 1.497 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_corp_fin_v2.CectKwl1.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 2 Observed 2026-10-21T16:45:57.998Z Evidence SHA-256 `7cf2217ab3728d5a84bffce82aab9fc52d7f810b0cbe8c65b387df47f3d31c9b` Source locator `/tasks/max_fitting_context/meta~1muse_spark_1_2` | | | | | | | | | [MedScribe / overall](https://benchize.com/benchmarks/vals-ai%3Amedscribe%3Aoverall.md) | 90.06% | SE ±1.96 pp | 5 / 49 | $0.04 | 61.46source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_medscribe.BYf5a3C-.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 90.062 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.037779 \| USD \| per_test \| Lower is better \| \| `latency` \| 61.458 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 30000 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.96 pp sourcePopulation 109 stderr 1.958 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_medscribe.BYf5a3C-.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:46:00.004Z Evidence SHA-256 `271fc122ddc2b0602bd6c7947f65a9a7f0d8cab94f6dc27d62a9380a9317f9c0` Source locator `/tasks/overall/meta~1muse_spark_1_2` | | | | | | | | | [Arena text / chinese](https://benchize.com/benchmarks/lmarena%3Atext%3Achinese.md) | 1,509.45 | — | 30 / 146 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1509.4507744503828 \| rating \| reported \| Higher is better \| ### Configuration category chinese config text Reasoning effort xhigh thinkingEnabled true ### Reported statistics lower 1488.330262017108 rank 40 upper 1530.5712868836574 variance 116.1215221261973 votes 821 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Muse Spark 1.2 (xHigh) Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/456/row` | | | | | | | | | [Arena webdev / webdev-html](https://benchize.com/benchmarks/lmarena%3Awebdev%3Awebdev-html.md) | 1,542.73 | — | 34 / 89 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/webdev/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1542.7254677774858 \| rating \| reported \| Higher is better \| ### Configuration category webdev-html config webdev Reasoning effort xhigh thinkingEnabled true ### Reported statistics lower 1501.0739807336784 rank 46 upper 1584.3769548212933 variance 451.61134192426056 votes 244 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/webdev/latest) Source Arena Original model label Muse Spark 1.2 (xHigh) Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `f82507859808110820a4ab6df15561b8864137ddefc1f6fb0c552af2e58ea738` Source locator `/rows/405/row` | | | | | | | | | [SAGE / PDEs](https://benchize.com/benchmarks/vals-ai%3Asage%3APDEs.md) | 44.44% | SE ±6.24 pp | 8 / 41 | $0.03 | 31.27source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_sage.RRwIIzO5.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 44.444 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.033761 \| USD \| per_test \| Lower is better \| \| `latency` \| 31.274 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 30000 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±6.24 pp sourcePopulation 91 stderr 6.24 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_sage.RRwIIzO5.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:46:07.515Z Evidence SHA-256 `cc5fb3fecdb0382d492ff167a42ad84b9c5c3883373c78ed87baaa972b8b6f7c` Source locator `/tasks/PDEs/meta~1muse_spark_1_2` | | | | | | | | | [Arena text style control / multi turn](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Amulti_turn.md) | 1,514.07 | — | 7 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1514.0691494515304 \| rating \| reported \| Higher is better \| ### Configuration category multi_turn config text_style_control Reasoning effort xhigh thinkingEnabled true ### Reported statistics lower 1497.4968136219618 rank 7 upper 1530.6414852810994 variance 71.49427539571772 votes 1393 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Muse Spark 1.2 (xHigh) Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/9322/row` | | | | | | | | | [Arena text / industry medicine and healthcare](https://benchize.com/benchmarks/lmarena%3Atext%3Aindustry_medicine_and_healthcare.md) | 1,495.95 | — | 12 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1495.953085889044 \| rating \| reported \| Higher is better \| ### Configuration category industry_medicine_and_healthcare config text Reasoning effort xhigh thinkingEnabled true ### Reported statistics lower 1472.5307009525623 rank 13 upper 1519.3754708255256 variance 142.81244228295313 votes 660 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Muse Spark 1.2 (xHigh) Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/6325/row` | | | | | | | | | [IOI / ioi2026](https://benchize.com/benchmarks/vals-ai%3Aioi%3Aioi2026.md) | 20.17% | SE ±14.74 pp | 28 / 29 | $1.69 | 1,264.23source duration | [Vals AI · 2](https://www.vals.ai/_astro/benchmark_view_ioi.CuUolFNv.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 20.167 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 1.688722 \| USD \| per_test \| Lower is better \| \| `latency` \| 1264.229 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±14.74 pp sourcePopulation 44 stderr 14.739 tokenTotals {"cache_read_tokens":31582544,"cache_write_tokens":0,"input_tokens":32845457,"output_tokens":880077,"reasoning_tokens":663527} ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_ioi.CuUolFNv.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 2 Observed 2026-10-21T16:46:11.757Z Evidence SHA-256 `e1545b21b5b5c98d037aefa9d441b65859d07a10550f242d0e16162a49b8e8ab` Source locator `/tasks/ioi2026/meta~1muse_spark_1_2` | | | | | | | | | [Legal Research Bench / overall](https://benchize.com/benchmarks/vals-ai%3Alegal_research%3Aoverall.md) | 43.75% | SE ±3.45 pp | 11 / 50 | $0.51 | 306.89source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_research.DiuL0R8P.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 43.75 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.508097 \| USD \| per_test \| Lower is better \| \| `latency` \| 306.893 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±3.45 pp sourcePopulation 82 stderr 3.448 tokenTotals {"cache_read_tokens":113477050,"cache_write_tokens":0,"input_tokens":163340498,"output_tokens":5837394,"reasoning_tokens":2676881} ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_research.DiuL0R8P.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:45:52.389Z Evidence SHA-256 `26c58dfd47d0d2dc86f33c6d056f30309e0ee63570e7cd752c593b385f9d862e` Source locator `/tasks/overall/meta~1muse_spark_1_2` | | | | | | | | | [Harvey's Legal Agent Benchmark v1 / corporate governance](https://benchize.com/benchmarks/vals-ai%3Ahlab-v1%3Acorporate_governance.md) | 20% | SE ±20 pp | 3 / 49 | $2.16 | 1,426.99source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 20 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 2.15945 \| USD \| per_test \| Lower is better \| \| `latency` \| 1426.99 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±20 pp sourcePopulation 81 stderr 20 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:45:53.909Z Evidence SHA-256 `65e7cd51e83066a42c9d782635dba5f2e9e1b189bd8118d3510cd17d2ddcba3f` Source locator `/tasks/corporate_governance/meta~1muse_spark_1_2` | | | | | | | | | [MMLU Pro / other](https://benchize.com/benchmarks/vals-ai%3Ammlu_pro%3Aother.md) | 84.96% | SE ±1.18 pp | 17 / 40 | $0.00837 | 35.06source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 84.957 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.00837 \| USD \| per_test \| Lower is better \| \| `latency` \| 35.056 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.18 pp sourcePopulation 138 stderr 1.183 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:46:06.503Z Evidence SHA-256 `dab025507f46c716dd8d145e90ec0a737d9c56219853f41e4b1cc3c5e8c222b4` Source locator `/tasks/other/meta~1muse_spark_1_2` | | | | | | | | | [Arena text style control / spanish](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Aspanish.md) | 1,489.42 | — | 10 / 134 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1489.4179115982597 \| rating \| reported \| Higher is better \| ### Configuration category spanish config text_style_control Reasoning effort xhigh thinkingEnabled true ### Reported statistics lower 1456.8935265935597 rank 10 upper 1521.9422966029597 variance 275.3734113288795 votes 308 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Muse Spark 1.2 (xHigh) Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/10774/row` | | | | | | | | | [MMLU Pro / engineering](https://benchize.com/benchmarks/vals-ai%3Ammlu_pro%3Aengineering.md) | 86.28% | SE ±1.11 pp | 15 / 40 | $0.03 | 105.17source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 86.275 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.029168 \| USD \| per_test \| Lower is better \| \| `latency` \| 105.172 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.11 pp sourcePopulation 138 stderr 1.105 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:46:06.503Z Evidence SHA-256 `dab025507f46c716dd8d145e90ec0a737d9c56219853f41e4b1cc3c5e8c222b4` Source locator `/tasks/engineering/meta~1muse_spark_1_2` | | | | | | | | | [MMLU Pro / psychology](https://benchize.com/benchmarks/vals-ai%3Ammlu_pro%3Apsychology.md) | 86.59% | SE ±1.21 pp | 20 / 40 | $0.00688 | 27.43source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 86.591 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.00688 \| USD \| per_test \| Lower is better \| \| `latency` \| 27.427 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.21 pp sourcePopulation 138 stderr 1.211 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:46:06.503Z Evidence SHA-256 `dab025507f46c716dd8d145e90ec0a737d9c56219853f41e4b1cc3c5e8c222b4` Source locator `/tasks/psychology/meta~1muse_spark_1_2` | | | | | | | | | [Legal Research Bench / weighted pass constitutional civil rights](https://benchize.com/benchmarks/vals-ai%3Alegal_research%3Aweighted_pass__constitutional_civil_rights.md) | 84.69% | SE ±4.06 pp | 24 / 50 | $0.43 | 275.61source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_research.DiuL0R8P.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 84.694 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.430216 \| USD \| per_test \| Lower is better \| \| `latency` \| 275.608 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±4.06 pp sourcePopulation 82 stderr 4.064 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_research.DiuL0R8P.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:45:52.389Z Evidence SHA-256 `26c58dfd47d0d2dc86f33c6d056f30309e0ee63570e7cd752c593b385f9d862e` Source locator `/tasks/weighted_pass__constitutional_civil_rights/meta~1muse_spark_1_2` | | | | | | | | | [EMB / overall](https://benchize.com/benchmarks/vals-ai%3Aemb%3Aoverall.md) | 56.98% | SE ±3.13 pp | 31 / 47 | $2.31 | 1,027.48source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_emb.BY1LXsAw.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 56.978 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 2.313636 \| USD \| per_test \| Lower is better \| \| `latency` \| 1027.476 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±3.13 pp sourcePopulation 76 stderr 3.127 tokenTotals {"cache_read_tokens":769467634,"cache_write_tokens":null,"input_tokens":829404547,"output_tokens":10741088,"reasoning_tokens":5180580} ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_emb.BY1LXsAw.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:45:57.495Z Evidence SHA-256 `d807aee620ea47152a1fca0257a8dd12a1be4512c76cc1744c1ae9e285180918` Source locator `/tasks/overall/meta~1muse_spark_1_2` | | | | | | | | | [Arena text / french](https://benchize.com/benchmarks/lmarena%3Atext%3Afrench.md) | 1,494.56 | — | 16 / 132 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1494.5609809969737 \| rating \| reported \| Higher is better \| ### Configuration category french config text Reasoning effort xhigh thinkingEnabled true ### Reported statistics lower 1461.674754892567 rank 18 upper 1527.4472071013802 variance 281.5346767649927 votes 352 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Muse Spark 1.2 (xHigh) Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/2855/row` | | | | | | | | | [Arena text / non english](https://benchize.com/benchmarks/lmarena%3Atext%3Anon_english.md) | 1,475.94 | — | 15 / 151 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1475.9411408552703 \| rating \| reported \| Higher is better \| ### Configuration category non_english config text Reasoning effort xhigh thinkingEnabled true ### Reported statistics lower 1467.4488626057855 rank 15 upper 1484.4334191047553 variance 18.773802670528752 votes 5780 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text/latest) Source Arena Original model label Muse Spark 1.2 (xHigh) Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `8e027ef69b8de06c4b2a8b217bfe816b1f1536269bb257fd295b4ef1ba8246ac` Source locator `/rows/9745/row` | | | | | | | | | [SRE Bench / overall](https://benchize.com/benchmarks/vals-ai%3Asrebench%3Aoverall.md) | 0% | SE ±0 pp | 23 / 24 | $23.43 | 5,986.8source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_sre_bench.Bd0uBJxH.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 0 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 23.427477 \| USD \| per_test \| Lower is better \| \| `latency` \| 5986.803 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0 pp sourcePopulation 35 stderr 0 tokenTotals {"cache_read_tokens":6263046809,"cache_write_tokens":0,"input_tokens":10247621050,"output_tokens":51252763,"reasoning_tokens":28954284} ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_sre_bench.Bd0uBJxH.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:46:15.724Z Evidence SHA-256 `a10b2c964f5878b0fc21c888703f311a5ef7d7a74fc3c529cab3ddd9fa474e2b` Source locator `/tasks/overall/meta~1muse_spark_1_2` | | | | | | | | | [EMB / comps](https://benchize.com/benchmarks/vals-ai%3Aemb%3Acomps.md) | 54.96% | SE ±8.78 pp | 29 / 47 | $2.87 | 1,114.73source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_emb.BY1LXsAw.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 54.957 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 2.865188 \| USD \| per_test \| Lower is better \| \| `latency` \| 1114.726 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±8.78 pp sourcePopulation 76 stderr 8.776 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_emb.BY1LXsAw.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:45:57.495Z Evidence SHA-256 `d807aee620ea47152a1fca0257a8dd12a1be4512c76cc1744c1ae9e285180918` Source locator `/tasks/comps/meta~1muse_spark_1_2` | | | | | | | | | [Arena text style control / math](https://benchize.com/benchmarks/lmarena%3Atext_style_control%3Amath.md) | 1,491.35 | — | 25 / 149 | — | — | [Arena](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1491.3525795860444 \| rating \| reported \| Higher is better \| ### Configuration category math config text_style_control Reasoning effort xhigh thinkingEnabled true ### Reported statistics lower 1465.246339226482 rank 28 upper 1517.4588199456064 variance 177.41587702040903 votes 484 ### Source [Original source](https://datasets-server.huggingface.co/parquet/lmarena-ai%2Fleaderboard-dataset/text_style_control/latest) Source Arena Original model label Muse Spark 1.2 (xHigh) Observed 2026-10-21T18:45:05.190Z Evidence SHA-256 `d4875c03cb7ec0c6e8943c3145fd261225e8841b937240dc62a3032c4a798d84` Source locator `/rows/8940/row` | | | | | | | | | [Harvey's Legal Agent Benchmark v1 / criteria pass rate arbitration international dispute resolution](https://benchize.com/benchmarks/vals-ai%3Ahlab-v1%3Acriteria_pass_rate__arbitration_international_dispute_resolution.md) | 96.06% | SE ±1.17 pp | 1 / 49 | $2.62 | 1,617.61source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 96.057 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 2.621978 \| USD \| per_test \| Lower is better \| \| `latency` \| 1617.612 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 131072 provider Meta reasoning Not reported Reasoning effort xhigh Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.17 pp sourcePopulation 81 stderr 1.167 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_agent_benchmark_v1.ZWRzZKcv.json) Source Vals AI Original model label meta/muse_spark_1_2 Source version 1 Observed 2026-10-21T16:45:53.909Z Evidence SHA-256 `65e7cd51e83066a42c9d782635dba5f2e9e1b189bd8118d3510cd17d2ddcba3f` Source locator `/tasks/criteria_pass_rate__arbitration_international_dispute_resolution/meta~1muse_spark_1_2` | | | | | | | | [Next page](https://benchize.com/models/muse-spark-1-2-xhigh.md?cursor=640475170c35f5382f96b6aa551337b1a779371ea7eb95f956de05da140e9c70) --- Cite as: Muse Spark 1.2Extra high — Benchize, https://benchize.com/models/muse-spark-1-2-xhigh (retrieved 2026-10-21)