# Mistral Large 3 2512 > Source: Benchize (https://benchize.com) — https://benchize.com/models/mistral-large-2512. When citing or reusing this content, credit "Benchize" and link to https://benchize.com/models/mistral-large-2512. Mistral Canonical URL: https://benchize.com/models/mistral-large-2512 Last updated: Wed, 21 Oct 2026 18:05:10 GMT Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations. Mistral ## Benchmarks | Benchmark | Score | ± | Rank | Cost | Latency | Source | | | --- | --- | --- | --- | --- | --- | --- | --- | | [MMLU Pro / other](https://benchize.com/benchmarks/vals-ai%3Ammlu_pro%3Aother.md) | 79.22% | SE ±1.63 pp | 30 / 40 | $0.000929 | 8.96source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 79.221 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.000929 \| USD \| per_test \| Lower is better \| \| `latency` \| 8.956 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.63 pp sourcePopulation 138 stderr 1.632 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:06.503Z Evidence SHA-256 `dab025507f46c716dd8d145e90ec0a737d9c56219853f41e4b1cc3c5e8c222b4` Source locator `/tasks/other/mistralai~1mistral-large-2512` | | | | | | | | | [MedQA / hispanic](https://benchize.com/benchmarks/vals-ai%3Amedqa%3Ahispanic.md) | 82.75% | SE ±0.85 pp | 7 / 12 | $0.000768 | 17.95source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_medqa.Cco1kvog.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 82.75 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.000768 \| USD \| per_test \| Lower is better \| \| `latency` \| 17.954 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.85 pp sourcePopulation 95 stderr 0.845 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_medqa.Cco1kvog.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:00.691Z Evidence SHA-256 `d67905978d932f64698ebe9e230d9519e5bae1c9d7176dda8379dc3874b6f90f` Source locator `/tasks/hispanic/mistralai~1mistral-large-2512` | | | | | | | | | [LegalBench / conclusion tasks](https://benchize.com/benchmarks/vals-ai%3Alegal_bench%3Aconclusion_tasks.md) | 81.03% | SE ±1 pp | 41 / 44 | $0.000225 | 0.79source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_bench.D6uTgA3b.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 81.032 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.000225 \| USD \| per_test \| Lower is better \| \| `latency` \| 0.793 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1 pp sourcePopulation 151 stderr 1.001 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_bench.D6uTgA3b.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:45:53.390Z Evidence SHA-256 `c8486ba756baa5cd3955d035edff67440e8db23e69d62ad1a9e18d15b8c4bc52` Source locator `/tasks/conclusion_tasks/mistralai~1mistral-large-2512` | | | | | | | | | [DesignArena SVG generation](https://benchize.com/benchmarks/designarena%3Asvgs.md) | 993elo | — | 73 / 77 | — | — | [designarena · public](https://www.designarena.ai/api/leaderboard#board=svgs) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 993 \| elo \| svgs \| Higher is better \| ### Configuration arenaType models category svg inputModality Not reported sourceModelVersion mistral-large-2512 variationName public ### Reported statistics averageGenerationTimeMs 24992 battles 4910 losses 3044 standardError Not reported winRate 38 wins 1866 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=svgs) Source designarena Original model label Mistral Large 3 (2512) Source version public Observed 2026-10-21T16:38:03.249Z Evidence SHA-256 `8cbc34a474a66ef5c64f3ffe557df9b55bf7e13368c07c0214223e3ed8f3f21e` Source locator `/data/116` | | | | | | | | | [MMLU Pro / law](https://benchize.com/benchmarks/vals-ai%3Ammlu_pro%3Alaw.md) | 56.4% | SE ±1.31 pp | 34 / 40 | $0.0016 | 17.01source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 56.403 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.001604 \| USD \| per_test \| Lower is better \| \| `latency` \| 17.014 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.31 pp sourcePopulation 138 stderr 1.306 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:06.503Z Evidence SHA-256 `dab025507f46c716dd8d145e90ec0a737d9c56219853f41e4b1cc3c5e8c222b4` Source locator `/tasks/law/mistralai~1mistral-large-2512` | | | | | | | | | [DesignArena UI component generation](https://benchize.com/benchmarks/designarena%3Aui-components.md) | 1,102elo | — | 83 / 112 | — | — | [designarena · public](https://www.designarena.ai/api/leaderboard#board=ui-components) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 1102 \| elo \| ui-components \| Higher is better \| ### Configuration arenaType models category uicomponent inputModality Not reported sourceModelVersion mistral-large-2512 variationName public ### Reported statistics averageGenerationTimeMs 75406 battles 1735 losses 988 standardError Not reported winRate 43 wins 747 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=ui-components) Source designarena Original model label Mistral Large 3 (2512) Source version public Observed 2026-10-21T16:37:57.993Z Evidence SHA-256 `46482ec1b4012638eace65493daea4750e2088098018fd9d5fc46126fc1f8557` Source locator `/data/124` | | | | | | | | | [SWE-bench / 15 min - 1 hour](https://benchize.com/benchmarks/vals-ai%3Aswebench%3A15%20min%20-%201%20hour.md) | 36.4% | SE ±2.98 pp | 38 / 39 | $0.39 | 208.78source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_swebench.Ae8ni7h0.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 36.398 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.385336 \| USD \| per_test \| Lower is better \| \| `latency` \| 208.783 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±2.98 pp sourcePopulation 88 stderr 2.984 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_swebench.Ae8ni7h0.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:13.711Z Evidence SHA-256 `7a4e2e8485283caac500127419f68ec4bd5414c837ade114fc6afa5b2d34ccaa` Source locator `/tasks/15 min - 1 hour/mistralai~1mistral-large-2512` | | | | | | | | | [DesignArena Website generation](https://benchize.com/benchmarks/designarena%3Awebsite.md) | 1,162elo | — | 81 / 123 | — | — | [designarena · public](https://www.designarena.ai/api/leaderboard#board=website) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 1162 \| elo \| website \| Higher is better \| ### Configuration arenaType models category website inputModality text sourceModelVersion mistral-large-2512 variationName public ### Reported statistics averageGenerationTimeMs 122337 battles 19081 losses 9640 standardError Not reported winRate 49.5 wins 9441 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=website) Source designarena Original model label Mistral Large 3 (2512) Source version public Observed 2026-10-21T16:37:57.757Z Evidence SHA-256 `51873e97776a3c5ae706b24cc2c60384793dd18398df970e213a8e7c276d8ac0` Source locator `/data/118` | | | | | | | | | [MGSM / mgsm en](https://benchize.com/benchmarks/vals-ai%3Amgsm%3Amgsm_en.md) | 98.4% | SE ±0.79 pp | 3 / 8 | $0.000383 | 5.29source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_mgsm.CneCP-rm.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 98.4 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.000383 \| USD \| per_test \| Lower is better \| \| `latency` \| 5.293 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.79 pp sourcePopulation 75 stderr 0.794 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_mgsm.CneCP-rm.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:02.976Z Evidence SHA-256 `1b87f953e52c00bf4bdd90c3add26165f644eeb7a74a8382d2a0324ff0cc1040` Source locator `/tasks/mgsm_en/mistralai~1mistral-large-2512` | | | | | | | | | [Terminal-Bench 2.0 / hard](https://benchize.com/benchmarks/vals-ai%3Aterminal-bench-2%3Ahard.md) | 0% | SE ±0 pp | 23 / 23 | $0.09 | 3,501.56source duration | [Vals AI · 2.0](https://www.vals.ai/_astro/benchmark_view_terminal_bench_2.T48tPR4O.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 0 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.090431 \| USD \| per_test \| Lower is better \| \| `latency` \| 3501.563 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0 pp sourcePopulation 67 stderr 0 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_terminal_bench_2.T48tPR4O.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 2.0 Observed 2026-10-21T16:46:14.732Z Evidence SHA-256 `38e640d995259778e531f048b2f2c7b3b281cb05b56be643ddc9dc53eb85adf7` Source locator `/tasks/hard/mistralai~1mistral-large-2512` | | | | | | | | | [DesignArena Data visualization generation](https://benchize.com/benchmarks/designarena%3Adata-viz.md) | 1,136elo | — | 75 / 99 | — | — | [designarena · public](https://www.designarena.ai/api/leaderboard#board=data-viz) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 1136 \| elo \| data-viz \| Higher is better \| ### Configuration arenaType models category dataviz inputModality Not reported sourceModelVersion mistral-large-2512 variationName public ### Reported statistics averageGenerationTimeMs 105334 battles 1091 losses 592 standardError Not reported winRate 45.7 wins 499 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=data-viz) Source designarena Original model label Mistral Large 3 (2512) Source version public Observed 2026-10-21T16:37:58.264Z Evidence SHA-256 `a895f6f1a25fa8eb01f821c2097ddec4f884de7bd22f1b8a22e82e6679b71849` Source locator `/data/112` | | | | | | | | | [MMLU Pro / computer science](https://benchize.com/benchmarks/vals-ai%3Ammlu_pro%3Acomputer_science.md) | 83.17% | SE ±2.25 pp | 32 / 40 | $0.00154 | 11.87source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 83.171 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.00154 \| USD \| per_test \| Lower is better \| \| `latency` \| 11.872 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±2.25 pp sourcePopulation 138 stderr 2.247 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:06.503Z Evidence SHA-256 `dab025507f46c716dd8d145e90ec0a737d9c56219853f41e4b1cc3c5e8c222b4` Source locator `/tasks/computer_science/mistralai~1mistral-large-2512` | | | | | | | | | [MGSM / mgsm zh](https://benchize.com/benchmarks/vals-ai%3Amgsm%3Amgsm_zh.md) | 91.6% | SE ±1.75 pp | 2 / 8 | $0.000468 | 6.27source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_mgsm.CneCP-rm.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 91.6 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.000468 \| USD \| per_test \| Lower is better \| \| `latency` \| 6.266 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.75 pp sourcePopulation 75 stderr 1.754 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_mgsm.CneCP-rm.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:02.976Z Evidence SHA-256 `1b87f953e52c00bf4bdd90c3add26165f644eeb7a74a8382d2a0324ff0cc1040` Source locator `/tasks/mgsm_zh/mistralai~1mistral-large-2512` | | | | | | | | | [Terminal-Bench 2.0 / easy](https://benchize.com/benchmarks/vals-ai%3Aterminal-bench-2%3Aeasy.md) | 50% | SE ±28.87 pp | 17 / 23 | $0.68 | 26,261.72source duration | [Vals AI · 2.0](https://www.vals.ai/_astro/benchmark_view_terminal_bench_2.T48tPR4O.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 50 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.678233 \| USD \| per_test \| Lower is better \| \| `latency` \| 26261.72 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±28.87 pp sourcePopulation 67 stderr 28.868 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_terminal_bench_2.T48tPR4O.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 2.0 Observed 2026-10-21T16:46:14.732Z Evidence SHA-256 `38e640d995259778e531f048b2f2c7b3b281cb05b56be643ddc9dc53eb85adf7` Source locator `/tasks/easy/mistralai~1mistral-large-2512` | | | | | | | | | [MGSM / mgsm ru](https://benchize.com/benchmarks/vals-ai%3Amgsm%3Amgsm_ru.md) | 94.4% | SE ±1.45 pp | 4 / 8 | $0.000419 | 6.15source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_mgsm.CneCP-rm.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 94.4 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.000419 \| USD \| per_test \| Lower is better \| \| `latency` \| 6.148 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.45 pp sourcePopulation 75 stderr 1.454 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_mgsm.CneCP-rm.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:02.976Z Evidence SHA-256 `1b87f953e52c00bf4bdd90c3add26165f644eeb7a74a8382d2a0324ff0cc1040` Source locator `/tasks/mgsm_ru/mistralai~1mistral-large-2512` | | | | | | | | | [LiveCodeBench / medium](https://benchize.com/benchmarks/vals-ai%3Alcb%3Amedium.md) | 53.53% | SE ±2.55 pp | 39 / 43 | $0.00193 | 25.39source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_lcb.miyRUvVa.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 53.525 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.001931 \| USD \| per_test \| Lower is better \| \| `latency` \| 25.394 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±2.55 pp sourcePopulation 143 stderr 2.549 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_lcb.miyRUvVa.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:14.220Z Evidence SHA-256 `1a7c7dabc9d95a0182886b1edc42623987cac2095a0d407a5e334f37acdfa2f5` Source locator `/tasks/medium/mistralai~1mistral-large-2512` | | | | | | | | | [Terminal-Bench 2.0 / overall](https://benchize.com/benchmarks/vals-ai%3Aterminal-bench-2%3Aoverall.md) | 8.99% | SE ±3.05 pp | 22 / 23 | $0.03 | 1,180.3source duration | [Vals AI · 2.0](https://www.vals.ai/_astro/benchmark_view_terminal_bench_2.T48tPR4O.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 8.989 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.030482 \| USD \| per_test \| Lower is better \| \| `latency` \| 1180.302 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±3.05 pp sourcePopulation 67 stderr 3.049 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_terminal_bench_2.T48tPR4O.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 2.0 Observed 2026-10-21T16:46:14.732Z Evidence SHA-256 `38e640d995259778e531f048b2f2c7b3b281cb05b56be643ddc9dc53eb85adf7` Source locator `/tasks/overall/mistralai~1mistral-large-2512` | | | | | | | | | [SWE-bench / <15 min fix](https://benchize.com/benchmarks/vals-ai%3Aswebench%3A%3C15%20min%20fix.md) | 56.19% | SE ±3.57 pp | 38 / 39 | $0.23 | 150.6source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_swebench.Ae8ni7h0.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 56.186 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.229311 \| USD \| per_test \| Lower is better \| \| `latency` \| 150.597 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±3.57 pp sourcePopulation 88 stderr 3.571 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_swebench.Ae8ni7h0.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:13.711Z Evidence SHA-256 `7a4e2e8485283caac500127419f68ec4bd5414c837ade114fc6afa5b2d34ccaa` Source locator `/tasks/<15 min fix/mistralai~1mistral-large-2512` | | | | | | | | | [MortgageTax / numerical extraction](https://benchize.com/benchmarks/vals-ai%3Amortgage_tax%3Anumerical_extraction.md) | 50% | SE ±1.41 pp | 30 / 31 | $0.00326 | 9.87source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_mortgage_tax.DCd-oO5Y.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 50 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.003256 \| USD \| per_test \| Lower is better \| \| `latency` \| 9.865 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.41 pp sourcePopulation 98 stderr 1.41 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_mortgage_tax.DCd-oO5Y.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:45:58.500Z Evidence SHA-256 `e5c844561f97d119d66d70269e726ecfb68be79eae39acf14ead3e95422e648c` Source locator `/tasks/numerical_extraction/mistralai~1mistral-large-2512` | | | | | | | | | [CaseLaw v2 / overall](https://benchize.com/benchmarks/vals-ai%3Acase_law_v2%3Aoverall.md) | 61.42% | SE ±0.97 pp | 7 / 17 | $0.02 | 40.84source duration | [Vals AI · 2](https://www.vals.ai/_astro/benchmark_view_case_law_v2.DLKA06_7.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 61.415 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.018968 \| USD \| per_test \| Lower is better \| \| `latency` \| 40.839 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.97 pp sourcePopulation 54 stderr 0.965 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_case_law_v2.DLKA06_7.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 2 Observed 2026-10-21T16:45:54.497Z Evidence SHA-256 `293f388f7e0fe563287d4cd19beaa7ef9821b32795dace34bd0197ed47a592d4` Source locator `/tasks/overall/mistralai~1mistral-large-2512` | | | | | | | | | [AIME / overall](https://benchize.com/benchmarks/vals-ai%3Aaime%3Aoverall.md) | 42.92% | SE ±0.88 pp | 9 / 14 | $0.00609 | 104.33source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_aime.C3_jItdR.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 42.917 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.006086 \| USD \| per_test \| Lower is better \| \| `latency` \| 104.325 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens Not reported provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.88 pp sourcePopulation 96 stderr 0.884 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_aime.C3_jItdR.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:01.920Z Evidence SHA-256 `7d016210b39d24351bbb5d12be09a973decac461bb2486eb1f23724fed2b7e6c` Source locator `/tasks/overall/mistralai~1mistral-large-2512` | | | | | | | | | [MMLU Pro / biology](https://benchize.com/benchmarks/vals-ai%3Ammlu_pro%3Abiology.md) | 88.56% | SE ±1.87 pp | 32 / 40 | $0.00139 | 12.47source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 88.563 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.001387 \| USD \| per_test \| Lower is better \| \| `latency` \| 12.468 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.87 pp sourcePopulation 138 stderr 1.865 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:06.503Z Evidence SHA-256 `dab025507f46c716dd8d145e90ec0a737d9c56219853f41e4b1cc3c5e8c222b4` Source locator `/tasks/biology/mistralai~1mistral-large-2512` | | | | | | | | | [SWE-bench / 1-4 hours](https://benchize.com/benchmarks/vals-ai%3Aswebench%3A1-4%20hours.md) | 4.76% | SE ±3.33 pp | 38 / 39 | $0.34 | 216.75source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_swebench.Ae8ni7h0.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 4.762 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.33932 \| USD \| per_test \| Lower is better \| \| `latency` \| 216.75 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±3.33 pp sourcePopulation 88 stderr 3.326 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_swebench.Ae8ni7h0.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:13.711Z Evidence SHA-256 `7a4e2e8485283caac500127419f68ec4bd5414c837ade114fc6afa5b2d34ccaa` Source locator `/tasks/1-4 hours/mistralai~1mistral-large-2512` | | | | | | | | | [SWE-bench / >4 hours](https://benchize.com/benchmarks/vals-ai%3Aswebench%3A%3E4%20hours.md) | 33.33% | SE ±33.33 pp | 13 / 39 | $0.51 | 221.86source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_swebench.Ae8ni7h0.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 33.333 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.507432 \| USD \| per_test \| Lower is better \| \| `latency` \| 221.861 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±33.33 pp sourcePopulation 88 stderr 33.333 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_swebench.Ae8ni7h0.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:13.711Z Evidence SHA-256 `7a4e2e8485283caac500127419f68ec4bd5414c837ade114fc6afa5b2d34ccaa` Source locator `/tasks/>4 hours/mistralai~1mistral-large-2512` | | | | | | | | | [CorpFin v2 / shared max context](https://benchize.com/benchmarks/vals-ai%3Acorp_fin_v2%3Ashared_max_context.md) | 59.56% | SE ±1.68 pp | 31 / 39 | $0.04 | 73.14source duration | [Vals AI · 2](https://www.vals.ai/_astro/benchmark_view_corp_fin_v2.CectKwl1.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 59.557 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.035322 \| USD \| per_test \| Lower is better \| \| `latency` \| 73.135 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.68 pp sourcePopulation 134 stderr 1.675 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_corp_fin_v2.CectKwl1.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 2 Observed 2026-10-21T16:45:57.998Z Evidence SHA-256 `7cf2217ab3728d5a84bffce82aab9fc52d7f810b0cbe8c65b387df47f3d31c9b` Source locator `/tasks/shared_max_context/mistralai~1mistral-large-2512` | | | | | | | | | [Terminal-Bench 2.0 / medium](https://benchize.com/benchmarks/vals-ai%3Aterminal-bench-2%3Amedium.md) | 10.91% | SE ±4.24 pp | 22 / 23 | $0.05 | 1,909.94source duration | [Vals AI · 2.0](https://www.vals.ai/_astro/benchmark_view_terminal_bench_2.T48tPR4O.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 10.909 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.049326 \| USD \| per_test \| Lower is better \| \| `latency` \| 1909.943 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±4.24 pp sourcePopulation 67 stderr 4.242 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_terminal_bench_2.T48tPR4O.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 2.0 Observed 2026-10-21T16:46:14.732Z Evidence SHA-256 `38e640d995259778e531f048b2f2c7b3b281cb05b56be643ddc9dc53eb85adf7` Source locator `/tasks/medium/mistralai~1mistral-large-2512` | | | | | | | | | [AIME / aime 2024](https://benchize.com/benchmarks/vals-ai%3Aaime%3Aaime_2024.md) | 54.58% | SE ±0.61 pp | 9 / 14 | $0.00586 | 101.85source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_aime.C3_jItdR.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 54.583 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.005864 \| USD \| per_test \| Lower is better \| \| `latency` \| 101.853 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens Not reported provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.61 pp sourcePopulation 96 stderr 0.61 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_aime.C3_jItdR.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:01.920Z Evidence SHA-256 `7d016210b39d24351bbb5d12be09a973decac461bb2486eb1f23724fed2b7e6c` Source locator `/tasks/aime_2024/mistralai~1mistral-large-2512` | | | | | | | | | [LiveCodeBench / overall](https://benchize.com/benchmarks/vals-ai%3Alcb%3Aoverall.md) | 55.34% | SE ±1.15 pp | 39 / 43 | $0.00222 | 28.89source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_lcb.miyRUvVa.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 55.337 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.002215 \| USD \| per_test \| Lower is better \| \| `latency` \| 28.888 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.15 pp sourcePopulation 143 stderr 1.152 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_lcb.miyRUvVa.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:14.220Z Evidence SHA-256 `1a7c7dabc9d95a0182886b1edc42623987cac2095a0d407a5e334f37acdfa2f5` Source locator `/tasks/overall/mistralai~1mistral-large-2512` | | | | | | | | | [MGSM / mgsm de](https://benchize.com/benchmarks/vals-ai%3Amgsm%3Amgsm_de.md) | 92% | SE ±1.72 pp | 4 / 8 | $0.000408 | 5.93source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_mgsm.CneCP-rm.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 92 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.000408 \| USD \| per_test \| Lower is better \| \| `latency` \| 5.931 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.72 pp sourcePopulation 75 stderr 1.716 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_mgsm.CneCP-rm.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:02.976Z Evidence SHA-256 `1b87f953e52c00bf4bdd90c3add26165f644eeb7a74a8382d2a0324ff0cc1040` Source locator `/tasks/mgsm_de/mistralai~1mistral-large-2512` | | | | | | | | | [MMLU Pro / economics](https://benchize.com/benchmarks/vals-ai%3Ammlu_pro%3Aeconomics.md) | 85.78% | SE ±1.66 pp | 30 / 40 | $0.00126 | 11.55source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 85.782 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.001255 \| USD \| per_test \| Lower is better \| \| `latency` \| 11.545 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.66 pp sourcePopulation 138 stderr 1.662 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:06.503Z Evidence SHA-256 `dab025507f46c716dd8d145e90ec0a737d9c56219853f41e4b1cc3c5e8c222b4` Source locator `/tasks/economics/mistralai~1mistral-large-2512` | | | | | | | | | [GPQA Diamond / diamond few shot cot](https://benchize.com/benchmarks/vals-ai%3Agpqa%3Adiamond_few_shot_cot.md) | 64.14% | SE ±3.32 pp | 31 / 40 | $0.00263 | 21.8source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_gpqa.ghZZBpyU.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 64.141 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.002625 \| USD \| per_test \| Lower is better \| \| `latency` \| 21.802 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±3.32 pp sourcePopulation 138 stderr 3.324 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_gpqa.ghZZBpyU.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:06.040Z Evidence SHA-256 `951eb5224097733a9d09d06c14908ae2980e2e640e539f2c284877c5092d7077` Source locator `/tasks/diamond_few_shot_cot/mistralai~1mistral-large-2512` | | | | | | | | | [LiveCodeBench / hard](https://benchize.com/benchmarks/vals-ai%3Alcb%3Ahard.md) | 17.14% | SE ±2.02 pp | 39 / 43 | $0.00396 | 53.16source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_lcb.miyRUvVa.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 17.143 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.003963 \| USD \| per_test \| Lower is better \| \| `latency` \| 53.158 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±2.02 pp sourcePopulation 143 stderr 2.015 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_lcb.miyRUvVa.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:14.220Z Evidence SHA-256 `1a7c7dabc9d95a0182886b1edc42623987cac2095a0d407a5e334f37acdfa2f5` Source locator `/tasks/hard/mistralai~1mistral-large-2512` | | | | | | | | | [MGSM / mgsm th](https://benchize.com/benchmarks/vals-ai%3Amgsm%3Amgsm_th.md) | 92.4% | SE ±1.68 pp | 3 / 8 | $0.000532 | 8.05source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_mgsm.CneCP-rm.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 92.4 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.000532 \| USD \| per_test \| Lower is better \| \| `latency` \| 8.05 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.68 pp sourcePopulation 75 stderr 1.676 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_mgsm.CneCP-rm.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:02.976Z Evidence SHA-256 `1b87f953e52c00bf4bdd90c3add26165f644eeb7a74a8382d2a0324ff0cc1040` Source locator `/tasks/mgsm_th/mistralai~1mistral-large-2512` | | | | | | | | | [MedQA / indigenous](https://benchize.com/benchmarks/vals-ai%3Amedqa%3Aindigenous.md) | 81.75% | SE ±0.86 pp | 7 / 12 | $0.000807 | 17.58source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_medqa.Cco1kvog.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 81.75 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.000807 \| USD \| per_test \| Lower is better \| \| `latency` \| 17.583 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.86 pp sourcePopulation 95 stderr 0.864 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_medqa.Cco1kvog.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:00.691Z Evidence SHA-256 `d67905978d932f64698ebe9e230d9519e5bae1c9d7176dda8379dc3874b6f90f` Source locator `/tasks/indigenous/mistralai~1mistral-large-2512` | | | | | | | | | [MMLU Pro / engineering](https://benchize.com/benchmarks/vals-ai%3Ammlu_pro%3Aengineering.md) | 74.92% | SE ±1.6 pp | 32 / 40 | $0.00249 | 26.84source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 74.923 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.002489 \| USD \| per_test \| Lower is better \| \| `latency` \| 26.843 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.6 pp sourcePopulation 138 stderr 1.595 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:06.503Z Evidence SHA-256 `dab025507f46c716dd8d145e90ec0a737d9c56219853f41e4b1cc3c5e8c222b4` Source locator `/tasks/engineering/mistralai~1mistral-large-2512` | | | | | | | | | [LegalBench / rule tasks](https://benchize.com/benchmarks/vals-ai%3Alegal_bench%3Arule_tasks.md) | 79.13% | SE ±1.5 pp | 25 / 44 | $0.000344 | 5.15source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_bench.D6uTgA3b.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 79.13 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.000344 \| USD \| per_test \| Lower is better \| \| `latency` \| 5.148 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.5 pp sourcePopulation 151 stderr 1.496 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_bench.D6uTgA3b.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:45:53.390Z Evidence SHA-256 `c8486ba756baa5cd3955d035edff67440e8db23e69d62ad1a9e18d15b8c4bc52` Source locator `/tasks/rule_tasks/mistralai~1mistral-large-2512` | | | | | | | | | [MedQA / black](https://benchize.com/benchmarks/vals-ai%3Amedqa%3Ablack.md) | 81.85% | SE ±0.86 pp | 8 / 12 | $0.000783 | 17.94source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_medqa.Cco1kvog.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 81.85 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.000783 \| USD \| per_test \| Lower is better \| \| `latency` \| 17.944 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.86 pp sourcePopulation 95 stderr 0.862 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_medqa.Cco1kvog.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:00.691Z Evidence SHA-256 `d67905978d932f64698ebe9e230d9519e5bae1c9d7176dda8379dc3874b6f90f` Source locator `/tasks/black/mistralai~1mistral-large-2512` | | | | | | | | | [GPQA Diamond / diamond zero shot cot](https://benchize.com/benchmarks/vals-ai%3Agpqa%3Adiamond_zero_shot_cot.md) | 72.73% | SE ±3.39 pp | 31 / 40 | $0.00168 | 20.63source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_gpqa.ghZZBpyU.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 72.727 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.001675 \| USD \| per_test \| Lower is better \| \| `latency` \| 20.631 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±3.39 pp sourcePopulation 138 stderr 3.386 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_gpqa.ghZZBpyU.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:06.040Z Evidence SHA-256 `951eb5224097733a9d09d06c14908ae2980e2e640e539f2c284877c5092d7077` Source locator `/tasks/diamond_zero_shot_cot/mistralai~1mistral-large-2512` | | | | | | | | | [DesignArena ASCII art generation](https://benchize.com/benchmarks/designarena%3Aascii.md) | 1,069elo | — | 60 / 65 | — | — | [designarena · public](https://www.designarena.ai/api/leaderboard#board=ascii) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 1069 \| elo \| ascii \| Higher is better \| ### Configuration arenaType models category ascii inputModality Not reported sourceModelVersion mistral-large-2512 variationName public ### Reported statistics averageGenerationTimeMs 65243 battles 340 losses 203 standardError Not reported winRate 40.3 wins 137 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=ascii) Source designarena Original model label Mistral Large 3 (2512) Source version public Observed 2026-10-21T16:38:03.513Z Evidence SHA-256 `0603b8c65b44ee887f5b566feb469465f59635137a6ac5c6d94c23bcf3776311` Source locator `/data/85` | | | | | | | | | [MMLU Pro / philosophy](https://benchize.com/benchmarks/vals-ai%3Ammlu_pro%3Aphilosophy.md) | 76.35% | SE ±2.17 pp | 30 / 40 | $0.00103 | 9.98source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 76.353 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.001026 \| USD \| per_test \| Lower is better \| \| `latency` \| 9.977 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±2.17 pp sourcePopulation 138 stderr 2.169 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:06.503Z Evidence SHA-256 `dab025507f46c716dd8d145e90ec0a737d9c56219853f41e4b1cc3c5e8c222b4` Source locator `/tasks/philosophy/mistralai~1mistral-large-2512` | | | | | | | | | [TaxEval v2 / correctness](https://benchize.com/benchmarks/vals-ai%3Atax_eval_v2%3Acorrectness.md) | 61.57% | SE ±1.39 pp | 24 / 40 | $0.0016 | 29.53source duration | [Vals AI · 2](https://www.vals.ai/_astro/benchmark_view_tax_eval_v2.B3yoffr8.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 61.57 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.001601 \| USD \| per_test \| Lower is better \| \| `latency` \| 29.531 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.39 pp sourcePopulation 145 stderr 1.391 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_tax_eval_v2.B3yoffr8.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 2 Observed 2026-10-21T16:45:59.000Z Evidence SHA-256 `8b354a6ae848f5bb25a2e8b061b5f576d5b9e0c11b941dc1e6bed078e6529cd6` Source locator `/tasks/correctness/mistralai~1mistral-large-2512` | | | | | | | | | [MortgageTax / overall](https://benchize.com/benchmarks/vals-ai%3Amortgage_tax%3Aoverall.md) | 52.11% | SE ±1 pp | 30 / 31 | $0.00323 | 9.29source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_mortgage_tax.DCd-oO5Y.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 52.106 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.003226 \| USD \| per_test \| Lower is better \| \| `latency` \| 9.292 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1 pp sourcePopulation 98 stderr 0.995 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_mortgage_tax.DCd-oO5Y.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:45:58.500Z Evidence SHA-256 `e5c844561f97d119d66d70269e726ecfb68be79eae39acf14ead3e95422e648c` Source locator `/tasks/overall/mistralai~1mistral-large-2512` | | | | | | | | | [MedQA / unbiased](https://benchize.com/benchmarks/vals-ai%3Amedqa%3Aunbiased.md) | 82.2% | SE ±0.86 pp | 8 / 12 | $0.000726 | 14.75source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_medqa.Cco1kvog.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 82.2 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.000726 \| USD \| per_test \| Lower is better \| \| `latency` \| 14.75 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.86 pp sourcePopulation 95 stderr 0.855 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_medqa.Cco1kvog.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:00.691Z Evidence SHA-256 `d67905978d932f64698ebe9e230d9519e5bae1c9d7176dda8379dc3874b6f90f` Source locator `/tasks/unbiased/mistralai~1mistral-large-2512` | | | | | | | | | [SAGE / linear algebra](https://benchize.com/benchmarks/vals-ai%3Asage%3Alinear_algebra.md) | 44.42% | SE ±5.58 pp | 37 / 41 | $0.00973 | 49.23source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_sage.RRwIIzO5.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 44.419 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.009728 \| USD \| per_test \| Lower is better \| \| `latency` \| 49.23 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 30000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±5.58 pp sourcePopulation 91 stderr 5.581 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_sage.RRwIIzO5.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:07.515Z Evidence SHA-256 `cc5fb3fecdb0382d492ff167a42ad84b9c5c3883373c78ed87baaa972b8b6f7c` Source locator `/tasks/linear_algebra/mistralai~1mistral-large-2512` | | | | | | | | | [CorpFin v2 / overall](https://benchize.com/benchmarks/vals-ai%3Acorp_fin_v2%3Aoverall.md) | 61.03% | SE ±0.96 pp | 24 / 39 | $0.02 | 48.84source duration | [Vals AI · 2](https://www.vals.ai/_astro/benchmark_view_corp_fin_v2.CectKwl1.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 61.033 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.024166 \| USD \| per_test \| Lower is better \| \| `latency` \| 48.842 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.96 pp sourcePopulation 134 stderr 0.96 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_corp_fin_v2.CectKwl1.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 2 Observed 2026-10-21T16:45:57.998Z Evidence SHA-256 `7cf2217ab3728d5a84bffce82aab9fc52d7f810b0cbe8c65b387df47f3d31c9b` Source locator `/tasks/overall/mistralai~1mistral-large-2512` | | | | | | | | | [LegalBench / rhetoric tasks](https://benchize.com/benchmarks/vals-ai%3Alegal_bench%3Arhetoric_tasks.md) | 77.93% | SE ±1.24 pp | 34 / 44 | $0.000427 | 0.89source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_bench.D6uTgA3b.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 77.926 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.000427 \| USD \| per_test \| Lower is better \| \| `latency` \| 0.886 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.24 pp sourcePopulation 151 stderr 1.238 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_bench.D6uTgA3b.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:45:53.390Z Evidence SHA-256 `c8486ba756baa5cd3955d035edff67440e8db23e69d62ad1a9e18d15b8c4bc52` Source locator `/tasks/rhetoric_tasks/mistralai~1mistral-large-2512` | | | | | | | | | [MMLU Pro / math](https://benchize.com/benchmarks/vals-ai%3Ammlu_pro%3Amath.md) | 88.38% | SE ±1.23 pp | 34 / 40 | $0.00191 | 15.54source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 88.379 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.001912 \| USD \| per_test \| Lower is better \| \| `latency` \| 15.539 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.23 pp sourcePopulation 138 stderr 1.232 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:06.503Z Evidence SHA-256 `dab025507f46c716dd8d145e90ec0a737d9c56219853f41e4b1cc3c5e8c222b4` Source locator `/tasks/math/mistralai~1mistral-large-2512` | | | | | | | | | [MGSM / mgsm es](https://benchize.com/benchmarks/vals-ai%3Amgsm%3Amgsm_es.md) | 94% | SE ±1.5 pp | 2 / 8 | $0.00041 | 9.1source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_mgsm.CneCP-rm.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 94 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.00041 \| USD \| per_test \| Lower is better \| \| `latency` \| 9.102 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.5 pp sourcePopulation 75 stderr 1.502 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_mgsm.CneCP-rm.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:02.976Z Evidence SHA-256 `1b87f953e52c00bf4bdd90c3add26165f644eeb7a74a8382d2a0324ff0cc1040` Source locator `/tasks/mgsm_es/mistralai~1mistral-large-2512` | | | | | | | | | [MedQA / white](https://benchize.com/benchmarks/vals-ai%3Amedqa%3Awhite.md) | 82.8% | SE ±0.84 pp | 7 / 12 | $0.000771 | 17.68source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_medqa.Cco1kvog.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 82.8 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.000771 \| USD \| per_test \| Lower is better \| \| `latency` \| 17.683 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.84 pp sourcePopulation 95 stderr 0.844 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_medqa.Cco1kvog.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:00.691Z Evidence SHA-256 `d67905978d932f64698ebe9e230d9519e5bae1c9d7176dda8379dc3874b6f90f` Source locator `/tasks/white/mistralai~1mistral-large-2512` | | | | | | | | | [LiveCodeBench / easy](https://benchize.com/benchmarks/vals-ai%3Alcb%3Aeasy.md) | 95.34% | SE ±1.17 pp | 39 / 43 | $0.00075 | 8.11source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_lcb.miyRUvVa.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 95.342 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.00075 \| USD \| per_test \| Lower is better \| \| `latency` \| 8.113 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.17 pp sourcePopulation 143 stderr 1.174 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_lcb.miyRUvVa.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:14.220Z Evidence SHA-256 `1a7c7dabc9d95a0182886b1edc42623987cac2095a0d407a5e334f37acdfa2f5` Source locator `/tasks/easy/mistralai~1mistral-large-2512` | | | | | | | | | [SAGE / PDEs](https://benchize.com/benchmarks/vals-ai%3Asage%3APDEs.md) | 17.46% | SE ±4.76 pp | 40 / 41 | $0.00627 | 53.01source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_sage.RRwIIzO5.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 17.46 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.006272 \| USD \| per_test \| Lower is better \| \| `latency` \| 53.013 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 30000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±4.76 pp sourcePopulation 91 stderr 4.764 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_sage.RRwIIzO5.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:07.515Z Evidence SHA-256 `cc5fb3fecdb0382d492ff167a42ad84b9c5c3883373c78ed87baaa972b8b6f7c` Source locator `/tasks/PDEs/mistralai~1mistral-large-2512` | | | | | | | | | [MGSM / mgsm sw](https://benchize.com/benchmarks/vals-ai%3Amgsm%3Amgsm_sw.md) | 87.6% | SE ±2.08 pp | 6 / 8 | $0.000407 | 7.23source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_mgsm.CneCP-rm.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 87.6 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.000407 \| USD \| per_test \| Lower is better \| \| `latency` \| 7.226 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±2.08 pp sourcePopulation 75 stderr 2.084 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_mgsm.CneCP-rm.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:02.976Z Evidence SHA-256 `1b87f953e52c00bf4bdd90c3add26165f644eeb7a74a8382d2a0324ff0cc1040` Source locator `/tasks/mgsm_sw/mistralai~1mistral-large-2512` | | | | | | | | | [SVGBench Arena](https://benchize.com/benchmarks/svgbench%3Aarena.md) | 1,412 | — | 100 / 191 | — | — | [svgbench](https://svgbench.ai/api/leaderboard?shape=2) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1412 \| rating \| reported \| Higher is better \| ### Configuration Reasoning effort unknown sourceModelId model_mistralai_mistral_large_2512 ### Reported statistics coverageCount 27 draws 1 judged 85 losses 41 rank 140 ratingDeviation 28 wins 43 ### Source [Original source](https://svgbench.ai/api/leaderboard?shape=2) Source svgbench Original model label Mistral Large 3 2512 Observed 2026-10-21T16:32:23.388Z Evidence SHA-256 `5c0a9c869593820d57d2c05f6d416e1b44a740b4835e66c66e9ad8b8edc59e2c` Source locator `/rows/136` | | | | | | | | | [GPQA Diamond](https://benchize.com/benchmarks/gpqa-diamond.md) | 68.43% | SE ±2.37 pp | 31 / 40 | $0.00215 | 21.22source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_gpqa.ghZZBpyU.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 68.434 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.00215 \| USD \| per_test \| Lower is better \| \| `latency` \| 21.216 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±2.37 pp sourcePopulation 138 stderr 2.372 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_gpqa.ghZZBpyU.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:06.040Z Evidence SHA-256 `951eb5224097733a9d09d06c14908ae2980e2e640e539f2c284877c5092d7077` Source locator `/tasks/overall/mistralai~1mistral-large-2512` | | | | | | | | | [MGSM / overall](https://benchize.com/benchmarks/vals-ai%3Amgsm%3Aoverall.md) | 85.42% | SE ±1.79 pp | 8 / 8 | $0.000472 | 7.62source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_mgsm.CneCP-rm.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 85.418 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.000472 \| USD \| per_test \| Lower is better \| \| `latency` \| 7.622 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.79 pp sourcePopulation 75 stderr 1.787 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_mgsm.CneCP-rm.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:02.976Z Evidence SHA-256 `1b87f953e52c00bf4bdd90c3add26165f644eeb7a74a8382d2a0324ff0cc1040` Source locator `/tasks/overall/mistralai~1mistral-large-2512` | | | | | | | | | [MGSM / mgsm te](https://benchize.com/benchmarks/vals-ai%3Amgsm%3Amgsm_te.md) | 88% | SE ±2.06 pp | 2 / 8 | $0.000616 | 11.17source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_mgsm.CneCP-rm.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 88 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.000616 \| USD \| per_test \| Lower is better \| \| `latency` \| 11.17 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±2.06 pp sourcePopulation 75 stderr 2.055 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_mgsm.CneCP-rm.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:02.976Z Evidence SHA-256 `1b87f953e52c00bf4bdd90c3add26165f644eeb7a74a8382d2a0324ff0cc1040` Source locator `/tasks/mgsm_te/mistralai~1mistral-large-2512` | | | | | | | | | [MortgageTax / semantic extraction](https://benchize.com/benchmarks/vals-ai%3Amortgage_tax%3Asemantic_extraction.md) | 54.21% | SE ±1.41 pp | 27 / 31 | $0.0032 | 8.72source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_mortgage_tax.DCd-oO5Y.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 54.213 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.003196 \| USD \| per_test \| Lower is better \| \| `latency` \| 8.719 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.41 pp sourcePopulation 98 stderr 1.405 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_mortgage_tax.DCd-oO5Y.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:45:58.500Z Evidence SHA-256 `e5c844561f97d119d66d70269e726ecfb68be79eae39acf14ead3e95422e648c` Source locator `/tasks/semantic_extraction/mistralai~1mistral-large-2512` | | | | | | | | | [TaxEval v2 / stepwise reasoning](https://benchize.com/benchmarks/vals-ai%3Atax_eval_v2%3Astepwise_reasoning.md) | 84.55% | SE ±1.03 pp | 19 / 40 | $0.0016 | 29.53source duration | [Vals AI · 2](https://www.vals.ai/_astro/benchmark_view_tax_eval_v2.B3yoffr8.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 84.546 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.001601 \| USD \| per_test \| Lower is better \| \| `latency` \| 29.531 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.03 pp sourcePopulation 145 stderr 1.034 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_tax_eval_v2.B3yoffr8.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 2 Observed 2026-10-21T16:45:59.000Z Evidence SHA-256 `8b354a6ae848f5bb25a2e8b061b5f576d5b9e0c11b941dc1e6bed078e6529cd6` Source locator `/tasks/stepwise_reasoning/mistralai~1mistral-large-2512` | | | | | | | | | [MGSM / mgsm bn](https://benchize.com/benchmarks/vals-ai%3Amgsm%3Amgsm_bn.md) | 23.2% | SE ±2.67 pp | 8 / 8 | $0.000601 | 10.35source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_mgsm.CneCP-rm.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 23.2 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.000601 \| USD \| per_test \| Lower is better \| \| `latency` \| 10.349 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±2.67 pp sourcePopulation 75 stderr 2.67 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_mgsm.CneCP-rm.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:02.976Z Evidence SHA-256 `1b87f953e52c00bf4bdd90c3add26165f644eeb7a74a8382d2a0324ff0cc1040` Source locator `/tasks/mgsm_bn/mistralai~1mistral-large-2512` | | | | | | | | | [CorpFin v2 / exact pages](https://benchize.com/benchmarks/vals-ai%3Acorp_fin_v2%3Aexact_pages.md) | 59.79% | SE ±1.67 pp | 28 / 39 | $0.04 | 20.07source duration | [Vals AI · 2](https://www.vals.ai/_astro/benchmark_view_corp_fin_v2.CectKwl1.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 59.79 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.035945 \| USD \| per_test \| Lower is better \| \| `latency` \| 20.072 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.67 pp sourcePopulation 134 stderr 1.674 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_corp_fin_v2.CectKwl1.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 2 Observed 2026-10-21T16:45:57.998Z Evidence SHA-256 `7cf2217ab3728d5a84bffce82aab9fc52d7f810b0cbe8c65b387df47f3d31c9b` Source locator `/tasks/exact_pages/mistralai~1mistral-large-2512` | | | | | | | | | [DesignArena Browser game generation](https://benchize.com/benchmarks/designarena%3Agame-dev.md) | 1,080elo | — | 90 / 117 | — | — | [designarena · public](https://www.designarena.ai/api/leaderboard#board=game-dev) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 1080 \| elo \| game-dev \| Higher is better \| ### Configuration arenaType models category gamedev inputModality Not reported sourceModelVersion mistral-large-2512 variationName public ### Reported statistics averageGenerationTimeMs 113564 battles 4125 losses 2414 standardError Not reported winRate 41.5 wins 1711 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=game-dev) Source designarena Original model label Mistral Large 3 (2512) Source version public Observed 2026-10-21T16:38:01.100Z Evidence SHA-256 `53db6a89112ce8cdf644568c666d4b8309aece764cfcedb291ffd52ae3934e30` Source locator `/data/134` | | | | | | | | | [MMLU Pro / business](https://benchize.com/benchmarks/vals-ai%3Ammlu_pro%3Abusiness.md) | 84.66% | SE ±1.78 pp | 32 / 40 | $0.00125 | 11.16source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 84.664 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.001253 \| USD \| per_test \| Lower is better \| \| `latency` \| 11.164 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.78 pp sourcePopulation 138 stderr 1.779 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:06.503Z Evidence SHA-256 `dab025507f46c716dd8d145e90ec0a737d9c56219853f41e4b1cc3c5e8c222b4` Source locator `/tasks/business/mistralai~1mistral-large-2512` | | | | | | | | | [MMLU Pro / health](https://benchize.com/benchmarks/vals-ai%3Ammlu_pro%3Ahealth.md) | 77.26% | SE ±1.74 pp | 32 / 40 | $0.00113 | 11.32source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 77.262 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.00113 \| USD \| per_test \| Lower is better \| \| `latency` \| 11.318 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.74 pp sourcePopulation 138 stderr 1.738 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:06.503Z Evidence SHA-256 `dab025507f46c716dd8d145e90ec0a737d9c56219853f41e4b1cc3c5e8c222b4` Source locator `/tasks/health/mistralai~1mistral-large-2512` | | | | | | | | | [SAGE / automata](https://benchize.com/benchmarks/vals-ai%3Asage%3Aautomata.md) | 11.91% | SE ±4.15 pp | 41 / 41 | $0.00818 | 62.96source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_sage.RRwIIzO5.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 11.905 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.00818 \| USD \| per_test \| Lower is better \| \| `latency` \| 62.961 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 30000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±4.15 pp sourcePopulation 91 stderr 4.152 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_sage.RRwIIzO5.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:07.515Z Evidence SHA-256 `cc5fb3fecdb0382d492ff167a42ad84b9c5c3883373c78ed87baaa972b8b6f7c` Source locator `/tasks/automata/mistralai~1mistral-large-2512` | | | | | | | | | [TaxEval v2 / overall](https://benchize.com/benchmarks/vals-ai%3Atax_eval_v2%3Aoverall.md) | 73.06% | SE ±0.87 pp | 22 / 40 | $0.0016 | 29.53source duration | [Vals AI · 2](https://www.vals.ai/_astro/benchmark_view_tax_eval_v2.B3yoffr8.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 73.058 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.001601 \| USD \| per_test \| Lower is better \| \| `latency` \| 29.531 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.87 pp sourcePopulation 145 stderr 0.867 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_tax_eval_v2.B3yoffr8.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 2 Observed 2026-10-21T16:45:59.000Z Evidence SHA-256 `8b354a6ae848f5bb25a2e8b061b5f576d5b9e0c11b941dc1e6bed078e6529cd6` Source locator `/tasks/overall/mistralai~1mistral-large-2512` | | | | | | | | | [LegalBench / issue tasks](https://benchize.com/benchmarks/vals-ai%3Alegal_bench%3Aissue_tasks.md) | 81.01% | SE ±0.69 pp | 36 / 44 | $0.0008 | 0.94source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_bench.D6uTgA3b.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 81.006 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.0008 \| USD \| per_test \| Lower is better \| \| `latency` \| 0.938 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.69 pp sourcePopulation 151 stderr 0.694 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_bench.D6uTgA3b.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:45:53.390Z Evidence SHA-256 `c8486ba756baa5cd3955d035edff67440e8db23e69d62ad1a9e18d15b8c4bc52` Source locator `/tasks/issue_tasks/mistralai~1mistral-large-2512` | | | | | | | | | [MGSM / mgsm ja](https://benchize.com/benchmarks/vals-ai%3Amgsm%3Amgsm_ja.md) | 90% | SE ±1.9 pp | 2 / 8 | $0.000579 | 9.53source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_mgsm.CneCP-rm.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 90 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.000579 \| USD \| per_test \| Lower is better \| \| `latency` \| 9.533 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.9 pp sourcePopulation 75 stderr 1.897 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_mgsm.CneCP-rm.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:02.976Z Evidence SHA-256 `1b87f953e52c00bf4bdd90c3add26165f644eeb7a74a8382d2a0324ff0cc1040` Source locator `/tasks/mgsm_ja/mistralai~1mistral-large-2512` | | | | | | | | | [MMMU Pro / overall](https://benchize.com/benchmarks/vals-ai%3Ammmu%3Aoverall.md) | 66.19% | SE ±1.14 pp | 25 / 28 | $0.00148 | 13.55source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_mmmu.BBln8x5x.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 66.185 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.001477 \| USD \| per_test \| Lower is better \| \| `latency` \| 13.55 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.14 pp sourcePopulation 93 stderr 1.137 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_mmmu.BBln8x5x.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:07.000Z Evidence SHA-256 `29395186eddd2c70601228c584a14b3c1d8f9dba4b68256561b46b0dd03c635a` Source locator `/tasks/overall/mistralai~1mistral-large-2512` | | | | | | | | | [DesignArena 3D design generation](https://benchize.com/benchmarks/designarena%3A3d-design.md) | 1,100elo | — | 66 / 110 | — | — | [designarena · public](https://www.designarena.ai/api/leaderboard#board=3d-design) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 1100 \| elo \| 3d-design \| Higher is better \| ### Configuration arenaType models category 3d inputModality Not reported sourceModelVersion mistral-large-2512 variationName public ### Reported statistics averageGenerationTimeMs 66695 battles 4549 losses 2414 standardError Not reported winRate 46.9 wins 2135 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=3d-design) Source designarena Original model label Mistral Large 3 (2512) Source version public Observed 2026-10-21T16:37:58.515Z Evidence SHA-256 `bcc0267f7bc7e9ec112306b3a35413cf78bbccbfaa838356232d5d5ed0b83d0f` Source locator `/data/104` | | | | | | | | | [MGSM / mgsm fr](https://benchize.com/benchmarks/vals-ai%3Amgsm%3Amgsm_fr.md) | 88% | SE ±2.06 pp | 1 / 8 | $0.000365 | 4.77source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_mgsm.CneCP-rm.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 88 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.000365 \| USD \| per_test \| Lower is better \| \| `latency` \| 4.771 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±2.06 pp sourcePopulation 75 stderr 2.055 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_mgsm.CneCP-rm.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:02.976Z Evidence SHA-256 `1b87f953e52c00bf4bdd90c3add26165f644eeb7a74a8382d2a0324ff0cc1040` Source locator `/tasks/mgsm_fr/mistralai~1mistral-large-2512` | | | | | | | | | [LegalBench / interpretation tasks](https://benchize.com/benchmarks/vals-ai%3Alegal_bench%3Ainterpretation_tasks.md) | 76.59% | SE ±0.21 pp | 35 / 44 | $0.000401 | 0.89source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_bench.D6uTgA3b.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 76.594 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.000401 \| USD \| per_test \| Lower is better \| \| `latency` \| 0.889 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.21 pp sourcePopulation 151 stderr 0.207 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_bench.D6uTgA3b.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:45:53.390Z Evidence SHA-256 `c8486ba756baa5cd3955d035edff67440e8db23e69d62ad1a9e18d15b8c4bc52` Source locator `/tasks/interpretation_tasks/mistralai~1mistral-large-2512` | | | | | | | | | [CorpFin v2 / max fitting context](https://benchize.com/benchmarks/vals-ai%3Acorp_fin_v2%3Amax_fitting_context.md) | 63.75% | SE ±1.64 pp | 19 / 39 | $0.00123 | 53.32source duration | [Vals AI · 2](https://www.vals.ai/_astro/benchmark_view_corp_fin_v2.CectKwl1.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 63.753 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.001232 \| USD \| per_test \| Lower is better \| \| `latency` \| 53.318 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.64 pp sourcePopulation 134 stderr 1.641 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_corp_fin_v2.CectKwl1.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 2 Observed 2026-10-21T16:45:57.998Z Evidence SHA-256 `7cf2217ab3728d5a84bffce82aab9fc52d7f810b0cbe8c65b387df47f3d31c9b` Source locator `/tasks/max_fitting_context/mistralai~1mistral-large-2512` | | | | | | | | | [MMLU Pro / psychology](https://benchize.com/benchmarks/vals-ai%3Ammlu_pro%3Apsychology.md) | 80.58% | SE ±1.75 pp | 33 / 40 | $0.00108 | 10.75source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 80.576 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.001079 \| USD \| per_test \| Lower is better \| \| `latency` \| 10.746 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.75 pp sourcePopulation 138 stderr 1.754 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:06.503Z Evidence SHA-256 `dab025507f46c716dd8d145e90ec0a737d9c56219853f41e4b1cc3c5e8c222b4` Source locator `/tasks/psychology/mistralai~1mistral-large-2512` | | | | | | | | | [MedQA / overall](https://benchize.com/benchmarks/vals-ai%3Amedqa%3Aoverall.md) | 82.23% | SE ±0.35 pp | 7 / 12 | $0.000771 | 17.31source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_medqa.Cco1kvog.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 82.233 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.000771 \| USD \| per_test \| Lower is better \| \| `latency` \| 17.31 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.35 pp sourcePopulation 95 stderr 0.349 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_medqa.Cco1kvog.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:00.691Z Evidence SHA-256 `d67905978d932f64698ebe9e230d9519e5bae1c9d7176dda8379dc3874b6f90f` Source locator `/tasks/overall/mistralai~1mistral-large-2512` | | | | | | | | | [MMLU Pro / history](https://benchize.com/benchmarks/vals-ai%3Ammlu_pro%3Ahistory.md) | 70.87% | SE ±2.56 pp | 30 / 40 | $0.00166 | 11.78source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 70.866 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.001663 \| USD \| per_test \| Lower is better \| \| `latency` \| 11.778 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±2.56 pp sourcePopulation 138 stderr 2.555 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:06.503Z Evidence SHA-256 `dab025507f46c716dd8d145e90ec0a737d9c56219853f41e4b1cc3c5e8c222b4` Source locator `/tasks/history/mistralai~1mistral-large-2512` | | | | | | | | | [MMLU-Pro](https://benchize.com/benchmarks/mmlu-pro.md) | 79.82% | SE ±0.47 pp | 32 / 40 | $0.00148 | 13.55source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 79.823 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.001481 \| USD \| per_test \| Lower is better \| \| `latency` \| 13.554 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.47 pp sourcePopulation 138 stderr 0.472 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:06.503Z Evidence SHA-256 `dab025507f46c716dd8d145e90ec0a737d9c56219853f41e4b1cc3c5e8c222b4` Source locator `/tasks/overall/mistralai~1mistral-large-2512` | | | | | | | | | [SAGE / overall](https://benchize.com/benchmarks/vals-ai%3Asage%3Aoverall.md) | 24.6% | SE ±2.81 pp | 41 / 41 | $0.00806 | 55.07source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_sage.RRwIIzO5.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 24.595 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.00806 \| USD \| per_test \| Lower is better \| \| `latency` \| 55.068 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 30000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±2.81 pp sourcePopulation 91 stderr 2.81 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_sage.RRwIIzO5.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:07.515Z Evidence SHA-256 `cc5fb3fecdb0382d492ff167a42ad84b9c5c3883373c78ed87baaa972b8b6f7c` Source locator `/tasks/overall/mistralai~1mistral-large-2512` | | | | | | | | | [MMLU Pro / physics](https://benchize.com/benchmarks/vals-ai%3Ammlu_pro%3Aphysics.md) | 86.37% | SE ±1.21 pp | 33 / 40 | $0.00161 | 14.86source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 86.374 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.001605 \| USD \| per_test \| Lower is better \| \| `latency` \| 14.859 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.21 pp sourcePopulation 138 stderr 1.213 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:06.503Z Evidence SHA-256 `dab025507f46c716dd8d145e90ec0a737d9c56219853f41e4b1cc3c5e8c222b4` Source locator `/tasks/physics/mistralai~1mistral-large-2512` | | | | | | | | | [AIME 2025](https://benchize.com/benchmarks/aime-2025.md) | 31.25% | SE ±1.66 pp | 9 / 14 | $0.00631 | 106.8source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_aime.C3_jItdR.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 31.25 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.006307 \| USD \| per_test \| Lower is better \| \| `latency` \| 106.797 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens Not reported provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.66 pp sourcePopulation 96 stderr 1.659 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_aime.C3_jItdR.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:01.920Z Evidence SHA-256 `7d016210b39d24351bbb5d12be09a973decac461bb2486eb1f23724fed2b7e6c` Source locator `/tasks/aime_2025/mistralai~1mistral-large-2512` | | | | | | | | | [LegalBench / overall](https://benchize.com/benchmarks/vals-ai%3Alegal_bench%3Aoverall.md) | 79.14% | SE ±0.46 pp | 35 / 44 | $0.000439 | 1.73source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_legal_bench.D6uTgA3b.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 79.138 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.000439 \| USD \| per_test \| Lower is better \| \| `latency` \| 1.731 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.46 pp sourcePopulation 151 stderr 0.46 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_legal_bench.D6uTgA3b.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:45:53.390Z Evidence SHA-256 `c8486ba756baa5cd3955d035edff67440e8db23e69d62ad1a9e18d15b8c4bc52` Source locator `/tasks/overall/mistralai~1mistral-large-2512` | | | | | | | | | [MMLU Pro / chemistry](https://benchize.com/benchmarks/vals-ai%3Ammlu_pro%3Achemistry.md) | 84.98% | SE ±1.38 pp | 33 / 40 | $0.00186 | 15.68source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 84.982 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.001859 \| USD \| per_test \| Lower is better \| \| `latency` \| 15.68 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±1.38 pp sourcePopulation 138 stderr 1.375 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_mmlu_pro.y416pXDi.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:06.503Z Evidence SHA-256 `dab025507f46c716dd8d145e90ec0a737d9c56219853f41e4b1cc3c5e8c222b4` Source locator `/tasks/chemistry/mistralai~1mistral-large-2512` | | | | | | | | | [SWE-bench / overall](https://benchize.com/benchmarks/vals-ai%3Aswebench%3Aoverall.md) | 41.4% | SE ±2.21 pp | 38 / 39 | $0.32 | 186.96source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_swebench.Ae8ni7h0.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 41.4 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.321666 \| USD \| per_test \| Lower is better \| \| `latency` \| 186.955 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±2.21 pp sourcePopulation 88 stderr 2.205 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_swebench.Ae8ni7h0.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:13.711Z Evidence SHA-256 `7a4e2e8485283caac500127419f68ec4bd5414c837ade114fc6afa5b2d34ccaa` Source locator `/tasks/overall/mistralai~1mistral-large-2512` | | | | | | | | | [SAGE / calculus](https://benchize.com/benchmarks/vals-ai%3Asage%3Acalculus.md) | 0% | SE ±0 pp | 36 / 36 | $0.01 | 101.61source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_sage.RRwIIzO5.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 0 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.010832 \| USD \| per_test \| Lower is better \| \| `latency` \| 101.608 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 30000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 1 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0 pp sourcePopulation 91 stderr 0 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_sage.RRwIIzO5.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:07.515Z Evidence SHA-256 `cc5fb3fecdb0382d492ff167a42ad84b9c5c3883373c78ed87baaa972b8b6f7c` Source locator `/tasks/calculus/mistralai~1mistral-large-2512` | | | | | | | | | [MedQA / asian](https://benchize.com/benchmarks/vals-ai%3Amedqa%3Aasian.md) | 82.05% | SE ±0.86 pp | 7 / 12 | $0.000773 | 17.95source duration | [Vals AI · 1](https://www.vals.ai/_astro/benchmark_view_medqa.Cco1kvog.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 82.05 \| percent \| reported \| Higher is better \| \| `cost_per_test` \| 0.000773 \| USD \| per_test \| Lower is better \| \| `latency` \| 17.947 \| source_duration \| reported_duration \| Lower is better \| ### Configuration computeEffort Not reported harness Not reported maxOutputTokens 256000 provider Mistral AI reasoning Not reported Reasoning effort unknown Temperature 0.065 topP Not reported verbosity Not reported ### Reported statistics Uncertainty Standard error: ±0.86 pp sourcePopulation 95 stderr 0.858 tokenTotals Not reported ### Source [Original source](https://www.vals.ai/_astro/benchmark_view_medqa.Cco1kvog.json) Source Vals AI Original model label mistralai/mistral-large-2512 Source version 1 Observed 2026-10-21T16:46:00.691Z Evidence SHA-256 `d67905978d932f64698ebe9e230d9519e5bae1c9d7176dda8379dc3874b6f90f` Source locator `/tasks/asian/mistralai~1mistral-large-2512` | | | | | | | | | [DesignArena Overall frontend coding](https://benchize.com/benchmarks/designarena%3Acode.md) | 1,142elo | SE ±2.15 | 82 / 116 | — | — | [designarena · public](https://www.designarena.ai/api/leaderboard#board=code) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 1142 \| elo \| code \| Higher is better \| ### Configuration arenaType models category allcategories inputModality text sourceModelVersion mistral-large-2512 variationName public ### Reported statistics Uncertainty Standard error: ±2.15 averageGenerationTimeMs 109804 battles 30430 losses 15941 standardError 2.1474 winRate 47.6 wins 14489 ### Source [Original source](https://www.designarena.ai/api/leaderboard#board=code) Source designarena Original model label Mistral Large 3 (2512) Source version public Observed 2026-10-21T16:37:57.301Z Evidence SHA-256 `0c897b58670f5e352bd123db999a40c0d1781a443964c502b90774a76a3a7758` Source locator `/data/120` | | | | | | | | --- Cite as: Mistral Large 3 2512 — Benchize, https://benchize.com/models/mistral-large-2512 (retrieved 2026-10-21)