# Mistral Medium 3.1

> Source: Benchize (https://benchize.com) — https://benchize.com/models/mistral-medium-3-1. When citing or reusing this content, credit "Benchize" and link to https://benchize.com/models/mistral-medium-3-1.

Mistral AI

Canonical URL: https://benchize.com/models/mistral-medium-3-1
Last updated: Thu, 22 Oct 2026 05:30:58 GMT

Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations.

Mistral AI

## Benchmarks

| Benchmark | Score | ± | Rank | Source |  |
| --- | --- | --- | --- | --- | --- |
| [Short Story Writing — Pairwise Comparison](https://benchize.com/benchmarks/lechmazur-short-story%3Apairwise.md) | -0.39 | 95% CI -0.54–-0.26 | 33 / 50 | [lechmazur short story · 8ba548d1cffefa5c472d3832e05f64e119a88fa4](https://api.github.com/repos/lechmazur/writing/contents/data/writing_gemini_argon_20261013/ratings.csv?ref=8ba548d1cffefa5c472d3832e05f64e119a88fa4) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `thurstone_rating` \| -0.3861839020278999 \| index \| pooled_observed_panel \| Higher is better \| \| `win_probability` \| 0.4408162006877146 \| score_fraction \| comparison_pool \| Higher is better \| ### Configuration benchmarkScope data/writing_gemini_argon_20261013 ### Reported statistics Uncertainty 95% confidence interval: -0.54–-0.26 bootstrapSamples 300 confidenceInterval95 ["-0.53883571599254","-0.2610992956716161"] sourceRank 33 ### Source [Original source](https://api.github.com/repos/lechmazur/writing/contents/data/writing_gemini_argon_20261013/ratings.csv?ref=8ba548d1cffefa5c472d3832e05f64e119a88fa4) Source lechmazur short story Original model label Mistral Medium 3.1 Source version 8ba548d1cffefa5c472d3832e05f64e119a88fa4 Observed 2026-10-21T16:34:21.130Z Evidence SHA-256 `c36baebed9f302ff7ad8fe97907d72e1757a015a39b6a3b23437597cf8e3bff6` Source locator `/rows/32` |  |  |  |  |  |
| [SVGBench Arena](https://benchize.com/benchmarks/svgbench%3Aarena.md) | 1,426 | — | 95 / 191 | [svgbench](https://svgbench.ai/api/leaderboard?shape=2) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1426 \| rating \| reported \| Higher is better \| ### Configuration Reasoning effort unknown sourceModelId model_mistralai_mistral_medium_3_1 ### Reported statistics coverageCount 27 draws 6 judged 84 losses 36 rank 134 ratingDeviation 28 wins 42 ### Source [Original source](https://svgbench.ai/api/leaderboard?shape=2) Source svgbench Original model label Mistral Medium 3.1 Observed 2026-10-22T04:30:04.538Z Evidence SHA-256 `5c0a9c869593820d57d2c05f6d416e1b44a740b4835e66c66e9ad8b8edc59e2c` Source locator `/rows/130` |  |  |  |  |  |
| [Longform Creative Writing](https://benchize.com/benchmarks/eq-bench%3Alongform-writing.md) | 46.2% | — | 74 / 93 | [eq bench · longform-writing](https://eqbench.com/creative_writing_longform.js) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `overall_score_100` \| 46.2 \| percent \| overall \| Higher is better \| \| `chapter1_avg` \| 13.17 \| rubric_score \| overall \| Higher is better \| \| `chapter2_avg` \| 12.32 \| rubric_score \| overall \| Higher is better \| \| `chapter3_avg` \| 10.66 \| rubric_score \| overall \| Higher is better \| \| `chapter4_avg` \| 9.69 \| rubric_score \| overall \| Higher is better \| \| `chapter5_avg` \| 8.61 \| rubric_score \| overall \| Higher is better \| \| `chapter6_avg` \| 7.72 \| rubric_score \| overall \| Higher is better \| \| `chapter7_avg` \| 6.44 \| rubric_score \| overall \| Higher is better \| \| `chapter8_avg` \| 7.50 \| rubric_score \| overall \| Higher is better \| \| `final_judgement_avg` \| 9.45 \| rubric_score \| overall \| Higher is better \| ### Configuration interactiveAdjustments none protocol longform-writing sourceModelVersion mistral-medium-3.1 ### Source [Original source](https://eqbench.com/creative_writing_longform.js) Source eq bench Original model label mistral-medium-3.1 Source version longform-writing Observed 2026-10-22T05:10:05.903Z Evidence SHA-256 `3ba283ce357ac7620e16db640a961879c30fe3ddc50a27de9a8ed4290784825c` Source locator `/leaderboardDataLongformV3/54` |  |  |  |  |  |
| [Creative Writing v3](https://benchize.com/benchmarks/eq-bench%3Acreative-writing-v3.md) | 1,475.7elo | — | 55 / 90 | [eq bench · creative-writing-v3](https://eqbench.com/creative_writing.js) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo_score` \| 1475.7 \| elo \| overall \| Higher is better \| \| `creative_writing_score` \| 15.96 \| rubric_score \| overall \| Higher is better \| ### Configuration interactiveAdjustments none protocol creative-writing-v3 sourceModelVersion mistral-medium-3.1 ### Source [Original source](https://eqbench.com/creative_writing.js) Source eq bench Original model label mistral-medium-3.1 Source version creative-writing-v3 Observed 2026-10-22T05:10:05.433Z Evidence SHA-256 `722ddb132e8d3a5e5c39b8d445f8475f3f7e24893a007260c6f3e3cce5c1ee18` Source locator `/leaderboardDataCreativeWritingV3/68` |  |  |  |  |  |
| [Spiral-Bench v1.2](https://benchize.com/benchmarks/eq-bench%3Aspiral-bench-v1.2.md) | 15% | CI 15–15% | 15 / 16 | [eq bench · spiral-bench-v1.2](https://eqbench.com/spiral-bench.js) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score_norm` \| 15.0 \| percent \| overall \| Higher is better \| ### Configuration interactiveAdjustments none protocol spiral-bench-v1.2 sourceModelVersion mistral-medium-3.1 ### Reported statistics Uncertainty Confidence interval: 15–15% confidenceIntervalHigh 15.0 confidenceIntervalLow 15.0 ### Source [Original source](https://eqbench.com/spiral-bench.js) Source eq bench Original model label mistral-medium-3.1 Source version spiral-bench-v1.2 Observed 2026-10-22T05:10:07.179Z Evidence SHA-256 `2f0402654b01e7363c0d02bbc708afd7849e669dc5da63d9f85c995ed8f0a97f` Source locator `/leaderboardDataDelusion/15` |  |  |  |  |  |
| [NC Bench](https://benchize.com/benchmarks/nc-bench%3Aoverall.md) | 76.08% | — | 134 / 144 | [nc bench](https://www.nc-bench.com/models) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 76.08 \| percent \| reported \| Higher is better \| \| `tooling` \| 94.17 \| percent \| category \| Higher is better \| \| `creative_writing` \| 81.7 \| percent \| category \| Higher is better \| \| `language` \| 49.5 \| percent \| category \| Higher is better \| \| `utility` \| 80.13 \| percent \| category \| Higher is better \| \| `reasoning` \| 71.84 \| percent \| category \| Higher is better \| \| `text_editing` \| 93.77 \| percent \| category \| Higher is better \| \| `rule_following` \| 48.6 \| percent \| category \| Higher is better \| \| `hallucination` \| 88.93 \| percent \| category \| Higher is better \| ### Configuration Reasoning effort unknown Model configuration Mistral Medium 3.1 thinkingEnabled Not reported ### Source [Original source](https://www.nc-bench.com/models) Source nc bench Original model label Mistral Medium 3.1 Observed 2026-10-21T16:31:48.370Z Evidence SHA-256 `ec261022458543624b08a136d01f5a2f0666cd52ffb49c64d6ca983e8543d1b5` Source locator `/rows/180` |  |  |  |  |  |

---
Cite as: Mistral Medium 3.1 — Benchize, https://benchize.com/models/mistral-medium-3-1 (retrieved 2026-10-22)
