# Mistral Nemo

> Source: Benchize (https://benchize.com) — https://benchize.com/models/mistral-nemo. When citing or reusing this content, credit "Benchize" and link to https://benchize.com/models/mistral-nemo.

Mistral AI

Canonical URL: https://benchize.com/models/mistral-nemo
Last updated: Thu, 22 Oct 2026 05:30:58 GMT

Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations.

Mistral AI

## Benchmarks

| Benchmark | Score | ± | Rank | Source |  |
| --- | --- | --- | --- | --- | --- |
| [MAGI-Hard](https://benchize.com/benchmarks/eq-bench%3Amagi-hard.md) | 43.65% | — | 11 / 14 | [eq bench · magi-hard](https://eqbench.com/eqbench-v2.js) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 43.65 \| percent \| overall \| Higher is better \| ### Configuration interactiveAdjustments none protocol magi-hard sourceModelVersion mistralai/Mistral-Nemo-Instruct-2407 ### Source [Original source](https://eqbench.com/eqbench-v2.js) Source eq bench Original model label mistralai/Mistral-Nemo-Instruct-2407 Source version magi-hard Observed 2026-10-22T05:10:05.138Z Evidence SHA-256 `088fe07c18b4347c82113934c58bb801cdb21adfe80852c7d0854e9818749dcd` Source locator `/leaderboardDataMagi/136` |  |  |  |  |  |
| [Longform Creative Writing](https://benchize.com/benchmarks/eq-bench%3Alongform-writing.md) | 28.7% | — | 91 / 93 | [eq bench · longform-writing](https://eqbench.com/creative_writing_longform.js) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `overall_score_100` \| 28.7 \| percent \| overall \| Higher is better \| \| `chapter1_avg` \| 8.32 \| rubric_score \| overall \| Higher is better \| \| `chapter2_avg` \| 7.28 \| rubric_score \| overall \| Higher is better \| \| `chapter3_avg` \| 6.61 \| rubric_score \| overall \| Higher is better \| \| `chapter4_avg` \| 5.48 \| rubric_score \| overall \| Higher is better \| \| `chapter5_avg` \| 5.16 \| rubric_score \| overall \| Higher is better \| \| `chapter6_avg` \| 4.98 \| rubric_score \| overall \| Higher is better \| \| `chapter7_avg` \| 4.31 \| rubric_score \| overall \| Higher is better \| \| `chapter8_avg` \| 2.93 \| rubric_score \| overall \| Higher is better \| \| `final_judgement_avg` \| 4.46 \| rubric_score \| overall \| Higher is better \| ### Configuration interactiveAdjustments none protocol longform-writing sourceModelVersion mistralai/Mistral-Nemo-Instruct-2407 ### Source [Original source](https://eqbench.com/creative_writing_longform.js) Source eq bench Original model label mistralai/Mistral-Nemo-Instruct-2407 Source version longform-writing Observed 2026-10-22T05:10:05.903Z Evidence SHA-256 `3ba283ce357ac7620e16db640a961879c30fe3ddc50a27de9a8ed4290784825c` Source locator `/leaderboardDataLongformV3/83` |  |  |  |  |  |
| [Creative Writing v2](https://benchize.com/benchmarks/eq-bench%3Acreative-writing-v2.md) | 77.46% | CI 76.82–78.1% | 9 / 18 | [eq bench · creative-writing-v2](https://eqbench.com/creative_writing_v2.js) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 77.46 \| percent \| overall \| Higher is better \| ### Configuration interactiveAdjustments none protocol creative-writing-v2 sourceModelVersion mistralai/Mistral-Nemo-Instruct-2407 ### Reported statistics Uncertainty Confidence interval: 76.82–78.1% confidenceIntervalHigh 78.1 confidenceIntervalLow 76.82 ### Source [Original source](https://eqbench.com/creative_writing_v2.js) Source eq bench Original model label mistralai/Mistral-Nemo-Instruct-2407 Source version creative-writing-v2 Observed 2026-10-22T05:10:05.638Z Evidence SHA-256 `264c33d486559c25267ca29861754404dadb674022dcdf6530388cd9951af31a` Source locator `/leaderboardDataCreativeWriting/39` |  |  |  |  |  |
| [Creative Writing v3](https://benchize.com/benchmarks/eq-bench%3Acreative-writing-v3.md) | 880.9elo | — | 78 / 90 | [eq bench · creative-writing-v3](https://eqbench.com/creative_writing.js) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo_score` \| 880.9 \| elo \| overall \| Higher is better \| \| `creative_writing_score` \| 9.51 \| rubric_score \| overall \| Higher is better \| ### Configuration interactiveAdjustments none protocol creative-writing-v3 sourceModelVersion mistralai/Mistral-Nemo-Instruct-2407 ### Source [Original source](https://eqbench.com/creative_writing.js) Source eq bench Original model label mistralai/Mistral-Nemo-Instruct-2407 Source version creative-writing-v3 Observed 2026-10-22T05:10:05.433Z Evidence SHA-256 `722ddb132e8d3a5e5c39b8d445f8475f3f7e24893a007260c6f3e3cce5c1ee18` Source locator `/leaderboardDataCreativeWritingV3/120` |  |  |  |  |  |
| [SVGBench Arena](https://benchize.com/benchmarks/svgbench%3Aarena.md) | 1,292 | — | 135 / 191 | [svgbench](https://svgbench.ai/api/leaderboard?shape=2) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `rating` \| 1292 \| rating \| reported \| Higher is better \| ### Configuration Reasoning effort unknown sourceModelId model_mistralai_mistral_nemo ### Reported statistics coverageCount 26 draws 0 judged 12 losses 11 rank 216 ratingDeviation 55 wins 1 ### Source [Original source](https://svgbench.ai/api/leaderboard?shape=2) Source svgbench Original model label Mistral Nemo Observed 2026-10-22T04:30:04.538Z Evidence SHA-256 `5c0a9c869593820d57d2c05f6d416e1b44a740b4835e66c66e9ad8b8edc59e2c` Source locator `/rows/205` |  |  |  |  |  |
| [EQ-Bench v2](https://benchize.com/benchmarks/eq-bench%3Aeqbench-v2.md) | 77.13% | — | 9 / 18 | [eq bench · eqbench-v2](https://eqbench.com/eqbench-v2.js) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 77.13 \| percent \| overall \| Higher is better \| ### Configuration interactiveAdjustments none protocol eqbench-v2 sourceModelVersion mistralai/Mistral-Nemo-Instruct-2407 ### Source [Original source](https://eqbench.com/eqbench-v2.js) Source eq bench Original model label mistralai/Mistral-Nemo-Instruct-2407 Source version eqbench-v2 Observed 2026-10-22T05:10:05.138Z Evidence SHA-256 `088fe07c18b4347c82113934c58bb801cdb21adfe80852c7d0854e9818749dcd` Source locator `/leaderboardDataEqbench/144` |  |  |  |  |  |
| [Slop Score](https://benchize.com/benchmarks/eq-bench%3Aslop-score.md) | 54.37% | — | 10 / 16 | [eq bench · slop-score](https://eqbench.com/data/leaderboard_results.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `slop_score` \| 54.371114036596545 \| percent \| official_normalized_composite \| Lower is better \| \| `slop_list_matches_per_1k_words` \| 26.406771123508896 \| matches_per_1000_words \| writing_samples \| Lower is better \| \| `slop_trigram_matches_per_1k_words` \| 1.0112419577644303 \| matches_per_1000_words \| writing_samples \| Lower is better \| \| `not_x_but_y_per_1k_chars` \| 0.22976260708034502 \| matches_per_1000_chars \| writing_samples \| Lower is better \| ### Configuration normalization official_population_min_max_10_percent_buffer protocol slop-score ### Reported statistics samples 299 ### Source [Original source](https://eqbench.com/data/leaderboard_results.json) Source eq bench Original model label mistralai/mistral-nemo Source version slop-score Evaluated 2025-11-01T08:47:16.734702+00:00 Observed 2026-10-22T05:10:07.984Z Evidence SHA-256 `16925b79d955a1cacef4d2ac91b696e73f976a4a3ceb45122544a9cf661b04de` Source locator `/results/16` |  |  |  |  |  |
| [NC Bench](https://benchize.com/benchmarks/nc-bench%3Aoverall.md) | 63.8% | — | 144 / 144 | [nc bench](https://www.nc-bench.com/models) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 63.8 \| percent \| reported \| Higher is better \| \| `tooling` \| 79.34 \| percent \| category \| Higher is better \| \| `creative_writing` \| 76.72 \| percent \| category \| Higher is better \| \| `language` \| 80.8 \| percent \| category \| Higher is better \| \| `utility` \| 51.55 \| percent \| category \| Higher is better \| \| `reasoning` \| 44.87 \| percent \| category \| Higher is better \| \| `text_editing` \| 73.69 \| percent \| category \| Higher is better \| \| `rule_following` \| 34.11 \| percent \| category \| Higher is better \| \| `hallucination` \| 69.32 \| percent \| category \| Higher is better \| ### Configuration Reasoning effort unknown Model configuration Mistral NeMO thinkingEnabled Not reported ### Source [Original source](https://www.nc-bench.com/models) Source nc bench Original model label Mistral NeMO Observed 2026-10-21T16:31:48.370Z Evidence SHA-256 `ec261022458543624b08a136d01f5a2f0666cd52ffb49c64d6ca983e8543d1b5` Source locator `/rows/200` |  |  |  |  |  |

---
Cite as: Mistral Nemo — Benchize, https://benchize.com/models/mistral-nemo (retrieved 2026-10-22)