# MTEB(spa, v1) · Spanish

> Source: Benchize (https://benchize.com) — https://benchize.com/benchmarks/mteb%3AMTEB(spa%2C%20v1). When citing or reusing this content, credit "Benchize" and link to https://benchize.com/benchmarks/mteb%3AMTEB(spa%2C%20v1).

Spanish text embedding quality across classification, clustering, pair classification, reranking, retrieval, and semantic similarity. For discussion on benchmark construction, see the [original submission](https://github.com/embeddings-benchmark/mteb/pull/4053).

Canonical URL: https://benchize.com/benchmarks/mteb%3AMTEB(spa%2C%20v1)
Last updated: Wed, 21 Oct 2026 18:52:20 GMT

Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations.

Spanish text embedding quality across classification, clustering, pair classification, reranking, retrieval, and semantic similarity. For discussion on benchmark construction, see the [original submission](https://github.com/embeddings-benchmark/mteb/pull/4053).

Embeddings · Models tested: 5 · Score publishers: MTEB

## Model results

| # | Model | Score |  |
| --- | --- | --- | --- |
| 1 | [Gemini Embedding 001](https://benchize.com/models/gemini-embedding-001.md) | 0.72source score |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.7197869583333333 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.7195009236111112 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 87 ### Reported statistics experiments Not reported rank 1 scoresByTask {"MIRACLReranking":0.64087,"MIRACLRetrievalHardNegatives.v2":0.55971,"MLSUMClusteringP2P":0.546547,"MLSUMClusteringS2S":0.5377369999999999,"MintakaRetrieval":0.61785,"PawsXPairClassification":0.6193085,"STS17":0.8972585,"STS22":0.717634,"STSBenchmarkMultilingualSTS":0.886714,"STSES":0.81749,"SpanishNewsClassification.v2":0.909521,"SpanishPassageRetrievalS2P":0.48866,"SpanishPassageRetrievalS2S":0.77148,"SpanishSentimentClassification.v2":0.966423,"XNLI":0.8705849999999999,"XPQARetrieval":0.6688033333333333} scoresByTaskType {"Classification":0.937972,"Clustering":0.5421419999999999,"PairClassification":0.74494675,"Reranking":0.64087,"Retrieval":0.6213006666666667,"STS":0.8297741249999999} trainedOnTasks ["MIRACLReranking","MIRACLRetrievalHardNegatives.v2"] ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(spa%2C%20v1)/scores) Source MTEB Original model label google/gemini-embedding-001 Observed 2026-10-21T16:40:36.375Z Evidence SHA-256 `c8eba8bf2233665c86eba5e08e282beb5d4c20ed913f54f2b53d398a89d7ffcf` Source locator `/rows/0` |  |  |  |
| 2 | [Text Embedding 3 Large](https://benchize.com/models/text-embedding-3-large.md) | 0.69source score |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.6850363020833333 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.6860965069444444 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct -1 ### Reported statistics experiments Not reported rank 10 scoresByTask {"MIRACLReranking":0.61922,"MIRACLRetrievalHardNegatives.v2":0.51873,"MLSUMClusteringP2P":0.5070865,"MLSUMClusteringS2S":0.5043585,"MintakaRetrieval":0.60201,"PawsXPairClassification":0.619745,"STS17":0.879499,"STS22":0.672555,"STSBenchmarkMultilingualSTS":0.8452395,"STSES":0.742164,"SpanishNewsClassification.v2":0.912598,"SpanishPassageRetrievalS2P":0.45956,"SpanishPassageRetrievalS2S":0.73132,"SpanishSentimentClassification.v2":0.942336,"XNLI":0.754256,"XPQARetrieval":0.6499033333333334} scoresByTaskType {"Classification":0.927467,"Clustering":0.5057225000000001,"PairClassification":0.6870005,"Reranking":0.61922,"Retrieval":0.5923046666666667,"STS":0.784864375} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(spa%2C%20v1)/scores) Source MTEB Original model label openai/text-embedding-3-large Observed 2026-10-21T16:40:36.375Z Evidence SHA-256 `c8eba8bf2233665c86eba5e08e282beb5d4c20ed913f54f2b53d398a89d7ffcf` Source locator `/rows/9` |  |  |  |
| 3 | [Text Embedding 3 Small](https://benchize.com/models/text-embedding-3-small.md) | 0.66source score |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.6576181666666667 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.6605408888888888 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct -1 ### Reported statistics experiments Not reported rank 12 scoresByTask {"MIRACLReranking":0.59252,"MIRACLRetrievalHardNegatives.v2":0.51827,"MLSUMClusteringP2P":0.489102,"MLSUMClusteringS2S":0.492313,"MintakaRetrieval":0.41801,"PawsXPairClassification":0.5951044999999999,"STS17":0.8723350000000001,"STS22":0.676019,"STSBenchmarkMultilingualSTS":0.8338570000000001,"STSES":0.781869,"SpanishNewsClassification.v2":0.90332,"SpanishPassageRetrievalS2P":0.45088,"SpanishPassageRetrievalS2S":0.67756,"SpanishSentimentClassification.v2":0.889051,"XNLI":0.7199335,"XPQARetrieval":0.6117466666666668} scoresByTaskType {"Classification":0.8961855000000001,"Clustering":0.49070749999999996,"PairClassification":0.657519,"Reranking":0.59252,"Retrieval":0.5352933333333334,"STS":0.7910200000000001} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(spa%2C%20v1)/scores) Source MTEB Original model label openai/text-embedding-3-small Observed 2026-10-21T16:40:36.375Z Evidence SHA-256 `c8eba8bf2233665c86eba5e08e282beb5d4c20ed913f54f2b53d398a89d7ffcf` Source locator `/rows/11` |  |  |  |
| 4 | [Bge m3](https://benchize.com/models/bge-m3.md) | 0.65source score |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.647601278773842 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.6632681346410666 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 87 ### Reported statistics experiments Not reported rank 16 scoresByTask {"MIRACLReranking":0.63971,"MIRACLRetrievalHardNegatives.v2":0.57274,"MLSUMClusteringP2P":0.45277449999999997,"MLSUMClusteringS2S":0.456199,"MintakaRetrieval":0.22341,"PawsXPairClassification":0.5675139376707932,"STS17":0.814534314580825,"STS22":0.69507,"STSBenchmarkMultilingualSTS":0.835791,"STSES":0.7750423747965199,"SpanishNewsClassification.v2":0.88252,"SpanishPassageRetrievalS2P":0.44017,"SpanishPassageRetrievalS2S":0.70373,"SpanishSentimentClassification.v2":0.953285,"XNLI":0.819357,"XPQARetrieval":0.5297733333333333} scoresByTaskType {"Classification":0.9179025000000001,"Clustering":0.45448675,"PairClassification":0.6934354688353965,"Reranking":0.63971,"Retrieval":0.49396466666666666,"STS":0.7801094223443362} trainedOnTasks ["MIRACLReranking","MIRACLRetrievalHardNegatives.v2"] ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(spa%2C%20v1)/scores) Source MTEB Original model label BAAI/bge-m3 Observed 2026-10-21T16:40:36.375Z Evidence SHA-256 `c8eba8bf2233665c86eba5e08e282beb5d4c20ed913f54f2b53d398a89d7ffcf` Source locator `/rows/15` |  |  |  |
| 5 | [Multilingual-E5-Large](https://benchize.com/models/multilingual-e5-large.md) | 0.65source score |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.6474406676111926 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.6561661037808139 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 87 ### Reported statistics experiments Not reported rank 15 scoresByTask {"MIRACLReranking":0.61653,"MIRACLRetrievalHardNegatives.v2":0.53331,"MLSUMClusteringP2P":0.4630645,"MLSUMClusteringS2S":0.468098,"MintakaRetrieval":0.34233,"PawsXPairClassification":0.5542009999999999,"STS17":0.837241169816513,"STS22":0.682316,"STSBenchmarkMultilingualSTS":0.8506525,"STSES":0.8021052030021173,"SpanishNewsClassification.v2":0.886182,"SpanishPassageRetrievalS2P":0.41957,"SpanishPassageRetrievalS2S":0.72324,"SpanishSentimentClassification.v2":0.924088,"XNLI":0.7488556422937852,"XPQARetrieval":0.5072666666666666} scoresByTaskType {"Classification":0.905135,"Clustering":0.46558125,"PairClassification":0.6515283211468925,"Reranking":0.61653,"Retrieval":0.5051433333333334,"STS":0.7930787182046576} trainedOnTasks ["MIRACLReranking","MIRACLRetrievalHardNegatives.v2"] ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(spa%2C%20v1)/scores) Source MTEB Original model label intfloat/multilingual-e5-large Observed 2026-10-21T16:40:36.375Z Evidence SHA-256 `c8eba8bf2233665c86eba5e08e282beb5d4c20ed913f54f2b53d398a89d7ffcf` Source locator `/rows/14` |  |  |  |

---
Cite as: MTEB(spa, v1) · Spanish — Benchize, https://benchize.com/benchmarks/mteb%3AMTEB(spa%2C%20v1) (retrieved 2026-10-21)
