# MTEB(fra, v1) · French > Source: Benchize (https://benchize.com) — https://benchize.com/benchmarks/mteb%3AMTEB(fra%2C%20v1). When citing or reusing this content, credit "Benchize" and link to https://benchize.com/benchmarks/mteb%3AMTEB(fra%2C%20v1). French text embedding quality across classification, clustering, pair classification, reranking, retrieval, and semantic similarity, using high-quality native French datasets. Canonical URL: https://benchize.com/benchmarks/mteb%3AMTEB(fra%2C%20v1) Last updated: Wed, 21 Oct 2026 18:52:20 GMT Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations. French text embedding quality across classification, clustering, pair classification, reranking, retrieval, and semantic similarity, using high-quality native French datasets. Embeddings · Models tested: 7 · Score publishers: [MTEB](https://arxiv.org/abs/2405.20468) ## Model results | # | Model | Score | | | --- | --- | --- | --- | | 1 | [E5-Large-v2](https://benchize.com/models/e5-large-v2.md) | 0.52source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.5190197886117182 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.5331756761261679 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 59 scoresByTask {"AlloProfClusteringP2P":0.587541,"AlloProfClusteringS2S":0.349175,"AlloprofReranking":0.6512298546739727,"AlloprofRetrieval":0.34131,"AmazonReviewsClassification":0.37439999999999996,"BSARDRetrieval":0.44595,"HALClusteringS2S":0.233908,"MLSUMClusteringP2P":0.415667,"MLSUMClusteringS2S":0.4219695,"MTOPDomainClassification":0.829504,"MTOPIntentClassification":0.4534595,"MasakhaNEWSClassification":0.754739336492891,"MasakhaNEWSClusteringP2P":0.366986,"MasakhaNEWSClusteringS2S":0.45309116791799176,"MassiveIntentClassification":0.5071565140216686,"MassiveScenarioClassification":0.578057,"MintakaRetrieval":0.25453,"PawsXPairClassification":0.5600241755197637,"SICKFr":0.7137724999999999,"STS22":0.787462,"STSBenchmarkMultilingualSTS":0.7565685,"SummEvalFr":0.303915,"SyntecReranking":0.759222,"SyntecRetrieval":0.71137,"XPQARetrieval":0.3644866666666666} scoresByTaskType {"Classification":0.5828860584190932,"Clustering":0.40404823827399877,"PairClassification":0.5600241755197637,"Reranking":0.7052259273369863,"Retrieval":0.4235293333333333,"STS":0.752601,"Summarization":0.303915} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(fra%2C%20v1)/scores) Source MTEB Original model label intfloat/e5-large-v2 Observed 2026-10-21T16:40:33.844Z Evidence SHA-256 `e2ba55b8933730b983cec761c965ff540336068780c799c6af25183ac4e52267` Source locator `/rows/58` | | | | | 2 | [BGE Large EN V1.5](https://benchize.com/models/bge-large-en-v1-5.md) | 0.51source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.5148988433400877 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.5256277838390261 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 96 ### Reported statistics experiments Not reported rank 64 scoresByTask {"AlloProfClusteringP2P":0.603086,"AlloProfClusteringS2S":0.411459,"AlloprofReranking":0.6741453775649174,"AlloprofRetrieval":0.38742,"AmazonReviewsClassification":0.31220000000000003,"BSARDRetrieval":0.42793,"HALClusteringS2S":0.253623,"MLSUMClusteringP2P":0.4152675,"MLSUMClusteringS2S":0.41697649999999997,"MTOPDomainClassification":0.8046915,"MTOPIntentClassification":0.42177699999999996,"MasakhaNEWSClassification":0.7696682464454977,"MasakhaNEWSClusteringP2P":0.467083,"MasakhaNEWSClusteringS2S":0.4891940076549746,"MassiveIntentClassification":0.47717086366810435,"MassiveScenarioClassification":0.5728774999999999,"MintakaRetrieval":0.20442,"PawsXPairClassification":0.5500204215020319,"SICKFr":0.6928225,"STS22":0.794262,"STSBenchmarkMultilingualSTS":0.727131,"SummEvalFr":0.295038,"SyntecReranking":0.726651,"SyntecRetrieval":0.62295,"XPQARetrieval":0.3546066666666667} scoresByTaskType {"Classification":0.5597308516856003,"Clustering":0.43666985823642496,"PairClassification":0.5500204215020319,"Reranking":0.7003981887824587,"Retrieval":0.39946533333333334,"STS":0.7380718333333333,"Summarization":0.295038} trainedOnTasks ["AmazonReviewsClassification"] ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(fra%2C%20v1)/scores) Source MTEB Original model label BAAI/bge-large-en-v1.5 Observed 2026-10-21T16:40:33.844Z Evidence SHA-256 `e2ba55b8933730b983cec761c965ff540336068780c799c6af25183ac4e52267` Source locator `/rows/63` | | | | | 3 | [GTE-Large](https://benchize.com/models/gte-large.md) | 0.51source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.51470008 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.5306739795918367 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct -1 ### Reported statistics experiments Not reported rank 63 scoresByTask {"AlloProfClusteringP2P":0.576702,"AlloProfClusteringS2S":0.384662,"AlloprofReranking":0.70544,"AlloprofRetrieval":0.41356,"AmazonReviewsClassification":0.31093,"BSARDRetrieval":0.40541,"HALClusteringS2S":0.240663,"MLSUMClusteringP2P":0.4271285,"MLSUMClusteringS2S":0.419182,"MTOPDomainClassification":0.802007,"MTOPIntentClassification":0.38140949999999996,"MasakhaNEWSClassification":0.756635,"MasakhaNEWSClusteringP2P":0.430697,"MasakhaNEWSClusteringS2S":0.535602,"MassiveIntentClassification":0.451715,"MassiveScenarioClassification":0.5665065,"MintakaRetrieval":0.20553,"PawsXPairClassification":0.5746925,"SICKFr":0.6878925,"STS22":0.808783,"STSBenchmarkMultilingualSTS":0.7576815,"SummEvalFr":0.291358,"SyntecReranking":0.724675,"SyntecRetrieval":0.63912,"XPQARetrieval":0.36952} scoresByTaskType {"Classification":0.5448671666666667,"Clustering":0.4306623571428571,"PairClassification":0.5746925,"Reranking":0.7150574999999999,"Retrieval":0.406628,"STS":0.7514523333333333,"Summarization":0.291358} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(fra%2C%20v1)/scores) Source MTEB Original model label thenlper/gte-large Observed 2026-10-21T16:40:33.844Z Evidence SHA-256 `e2ba55b8933730b983cec761c965ff540336068780c799c6af25183ac4e52267` Source locator `/rows/62` | | | | | 4 | [E5-Base-v2](https://benchize.com/models/e5-base-v2.md) | 0.51source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.5111493542828796 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.5257419838872678 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 66 scoresByTask {"AlloProfClusteringP2P":0.585471,"AlloProfClusteringS2S":0.363475,"AlloprofReranking":0.654093169654747,"AlloprofRetrieval":0.31859,"AmazonReviewsClassification":0.32354000000000005,"BSARDRetrieval":0.43243,"HALClusteringS2S":0.223287,"MLSUMClusteringP2P":0.416798,"MLSUMClusteringS2S":0.41427749999999997,"MTOPDomainClassification":0.8056175,"MTOPIntentClassification":0.415021,"MasakhaNEWSClassification":0.7535545023696683,"MasakhaNEWSClusteringP2P":0.505629,"MasakhaNEWSClusteringS2S":0.4725881903652381,"MassiveIntentClassification":0.46169702100943044,"MassiveScenarioClassification":0.5680605000000001,"MintakaRetrieval":0.2351,"PawsXPairClassification":0.5425836403395701,"SICKFr":0.6837895,"STS22":0.76927,"STSBenchmarkMultilingualSTS":0.742783,"SummEvalFr":0.31866,"SyntecReranking":0.759115,"SyntecRetrieval":0.67336,"XPQARetrieval":0.3399433333333333} scoresByTaskType {"Classification":0.5545817538965164,"Clustering":0.4259322414807483,"PairClassification":0.5425836403395701,"Reranking":0.7066040848273735,"Retrieval":0.3998846666666666,"STS":0.7319475,"Summarization":0.31866} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(fra%2C%20v1)/scores) Source MTEB Original model label intfloat/e5-base-v2 Observed 2026-10-21T16:40:33.844Z Evidence SHA-256 `e2ba55b8933730b983cec761c965ff540336068780c799c6af25183ac4e52267` Source locator `/rows/65` | | | | | 5 | [GTE-Base](https://benchize.com/models/gte-base.md) | 0.5source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.49599163333333335 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.5169473163265306 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct -1 ### Reported statistics experiments Not reported rank 71 scoresByTask {"AlloProfClusteringP2P":0.600513,"AlloProfClusteringS2S":0.370729,"AlloprofReranking":0.665411,"AlloprofRetrieval":0.34561,"AmazonReviewsClassification":0.28625999999999996,"BSARDRetrieval":0.33784,"HALClusteringS2S":0.229799,"MLSUMClusteringP2P":0.4260465,"MLSUMClusteringS2S":0.41379600000000005,"MTOPDomainClassification":0.7708955,"MTOPIntentClassification":0.3927305,"MasakhaNEWSClassification":0.757109,"MasakhaNEWSClusteringP2P":0.37263,"MasakhaNEWSClusteringS2S":0.474905,"MassiveIntentClassification":0.441318,"MassiveScenarioClassification":0.545847,"MintakaRetrieval":0.17143,"PawsXPairClassification":0.5646445,"SICKFr":0.6600985,"STS22":0.810505,"STSBenchmarkMultilingualSTS":0.732599,"SummEvalFr":0.293614,"SyntecReranking":0.767357,"SyntecRetrieval":0.62449,"XPQARetrieval":0.3436133333333333} scoresByTaskType {"Classification":0.53236,"Clustering":0.41263121428571425,"PairClassification":0.5646445,"Reranking":0.7163839999999999,"Retrieval":0.3645966666666666,"STS":0.7344008333333334,"Summarization":0.293614} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(fra%2C%20v1)/scores) Source MTEB Original model label thenlper/gte-base Observed 2026-10-21T16:40:33.844Z Evidence SHA-256 `e2ba55b8933730b983cec761c965ff540336068780c799c6af25183ac4e52267` Source locator `/rows/71` | | | | | 6 | [BGE Base EN V1.5](https://benchize.com/models/bge-base-en-v1-5.md) | 0.49source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.4923401180868293 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.5090301672406726 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 96 ### Reported statistics experiments Not reported rank 77 scoresByTask {"AlloProfClusteringP2P":0.597755,"AlloProfClusteringS2S":0.383015,"AlloprofReranking":0.6218705897681431,"AlloprofRetrieval":0.31285,"AmazonReviewsClassification":0.28907,"BSARDRetrieval":0.36036,"HALClusteringS2S":0.231838,"MLSUMClusteringP2P":0.412689,"MLSUMClusteringS2S":0.4085925,"MTOPDomainClassification":0.7644295000000001,"MTOPIntentClassification":0.403453,"MasakhaNEWSClassification":0.7606635071090048,"MasakhaNEWSClusteringP2P":0.474066,"MasakhaNEWSClusteringS2S":0.4415491927838793,"MassiveIntentClassification":0.44195032137849233,"MassiveScenarioClassification":0.5445720000000001,"MintakaRetrieval":0.19269,"PawsXPairClassification":0.5558801744645467,"SICKFr":0.650105,"STS22":0.757175,"STSBenchmarkMultilingualSTS":0.6992375,"SummEvalFr":0.307167,"SyntecReranking":0.729968,"SyntecRetrieval":0.63703,"XPQARetrieval":0.3305266666666667} scoresByTaskType {"Classification":0.5340230547479162,"Clustering":0.4213578132548399,"PairClassification":0.5558801744645467,"Reranking":0.6759192948840715,"Retrieval":0.36669133333333337,"STS":0.7021725,"Summarization":0.307167} trainedOnTasks ["AmazonReviewsClassification"] ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(fra%2C%20v1)/scores) Source MTEB Original model label BAAI/bge-base-en-v1.5 Observed 2026-10-21T16:40:33.844Z Evidence SHA-256 `e2ba55b8933730b983cec761c965ff540336068780c799c6af25183ac4e52267` Source locator `/rows/76` | | | | | 7 | [all-MiniLM-L6-v2](https://benchize.com/models/all-minilm-l6-v2.md) | 0.45source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.45244487652103443 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.4795393290890028 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 111 scoresByTask {"AlloProfClusteringP2P":0.518308,"AlloProfClusteringS2S":0.320659,"AlloprofReranking":0.6262172640988071,"AlloprofRetrieval":0.28413,"AmazonReviewsClassification":0.26937,"BSARDRetrieval":0.27477,"HALClusteringS2S":0.188409,"MLSUMClusteringP2P":0.35714900000000005,"MLSUMClusteringS2S":0.34793399999999997,"MTOPDomainClassification":0.7533626387462586,"MTOPIntentClassification":0.40396769963464385,"MasakhaNEWSClassification":0.688388625592417,"MasakhaNEWSClusteringP2P":0.3492044210457986,"MasakhaNEWSClusteringS2S":0.4057681708831091,"MassiveIntentClassification":0.42246626857258723,"MassiveScenarioClassification":0.5086675,"MintakaRetrieval":0.09195,"PawsXPairClassification":0.5557581725988825,"SICKFr":0.6263990638546257,"STS22":0.7700398643056744,"STSBenchmarkMultilingualSTS":0.685019765897922,"SummEvalFr":0.2828840927157683,"SyntecReranking":0.673079365079365,"SyntecRetrieval":0.60148,"XPQARetrieval":0.30574} scoresByTaskType {"Classification":0.5077037887576511,"Clustering":0.35534737027555824,"PairClassification":0.5557581725988825,"Reranking":0.6496483145890861,"Retrieval":0.31161399999999995,"STS":0.693819564686074,"Summarization":0.2828840927157683} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(fra%2C%20v1)/scores) Source MTEB Original model label sentence-transformers/all-MiniLM-L6-v2 Observed 2026-10-21T16:40:33.844Z Evidence SHA-256 `e2ba55b8933730b983cec761c965ff540336068780c799c6af25183ac4e52267` Source locator `/rows/110` | | | | --- Cite as: MTEB(fra, v1) · French — Benchize, https://benchize.com/benchmarks/mteb%3AMTEB(fra%2C%20v1) (retrieved 2026-10-21)