# RTEB(fra, beta) · RTEB French > Source: Benchize (https://benchize.com) — https://benchize.com/benchmarks/mteb%3ARTEB(fra%2C%20beta). When citing or reusing this content, credit "Benchize" and link to https://benchize.com/benchmarks/mteb%3ARTEB(fra%2C%20beta). Retrieval quality in French across legal and general knowledge domains, with tasks representative of real-world production retrieval demands. A French-language subset of RTEB. Includes both open and closed datasets; to submit results on private tasks, please [open an issue](https://github.com/embeddings-benchmark/mteb/issues).Note: We have temporarily removed the 'Private' column to read more about this decision out the [announcement](https://github.com/embeddings-benchmark/mteb/issues/3934). Canonical URL: https://benchize.com/benchmarks/mteb%3ARTEB(fra%2C%20beta) Last updated: Wed, 21 Oct 2026 18:52:20 GMT Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations. Retrieval quality in French across legal and general knowledge domains, with tasks representative of real-world production retrieval demands. A French-language subset of RTEB. Includes both open and closed datasets; to submit results on private tasks, please [open an issue](https://github.com/embeddings-benchmark/mteb/issues).Note: We have temporarily removed the 'Private' column to read more about this decision out the [announcement](https://github.com/embeddings-benchmark/mteb/issues/3934). Embeddings · Models tested: 17 · Score publishers: MTEB ## Model results | # | Model | Score | | | --- | --- | --- | --- | | 1 | [Qwen3 Embedding](https://benchize.com/models/qwen3-embedding.md) | 0.6source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.5951390909090909 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 13 scoresByTask {"CUREv1":0.5951390909090909,"French1Retrieval":0.86754,"FrenchLegal1Retrieval":0.89591} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(fra%2C%20beta)/scores) Source MTEB Original model label Qwen/Qwen3-Embedding-8B Observed 2026-10-21T16:40:40.473Z Evidence SHA-256 `ec979a256821300f551b7822b61d94415dd4bf631591e9b647f2b6ae5b4b60f4` Source locator `/rows/12` | | | | | 2 | [Gemini Embedding 001](https://benchize.com/models/gemini-embedding-001.md) | 0.58source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.5836481818181819 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 15 scoresByTask {"CUREv1":0.5836481818181819,"French1Retrieval":0.87811,"FrenchLegal1Retrieval":0.86959} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(fra%2C%20beta)/scores) Source MTEB Original model label google/gemini-embedding-001 Observed 2026-10-21T16:40:40.473Z Evidence SHA-256 `ec979a256821300f551b7822b61d94415dd4bf631591e9b647f2b6ae5b4b60f4` Source locator `/rows/14` | | | | | 3 | [Text Embedding 3 Large](https://benchize.com/models/text-embedding-3-large.md) | 0.57source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.5685618181818182 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct -1 ### Reported statistics experiments Not reported rank 19 scoresByTask {"CUREv1":0.5685618181818182,"French1Retrieval":0.80504,"FrenchLegal1Retrieval":0.70051} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(fra%2C%20beta)/scores) Source MTEB Original model label openai/text-embedding-3-large Observed 2026-10-21T16:40:40.473Z Evidence SHA-256 `ec979a256821300f551b7822b61d94415dd4bf631591e9b647f2b6ae5b4b60f4` Source locator `/rows/18` | | | | | 4 | [Gemini Embedding 2](https://benchize.com/models/gemini-embedding-2.md) | 0.57source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.5674936363636364 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 21 scoresByTask {"CUREv1":0.5674936363636364} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(fra%2C%20beta)/scores) Source MTEB Original model label google/gemini-embedding-2-preview Observed 2026-10-21T16:40:40.473Z Evidence SHA-256 `ec979a256821300f551b7822b61d94415dd4bf631591e9b647f2b6ae5b4b60f4` Source locator `/rows/20` | | | | | 5 | [Bge m3](https://benchize.com/models/bge-m3.md) | 0.5source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.5008881818181817 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 44 scoresByTask {"CUREv1":0.5008881818181817,"French1Retrieval":0.82796,"FrenchLegal1Retrieval":0.63001} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(fra%2C%20beta)/scores) Source MTEB Original model label BAAI/bge-m3 Observed 2026-10-21T16:40:40.473Z Evidence SHA-256 `ec979a256821300f551b7822b61d94415dd4bf631591e9b647f2b6ae5b4b60f4` Source locator `/rows/43` | | | | | 6 | [Multilingual-E5-Large](https://benchize.com/models/multilingual-e5-large.md) | 0.47source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.47035727272727273 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 56 scoresByTask {"CUREv1":0.47035727272727273} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(fra%2C%20beta)/scores) Source MTEB Original model label intfloat/multilingual-e5-large Observed 2026-10-21T16:40:40.473Z Evidence SHA-256 `ec979a256821300f551b7822b61d94415dd4bf631591e9b647f2b6ae5b4b60f4` Source locator `/rows/55` | | | | | 7 | [Text Embedding 3 Small](https://benchize.com/models/text-embedding-3-small.md) | 0.44source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.4421545454545454 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct -1 ### Reported statistics experiments Not reported rank 65 scoresByTask {"CUREv1":0.4421545454545454,"French1Retrieval":0.82459,"FrenchLegal1Retrieval":0.62906} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(fra%2C%20beta)/scores) Source MTEB Original model label openai/text-embedding-3-small Observed 2026-10-21T16:40:40.473Z Evidence SHA-256 `ec979a256821300f551b7822b61d94415dd4bf631591e9b647f2b6ae5b4b60f4` Source locator `/rows/64` | | | | | 8 | [E5-Large-v2](https://benchize.com/models/e5-large-v2.md) | 0.3source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.2963572727272727 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 98 scoresByTask {"CUREv1":0.2963572727272727} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(fra%2C%20beta)/scores) Source MTEB Original model label intfloat/e5-large-v2 Observed 2026-10-21T16:40:40.473Z Evidence SHA-256 `ec979a256821300f551b7822b61d94415dd4bf631591e9b647f2b6ae5b4b60f4` Source locator `/rows/97` | | | | | 9 | [GTE-Large](https://benchize.com/models/gte-large.md) | 0.28source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.2772909090909091 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct -1 ### Reported statistics experiments Not reported rank 106 scoresByTask {"CUREv1":0.2772909090909091} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(fra%2C%20beta)/scores) Source MTEB Original model label thenlper/gte-large Observed 2026-10-21T16:40:40.473Z Evidence SHA-256 `ec979a256821300f551b7822b61d94415dd4bf631591e9b647f2b6ae5b4b60f4` Source locator `/rows/105` | | | | | 10 | [BGE Large EN V1.5](https://benchize.com/models/bge-large-en-v1-5.md) | 0.26source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.26433545454545454 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 114 scoresByTask {"CUREv1":0.26433545454545454,"French1Retrieval":0.79853,"FrenchLegal1Retrieval":0.3366} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(fra%2C%20beta)/scores) Source MTEB Original model label BAAI/bge-large-en-v1.5 Observed 2026-10-21T16:40:40.473Z Evidence SHA-256 `ec979a256821300f551b7822b61d94415dd4bf631591e9b647f2b6ae5b4b60f4` Source locator `/rows/113` | | | | | 11 | [E5-Base-v2](https://benchize.com/models/e5-base-v2.md) | 0.25source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.25357545454545455 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 117 scoresByTask {"CUREv1":0.25357545454545455} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(fra%2C%20beta)/scores) Source MTEB Original model label intfloat/e5-base-v2 Observed 2026-10-21T16:40:40.473Z Evidence SHA-256 `ec979a256821300f551b7822b61d94415dd4bf631591e9b647f2b6ae5b4b60f4` Source locator `/rows/116` | | | | | 12 | [GTE-Base](https://benchize.com/models/gte-base.md) | 0.24source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.2391136363636364 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct -1 ### Reported statistics experiments Not reported rank 120 scoresByTask {"CUREv1":0.2391136363636364} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(fra%2C%20beta)/scores) Source MTEB Original model label thenlper/gte-base Observed 2026-10-21T16:40:40.473Z Evidence SHA-256 `ec979a256821300f551b7822b61d94415dd4bf631591e9b647f2b6ae5b4b60f4` Source locator `/rows/119` | | | | | 13 | [BGE Base EN V1.5](https://benchize.com/models/bge-base-en-v1-5.md) | 0.23source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.23401545454545455 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 122 scoresByTask {"CUREv1":0.23401545454545455,"French1Retrieval":0.76901,"FrenchLegal1Retrieval":0.27591} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(fra%2C%20beta)/scores) Source MTEB Original model label BAAI/bge-base-en-v1.5 Observed 2026-10-21T16:40:40.473Z Evidence SHA-256 `ec979a256821300f551b7822b61d94415dd4bf631591e9b647f2b6ae5b4b60f4` Source locator `/rows/121` | | | | | 14 | [all-MiniLM-L12-v2](https://benchize.com/models/all-minilm-l12-v2.md) | 0.13source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.12899727272727274 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 163 scoresByTask {"CUREv1":0.12899727272727274,"French1Retrieval":0.69348,"FrenchLegal1Retrieval":0.09066} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(fra%2C%20beta)/scores) Source MTEB Original model label sentence-transformers/all-MiniLM-L12-v2 Observed 2026-10-21T16:40:40.473Z Evidence SHA-256 `ec979a256821300f551b7822b61d94415dd4bf631591e9b647f2b6ae5b4b60f4` Source locator `/rows/162` | | | | | 15 | [All Mpnet Base V2](https://benchize.com/models/all-mpnet-base-v2.md) | 0.13source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.12629545454545454 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 164 scoresByTask {"CUREv1":0.12629545454545454,"French1Retrieval":0.66649,"FrenchLegal1Retrieval":0.24001} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(fra%2C%20beta)/scores) Source MTEB Original model label sentence-transformers/all-mpnet-base-v2 Observed 2026-10-21T16:40:40.473Z Evidence SHA-256 `ec979a256821300f551b7822b61d94415dd4bf631591e9b647f2b6ae5b4b60f4` Source locator `/rows/163` | | | | | 16 | [all-MiniLM-L6-v2](https://benchize.com/models/all-minilm-l6-v2.md) | 0.1source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.10204909090909092 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 166 scoresByTask {"CUREv1":0.10204909090909092,"French1Retrieval":0.64307,"FrenchLegal1Retrieval":0.1652} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(fra%2C%20beta)/scores) Source MTEB Original model label sentence-transformers/all-MiniLM-L6-v2 Observed 2026-10-21T16:40:40.473Z Evidence SHA-256 `ec979a256821300f551b7822b61d94415dd4bf631591e9b647f2b6ae5b4b60f4` Source locator `/rows/166` | | | | | 17 | [BGE Large ZH V1.5](https://benchize.com/models/bge-large-zh-v1-5.md) | 0.05source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.053692727272727274 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 183 scoresByTask {"CUREv1":0.053692727272727274,"French1Retrieval":0.46979,"FrenchLegal1Retrieval":0.15767} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(fra%2C%20beta)/scores) Source MTEB Original model label BAAI/bge-large-zh-v1.5 Observed 2026-10-21T16:40:40.473Z Evidence SHA-256 `ec979a256821300f551b7822b61d94415dd4bf631591e9b647f2b6ae5b4b60f4` Source locator `/rows/182` | | | | --- Cite as: RTEB(fra, beta) · RTEB French — Benchize, https://benchize.com/benchmarks/mteb%3ARTEB(fra%2C%20beta) (retrieved 2026-10-21)