# RTEB(deu, beta) · RTEB German > Source: Benchize (https://benchize.com) — https://benchize.com/benchmarks/mteb%3ARTEB(deu%2C%20beta). When citing or reusing this content, credit "Benchize" and link to https://benchize.com/benchmarks/mteb%3ARTEB(deu%2C%20beta). Retrieval quality in German across legal, healthcare, and business domains, with tasks representative of real-world production retrieval demands. A German-language subset of RTEB. Includes both open and closed datasets; to submit results on private tasks, please [open an issue](https://github.com/embeddings-benchmark/mteb/issues).Note: We have temporarily removed the 'Private' column to read more about this decision out the [announcement](https://github.com/embeddings-benchmark/mteb/issues/3934). Canonical URL: https://benchize.com/benchmarks/mteb%3ARTEB(deu%2C%20beta) Last updated: Wed, 21 Oct 2026 18:52:20 GMT Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations. Retrieval quality in German across legal, healthcare, and business domains, with tasks representative of real-world production retrieval demands. A German-language subset of RTEB. Includes both open and closed datasets; to submit results on private tasks, please [open an issue](https://github.com/embeddings-benchmark/mteb/issues).Note: We have temporarily removed the 'Private' column to read more about this decision out the [announcement](https://github.com/embeddings-benchmark/mteb/issues/3934). Embeddings · Models tested: 17 · Score publishers: MTEB ## Model results | # | Model | Score | | | --- | --- | --- | --- | | 1 | [Qwen3 Embedding](https://benchize.com/models/qwen3-embedding.md) | 0.67source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.66846 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 29 scoresByTask {"German1Retrieval":0.96967,"GermanHealthcare1Retrieval":0.8762,"GermanLegal1Retrieval":0.69769,"LegalQuAD":0.66846} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(deu%2C%20beta)/scores) Source MTEB Original model label Qwen/Qwen3-Embedding-8B Observed 2026-10-21T16:40:40.727Z Evidence SHA-256 `70250aaee4788084a090cdccd91621a3c80bbf5076195bc3f215bcb392e7637d` Source locator `/rows/28` | | | | | 2 | [Gemini Embedding 001](https://benchize.com/models/gemini-embedding-001.md) | 0.66source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.65532 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 31 scoresByTask {"German1Retrieval":0.97613,"GermanHealthcare1Retrieval":0.87423,"GermanLegal1Retrieval":0.71492,"LegalQuAD":0.65532} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(deu%2C%20beta)/scores) Source MTEB Original model label google/gemini-embedding-001 Observed 2026-10-21T16:40:40.727Z Evidence SHA-256 `70250aaee4788084a090cdccd91621a3c80bbf5076195bc3f215bcb392e7637d` Source locator `/rows/30` | | | | | 3 | [Text Embedding 3 Large](https://benchize.com/models/text-embedding-3-large.md) | 0.56source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.56336 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct -1 ### Reported statistics experiments Not reported rank 58 scoresByTask {"German1Retrieval":0.97528,"GermanHealthcare1Retrieval":0.81089,"GermanLegal1Retrieval":0.66654,"LegalQuAD":0.56336} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(deu%2C%20beta)/scores) Source MTEB Original model label openai/text-embedding-3-large Observed 2026-10-21T16:40:40.727Z Evidence SHA-256 `70250aaee4788084a090cdccd91621a3c80bbf5076195bc3f215bcb392e7637d` Source locator `/rows/57` | | | | | 4 | [Text Embedding 3 Small](https://benchize.com/models/text-embedding-3-small.md) | 0.55source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.54807 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct -1 ### Reported statistics experiments Not reported rank 61 scoresByTask {"German1Retrieval":0.95885,"GermanHealthcare1Retrieval":0.70356,"GermanLegal1Retrieval":0.61798,"LegalQuAD":0.54807} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(deu%2C%20beta)/scores) Source MTEB Original model label openai/text-embedding-3-small Observed 2026-10-21T16:40:40.727Z Evidence SHA-256 `70250aaee4788084a090cdccd91621a3c80bbf5076195bc3f215bcb392e7637d` Source locator `/rows/60` | | | | | 5 | [Bge m3](https://benchize.com/models/bge-m3.md) | 0.5source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.50356 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 68 scoresByTask {"German1Retrieval":0.92453,"GermanHealthcare1Retrieval":0.72479,"GermanLegal1Retrieval":0.60887,"LegalQuAD":0.50356} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(deu%2C%20beta)/scores) Source MTEB Original model label BAAI/bge-m3 Observed 2026-10-21T16:40:40.727Z Evidence SHA-256 `70250aaee4788084a090cdccd91621a3c80bbf5076195bc3f215bcb392e7637d` Source locator `/rows/67` | | | | | 6 | [Multilingual-E5-Large](https://benchize.com/models/multilingual-e5-large.md) | 0.43source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.43172 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 90 scoresByTask {"LegalQuAD":0.43172} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(deu%2C%20beta)/scores) Source MTEB Original model label intfloat/multilingual-e5-large Observed 2026-10-21T16:40:40.727Z Evidence SHA-256 `70250aaee4788084a090cdccd91621a3c80bbf5076195bc3f215bcb392e7637d` Source locator `/rows/89` | | | | | 7 | [E5-Large-v2](https://benchize.com/models/e5-large-v2.md) | 0.27source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.27182 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 113 scoresByTask {"LegalQuAD":0.27182} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(deu%2C%20beta)/scores) Source MTEB Original model label intfloat/e5-large-v2 Observed 2026-10-21T16:40:40.727Z Evidence SHA-256 `70250aaee4788084a090cdccd91621a3c80bbf5076195bc3f215bcb392e7637d` Source locator `/rows/112` | | | | | 8 | [Gemini Embedding 2](https://benchize.com/models/gemini-embedding-2.md) | 0.26source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.26411 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 117 scoresByTask {"LegalQuAD":0.26411} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(deu%2C%20beta)/scores) Source MTEB Original model label google/gemini-embedding-2-preview Observed 2026-10-21T16:40:40.727Z Evidence SHA-256 `70250aaee4788084a090cdccd91621a3c80bbf5076195bc3f215bcb392e7637d` Source locator `/rows/116` | | | | | 9 | [E5-Base-v2](https://benchize.com/models/e5-base-v2.md) | 0.22source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.22319 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 126 scoresByTask {"LegalQuAD":0.22319} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(deu%2C%20beta)/scores) Source MTEB Original model label intfloat/e5-base-v2 Observed 2026-10-21T16:40:40.727Z Evidence SHA-256 `70250aaee4788084a090cdccd91621a3c80bbf5076195bc3f215bcb392e7637d` Source locator `/rows/125` | | | | | 10 | [GTE-Large](https://benchize.com/models/gte-large.md) | 0.2source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.19816 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct -1 ### Reported statistics experiments Not reported rank 134 scoresByTask {"LegalQuAD":0.19816} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(deu%2C%20beta)/scores) Source MTEB Original model label thenlper/gte-large Observed 2026-10-21T16:40:40.727Z Evidence SHA-256 `70250aaee4788084a090cdccd91621a3c80bbf5076195bc3f215bcb392e7637d` Source locator `/rows/133` | | | | | 11 | [BGE Large EN V1.5](https://benchize.com/models/bge-large-en-v1-5.md) | 0.17source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.16557 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 144 scoresByTask {"German1Retrieval":0.73326,"GermanHealthcare1Retrieval":0.37351,"GermanLegal1Retrieval":0.39161,"LegalQuAD":0.16557} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(deu%2C%20beta)/scores) Source MTEB Original model label BAAI/bge-large-en-v1.5 Observed 2026-10-21T16:40:40.727Z Evidence SHA-256 `70250aaee4788084a090cdccd91621a3c80bbf5076195bc3f215bcb392e7637d` Source locator `/rows/143` | | | | | 12 | [BGE Base EN V1.5](https://benchize.com/models/bge-base-en-v1-5.md) | 0.16source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.16008 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 152 scoresByTask {"German1Retrieval":0.62744,"GermanHealthcare1Retrieval":0.34764,"GermanLegal1Retrieval":0.40846,"LegalQuAD":0.16008} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(deu%2C%20beta)/scores) Source MTEB Original model label BAAI/bge-base-en-v1.5 Observed 2026-10-21T16:40:40.727Z Evidence SHA-256 `70250aaee4788084a090cdccd91621a3c80bbf5076195bc3f215bcb392e7637d` Source locator `/rows/151` | | | | | 13 | [GTE-Base](https://benchize.com/models/gte-base.md) | 0.16source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.15707 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct -1 ### Reported statistics experiments Not reported rank 155 scoresByTask {"LegalQuAD":0.15707} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(deu%2C%20beta)/scores) Source MTEB Original model label thenlper/gte-base Observed 2026-10-21T16:40:40.727Z Evidence SHA-256 `70250aaee4788084a090cdccd91621a3c80bbf5076195bc3f215bcb392e7637d` Source locator `/rows/154` | | | | | 14 | [all-MiniLM-L6-v2](https://benchize.com/models/all-minilm-l6-v2.md) | 0.12source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.11811 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 178 scoresByTask {"German1Retrieval":0.45009,"GermanHealthcare1Retrieval":0.2513,"GermanLegal1Retrieval":0.37473,"LegalQuAD":0.11811} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(deu%2C%20beta)/scores) Source MTEB Original model label sentence-transformers/all-MiniLM-L6-v2 Observed 2026-10-21T16:40:40.727Z Evidence SHA-256 `70250aaee4788084a090cdccd91621a3c80bbf5076195bc3f215bcb392e7637d` Source locator `/rows/178` | | | | | 15 | [All Mpnet Base V2](https://benchize.com/models/all-mpnet-base-v2.md) | 0.11source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.10669 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 187 scoresByTask {"German1Retrieval":0.48816,"GermanHealthcare1Retrieval":0.25016,"GermanLegal1Retrieval":0.37958,"LegalQuAD":0.10669} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(deu%2C%20beta)/scores) Source MTEB Original model label sentence-transformers/all-mpnet-base-v2 Observed 2026-10-21T16:40:40.727Z Evidence SHA-256 `70250aaee4788084a090cdccd91621a3c80bbf5076195bc3f215bcb392e7637d` Source locator `/rows/186` | | | | | 16 | [all-MiniLM-L12-v2](https://benchize.com/models/all-minilm-l12-v2.md) | 0.07source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.07442 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 199 scoresByTask {"German1Retrieval":0.49634,"GermanHealthcare1Retrieval":0.31249,"GermanLegal1Retrieval":0.39564,"LegalQuAD":0.07442} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(deu%2C%20beta)/scores) Source MTEB Original model label sentence-transformers/all-MiniLM-L12-v2 Observed 2026-10-21T16:40:40.727Z Evidence SHA-256 `70250aaee4788084a090cdccd91621a3c80bbf5076195bc3f215bcb392e7637d` Source locator `/rows/198` | | | | | 17 | [BGE Large ZH V1.5](https://benchize.com/models/bge-large-zh-v1-5.md) | 0.07source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.06837 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 202 scoresByTask {"German1Retrieval":0.3441,"GermanHealthcare1Retrieval":0.09744,"GermanLegal1Retrieval":0.31028,"LegalQuAD":0.06837} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(deu%2C%20beta)/scores) Source MTEB Original model label BAAI/bge-large-zh-v1.5 Observed 2026-10-21T16:40:40.727Z Evidence SHA-256 `70250aaee4788084a090cdccd91621a3c80bbf5076195bc3f215bcb392e7637d` Source locator `/rows/201` | | | | --- Cite as: RTEB(deu, beta) · RTEB German — Benchize, https://benchize.com/benchmarks/mteb%3ARTEB(deu%2C%20beta) (retrieved 2026-10-21)