# RTEB(Law, beta) · RTEB Legal > Source: Benchize (https://benchize.com) — https://benchize.com/benchmarks/mteb%3ARTEB(Law%2C%20beta). When citing or reusing this content, credit "Benchize" and link to https://benchize.com/benchmarks/mteb%3ARTEB(Law%2C%20beta). Retrieval quality in the legal domain across case documents, statutes, legal summarization, and multilingual legal Q&A, with tasks representative of real-world production retrieval demands. A domain-specific subset of RTEB. Includes both open and closed datasets; to submit results on private tasks, please [open an issue](https://github.com/embeddings-benchmark/mteb/issues).Note: We have temporarily removed the 'Private' column to read more about this decision out the [announcement](https://github.com/embeddings-benchmark/mteb/issues/3934). Canonical URL: https://benchize.com/benchmarks/mteb%3ARTEB(Law%2C%20beta) Last updated: Wed, 21 Oct 2026 18:52:20 GMT Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations. Retrieval quality in the legal domain across case documents, statutes, legal summarization, and multilingual legal Q&A, with tasks representative of real-world production retrieval demands. A domain-specific subset of RTEB. Includes both open and closed datasets; to submit results on private tasks, please [open an issue](https://github.com/embeddings-benchmark/mteb/issues).Note: We have temporarily removed the 'Private' column to read more about this decision out the [announcement](https://github.com/embeddings-benchmark/mteb/issues/3934). Embeddings · Models tested: 17 · Score publishers: MTEB ## Model results | # | Model | Score | | | --- | --- | --- | --- | | 1 | [Qwen3 Embedding](https://benchize.com/models/qwen3-embedding.md) | 0.67source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.6724874999999999 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 17 scoresByTask {"AILACasedocs":0.46322,"AILAStatutes":0.85086,"FrenchLegal1Retrieval":0.89591,"GermanLegal1Retrieval":0.69769,"JapaneseLegal1Retrieval":0.78413,"LegalQuAD":0.66846,"LegalSummarization":0.70741} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(Law%2C%20beta)/scores) Source MTEB Original model label Qwen/Qwen3-Embedding-8B Observed 2026-10-21T16:40:41.494Z Evidence SHA-256 `7204bf17f439a2d3c2052309544ff33f53928c057dd204e20b275f942e4f5516` Source locator `/rows/16` | | | | | 2 | [Gemini Embedding 001](https://benchize.com/models/gemini-embedding-001.md) | 0.58source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.58462 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 22 scoresByTask {"AILACasedocs":0.48325,"AILAStatutes":0.4877,"FrenchLegal1Retrieval":0.86959,"GermanLegal1Retrieval":0.71492,"JapaneseLegal1Retrieval":0.92278,"LegalQuAD":0.65532,"LegalSummarization":0.71221} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(Law%2C%20beta)/scores) Source MTEB Original model label google/gemini-embedding-001 Observed 2026-10-21T16:40:41.494Z Evidence SHA-256 `7204bf17f439a2d3c2052309544ff33f53928c057dd204e20b275f942e4f5516` Source locator `/rows/21` | | | | | 3 | [Text Embedding 3 Large](https://benchize.com/models/text-embedding-3-large.md) | 0.53source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.5257525 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct -1 ### Reported statistics experiments Not reported rank 38 scoresByTask {"AILACasedocs":0.39479,"AILAStatutes":0.4185,"FrenchLegal1Retrieval":0.70051,"GermanLegal1Retrieval":0.66654,"JapaneseLegal1Retrieval":0.53746,"LegalQuAD":0.56336,"LegalSummarization":0.72636} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(Law%2C%20beta)/scores) Source MTEB Original model label openai/text-embedding-3-large Observed 2026-10-21T16:40:41.494Z Evidence SHA-256 `7204bf17f439a2d3c2052309544ff33f53928c057dd204e20b275f942e4f5516` Source locator `/rows/37` | | | | | 4 | [Text Embedding 3 Small](https://benchize.com/models/text-embedding-3-small.md) | 0.47source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.4684525 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct -1 ### Reported statistics experiments Not reported rank 59 scoresByTask {"AILACasedocs":0.34899,"AILAStatutes":0.28335,"FrenchLegal1Retrieval":0.62906,"GermanLegal1Retrieval":0.61798,"JapaneseLegal1Retrieval":0.54799,"LegalQuAD":0.54807,"LegalSummarization":0.6934} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(Law%2C%20beta)/scores) Source MTEB Original model label openai/text-embedding-3-small Observed 2026-10-21T16:40:41.494Z Evidence SHA-256 `7204bf17f439a2d3c2052309544ff33f53928c057dd204e20b275f942e4f5516` Source locator `/rows/58` | | | | | 5 | [Bge m3](https://benchize.com/models/bge-m3.md) | 0.45source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.44692750000000003 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 72 scoresByTask {"AILACasedocs":0.36127,"AILAStatutes":0.29042,"FrenchLegal1Retrieval":0.63001,"GermanLegal1Retrieval":0.60887,"JapaneseLegal1Retrieval":0.70381,"LegalQuAD":0.50356,"LegalSummarization":0.63246} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(Law%2C%20beta)/scores) Source MTEB Original model label BAAI/bge-m3 Observed 2026-10-21T16:40:41.494Z Evidence SHA-256 `7204bf17f439a2d3c2052309544ff33f53928c057dd204e20b275f942e4f5516` Source locator `/rows/71` | | | | | 6 | [Gemini Embedding 2](https://benchize.com/models/gemini-embedding-2.md) | 0.41source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.4130775 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 83 scoresByTask {"AILACasedocs":0.22287,"AILAStatutes":0.47329,"LegalQuAD":0.26411,"LegalSummarization":0.69204} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(Law%2C%20beta)/scores) Source MTEB Original model label google/gemini-embedding-2-preview Observed 2026-10-21T16:40:41.494Z Evidence SHA-256 `7204bf17f439a2d3c2052309544ff33f53928c057dd204e20b275f942e4f5516` Source locator `/rows/82` | | | | | 7 | [Multilingual-E5-Large](https://benchize.com/models/multilingual-e5-large.md) | 0.38source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.38134999999999997 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 109 scoresByTask {"AILACasedocs":0.26427,"AILAStatutes":0.20842,"LegalQuAD":0.43172,"LegalSummarization":0.62099} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(Law%2C%20beta)/scores) Source MTEB Original model label intfloat/multilingual-e5-large Observed 2026-10-21T16:40:41.494Z Evidence SHA-256 `7204bf17f439a2d3c2052309544ff33f53928c057dd204e20b275f942e4f5516` Source locator `/rows/108` | | | | | 8 | [GTE-Large](https://benchize.com/models/gte-large.md) | 0.34source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.34294250000000004 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct -1 ### Reported statistics experiments Not reported rank 99 scoresByTask {"AILACasedocs":0.30493,"AILAStatutes":0.23233,"LegalQuAD":0.19816,"LegalSummarization":0.63635} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(Law%2C%20beta)/scores) Source MTEB Original model label thenlper/gte-large Observed 2026-10-21T16:40:41.494Z Evidence SHA-256 `7204bf17f439a2d3c2052309544ff33f53928c057dd204e20b275f942e4f5516` Source locator `/rows/98` | | | | | 9 | [E5-Large-v2](https://benchize.com/models/e5-large-v2.md) | 0.34source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.33894 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 131 scoresByTask {"AILACasedocs":0.31226,"AILAStatutes":0.17633,"LegalQuAD":0.27182,"LegalSummarization":0.59535} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(Law%2C%20beta)/scores) Source MTEB Original model label intfloat/e5-large-v2 Observed 2026-10-21T16:40:41.494Z Evidence SHA-256 `7204bf17f439a2d3c2052309544ff33f53928c057dd204e20b275f942e4f5516` Source locator `/rows/130` | | | | | 10 | [BGE Base EN V1.5](https://benchize.com/models/bge-base-en-v1-5.md) | 0.33source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.325325 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 110 scoresByTask {"AILACasedocs":0.27363,"AILAStatutes":0.23346,"FrenchLegal1Retrieval":0.27591,"GermanLegal1Retrieval":0.40846,"JapaneseLegal1Retrieval":0.3498,"LegalQuAD":0.16008,"LegalSummarization":0.63413} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(Law%2C%20beta)/scores) Source MTEB Original model label BAAI/bge-base-en-v1.5 Observed 2026-10-21T16:40:41.494Z Evidence SHA-256 `7204bf17f439a2d3c2052309544ff33f53928c057dd204e20b275f942e4f5516` Source locator `/rows/109` | | | | | 11 | [GTE-Base](https://benchize.com/models/gte-base.md) | 0.32source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.3235825 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct -1 ### Reported statistics experiments Not reported rank 115 scoresByTask {"AILACasedocs":0.2833,"AILAStatutes":0.22275,"LegalQuAD":0.15707,"LegalSummarization":0.63121} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(Law%2C%20beta)/scores) Source MTEB Original model label thenlper/gte-base Observed 2026-10-21T16:40:41.494Z Evidence SHA-256 `7204bf17f439a2d3c2052309544ff33f53928c057dd204e20b275f942e4f5516` Source locator `/rows/114` | | | | | 12 | [E5-Base-v2](https://benchize.com/models/e5-base-v2.md) | 0.32source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.3195325 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 143 scoresByTask {"AILACasedocs":0.27165,"AILAStatutes":0.19609,"LegalQuAD":0.22319,"LegalSummarization":0.5872} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(Law%2C%20beta)/scores) Source MTEB Original model label intfloat/e5-base-v2 Observed 2026-10-21T16:40:41.494Z Evidence SHA-256 `7204bf17f439a2d3c2052309544ff33f53928c057dd204e20b275f942e4f5516` Source locator `/rows/142` | | | | | 13 | [BGE Large EN V1.5](https://benchize.com/models/bge-large-en-v1-5.md) | 0.32source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.316795 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 126 scoresByTask {"AILACasedocs":0.25978,"AILAStatutes":0.23063,"FrenchLegal1Retrieval":0.3366,"GermanLegal1Retrieval":0.39161,"JapaneseLegal1Retrieval":0.36948,"LegalQuAD":0.16557,"LegalSummarization":0.6112} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(Law%2C%20beta)/scores) Source MTEB Original model label BAAI/bge-large-en-v1.5 Observed 2026-10-21T16:40:41.494Z Evidence SHA-256 `7204bf17f439a2d3c2052309544ff33f53928c057dd204e20b275f942e4f5516` Source locator `/rows/125` | | | | | 14 | [All Mpnet Base V2](https://benchize.com/models/all-mpnet-base-v2.md) | 0.28source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.2825175 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 172 scoresByTask {"AILACasedocs":0.22515,"AILAStatutes":0.21275,"FrenchLegal1Retrieval":0.24001,"GermanLegal1Retrieval":0.37958,"JapaneseLegal1Retrieval":0.07721,"LegalQuAD":0.10669,"LegalSummarization":0.58548} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(Law%2C%20beta)/scores) Source MTEB Original model label sentence-transformers/all-mpnet-base-v2 Observed 2026-10-21T16:40:41.494Z Evidence SHA-256 `7204bf17f439a2d3c2052309544ff33f53928c057dd204e20b275f942e4f5516` Source locator `/rows/171` | | | | | 15 | [all-MiniLM-L6-v2](https://benchize.com/models/all-minilm-l6-v2.md) | 0.28source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.2776175 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 174 scoresByTask {"AILACasedocs":0.19717,"AILAStatutes":0.20516,"FrenchLegal1Retrieval":0.1652,"GermanLegal1Retrieval":0.37473,"JapaneseLegal1Retrieval":0.03486,"LegalQuAD":0.11811,"LegalSummarization":0.59003} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(Law%2C%20beta)/scores) Source MTEB Original model label sentence-transformers/all-MiniLM-L6-v2 Observed 2026-10-21T16:40:41.494Z Evidence SHA-256 `7204bf17f439a2d3c2052309544ff33f53928c057dd204e20b275f942e4f5516` Source locator `/rows/174` | | | | | 16 | [all-MiniLM-L12-v2](https://benchize.com/models/all-minilm-l12-v2.md) | 0.26source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.2559475 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 189 scoresByTask {"AILACasedocs":0.16797,"AILAStatutes":0.20714,"FrenchLegal1Retrieval":0.09066,"GermanLegal1Retrieval":0.39564,"JapaneseLegal1Retrieval":0.23908,"LegalQuAD":0.07442,"LegalSummarization":0.57426} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(Law%2C%20beta)/scores) Source MTEB Original model label sentence-transformers/all-MiniLM-L12-v2 Observed 2026-10-21T16:40:41.494Z Evidence SHA-256 `7204bf17f439a2d3c2052309544ff33f53928c057dd204e20b275f942e4f5516` Source locator `/rows/189` | | | | | 17 | [BGE Large ZH V1.5](https://benchize.com/models/bge-large-zh-v1-5.md) | 0.22source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.220945 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 219 scoresByTask {"AILACasedocs":0.14441,"AILAStatutes":0.15417,"FrenchLegal1Retrieval":0.15767,"GermanLegal1Retrieval":0.31028,"JapaneseLegal1Retrieval":0.72109,"LegalQuAD":0.06837,"LegalSummarization":0.51683} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(Law%2C%20beta)/scores) Source MTEB Original model label BAAI/bge-large-zh-v1.5 Observed 2026-10-21T16:40:41.494Z Evidence SHA-256 `7204bf17f439a2d3c2052309544ff33f53928c057dd204e20b275f942e4f5516` Source locator `/rows/218` | | | | --- Cite as: RTEB(Law, beta) · RTEB Legal — Benchize, https://benchize.com/benchmarks/mteb%3ARTEB(Law%2C%20beta) (retrieved 2026-10-21)