# MTEB(Law, v1) · Legal > Source: Benchize (https://benchize.com) — https://benchize.com/benchmarks/mteb%3AMTEB(Law%2C%20v1). When citing or reusing this content, credit "Benchize" and link to https://benchize.com/benchmarks/mteb%3AMTEB(Law%2C%20v1). Legal document retrieval across case documents, statutes, legal Q&A, and legal summarization in multiple languages. Canonical URL: https://benchize.com/benchmarks/mteb%3AMTEB(Law%2C%20v1) Last updated: Wed, 21 Oct 2026 18:52:20 GMT Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations. Legal document retrieval across case documents, statutes, legal Q&A, and legal summarization in multiple languages. Embeddings · Models tested: 12 · Score publishers: MTEB ## Model results | # | Model | Score | | | --- | --- | --- | --- | | 1 | [Text Embedding 3 Large](https://benchize.com/models/text-embedding-3-large.md) | 0.59source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.5935937499999999 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.5935937499999999 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct -1 ### Reported statistics experiments Not reported rank 19 scoresByTask {"AILACasedocs":0.39479,"AILAStatutes":0.4185,"GerDaLIRSmall":0.3277,"LeCaRDv2":0.57197,"LegalBenchConsumerContractsQA":0.79385,"LegalBenchCorporateLobbying":0.95222,"LegalQuAD":0.56336,"LegalSummarization":0.72636} scoresByTaskType {"Retrieval":0.5935937499999999} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(Law%2C%20v1)/scores) Source MTEB Original model label openai/text-embedding-3-large Observed 2026-10-21T16:40:35.593Z Evidence SHA-256 `366cc22709240d33f3a878edf79ca05670c259d3ada02601cd525a1dfb8143c1` Source locator `/rows/18` | | | | | 2 | [Text Embedding 3 Small](https://benchize.com/models/text-embedding-3-small.md) | 0.56source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.5627150000000001 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.5627150000000001 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct -1 ### Reported statistics experiments Not reported rank 35 scoresByTask {"AILACasedocs":0.34899,"AILAStatutes":0.28335,"GerDaLIRSmall":0.34743,"LeCaRDv2":0.54998,"LegalBenchConsumerContractsQA":0.79147,"LegalBenchCorporateLobbying":0.93903,"LegalQuAD":0.54807,"LegalSummarization":0.6934} scoresByTaskType {"Retrieval":0.5627150000000001} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(Law%2C%20v1)/scores) Source MTEB Original model label openai/text-embedding-3-small Observed 2026-10-21T16:40:35.593Z Evidence SHA-256 `366cc22709240d33f3a878edf79ca05670c259d3ada02601cd525a1dfb8143c1` Source locator `/rows/34` | | | | | 3 | [Multilingual-E5-Large](https://benchize.com/models/multilingual-e5-large.md) | 0.48source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.483885 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.483885 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 67 scoresByTask {"AILACasedocs":0.26427,"AILAStatutes":0.20842,"GerDaLIRSmall":0.15723,"LeCaRDv2":0.55828,"LegalBenchConsumerContractsQA":0.73301,"LegalBenchCorporateLobbying":0.89716,"LegalQuAD":0.43172,"LegalSummarization":0.62099} scoresByTaskType {"Retrieval":0.483885} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(Law%2C%20v1)/scores) Source MTEB Original model label intfloat/multilingual-e5-large Observed 2026-10-21T16:40:35.593Z Evidence SHA-256 `366cc22709240d33f3a878edf79ca05670c259d3ada02601cd525a1dfb8143c1` Source locator `/rows/66` | | | | | 4 | [E5-Large-v2](https://benchize.com/models/e5-large-v2.md) | 0.42source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.41725 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.41725 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 81 scoresByTask {"AILACasedocs":0.31226,"AILAStatutes":0.17633,"GerDaLIRSmall":0.06465,"LeCaRDv2":0.2294,"LegalBenchConsumerContractsQA":0.77324,"LegalBenchCorporateLobbying":0.91495,"LegalQuAD":0.27182,"LegalSummarization":0.59535} scoresByTaskType {"Retrieval":0.41725} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(Law%2C%20v1)/scores) Source MTEB Original model label intfloat/e5-large-v2 Observed 2026-10-21T16:40:35.593Z Evidence SHA-256 `366cc22709240d33f3a878edf79ca05670c259d3ada02601cd525a1dfb8143c1` Source locator `/rows/80` | | | | | 5 | [GTE-Large](https://benchize.com/models/gte-large.md) | 0.41source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.4119575 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.4119575 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct -1 ### Reported statistics experiments Not reported rank 68 scoresByTask {"AILACasedocs":0.30493,"AILAStatutes":0.23233,"GerDaLIRSmall":0.05604,"LeCaRDv2":0.2115,"LegalBenchConsumerContractsQA":0.74173,"LegalBenchCorporateLobbying":0.91462,"LegalQuAD":0.19816,"LegalSummarization":0.63635} scoresByTaskType {"Retrieval":0.4119575} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(Law%2C%20v1)/scores) Source MTEB Original model label thenlper/gte-large Observed 2026-10-21T16:40:35.593Z Evidence SHA-256 `366cc22709240d33f3a878edf79ca05670c259d3ada02601cd525a1dfb8143c1` Source locator `/rows/67` | | | | | 6 | [BGE Base EN V1.5](https://benchize.com/models/bge-base-en-v1-5.md) | 0.4source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.40243 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.40243 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 82 scoresByTask {"AILACasedocs":0.27363,"AILAStatutes":0.23346,"GerDaLIRSmall":0.03324,"LeCaRDv2":0.23338,"LegalBenchConsumerContractsQA":0.7348,"LegalBenchCorporateLobbying":0.91672,"LegalQuAD":0.16008,"LegalSummarization":0.63413} scoresByTaskType {"Retrieval":0.40243} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(Law%2C%20v1)/scores) Source MTEB Original model label BAAI/bge-base-en-v1.5 Observed 2026-10-21T16:40:35.593Z Evidence SHA-256 `366cc22709240d33f3a878edf79ca05670c259d3ada02601cd525a1dfb8143c1` Source locator `/rows/81` | | | | | 7 | [GTE-Base](https://benchize.com/models/gte-base.md) | 0.4source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.40012749999999997 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.40012749999999997 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct -1 ### Reported statistics experiments Not reported rank 84 scoresByTask {"AILACasedocs":0.2833,"AILAStatutes":0.22275,"GerDaLIRSmall":0.04112,"LeCaRDv2":0.21572,"LegalBenchConsumerContractsQA":0.73171,"LegalBenchCorporateLobbying":0.91814,"LegalQuAD":0.15707,"LegalSummarization":0.63121} scoresByTaskType {"Retrieval":0.40012749999999997} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(Law%2C%20v1)/scores) Source MTEB Original model label thenlper/gte-base Observed 2026-10-21T16:40:35.593Z Evidence SHA-256 `366cc22709240d33f3a878edf79ca05670c259d3ada02601cd525a1dfb8143c1` Source locator `/rows/83` | | | | | 8 | [BGE Large EN V1.5](https://benchize.com/models/bge-large-en-v1-5.md) | 0.4source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.395805 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.395805 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 95 scoresByTask {"AILACasedocs":0.25978,"AILAStatutes":0.23063,"GerDaLIRSmall":0.04161,"LeCaRDv2":0.21665,"LegalBenchConsumerContractsQA":0.73333,"LegalBenchCorporateLobbying":0.90767,"LegalQuAD":0.16557,"LegalSummarization":0.6112} scoresByTaskType {"Retrieval":0.395805} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(Law%2C%20v1)/scores) Source MTEB Original model label BAAI/bge-large-en-v1.5 Observed 2026-10-21T16:40:35.593Z Evidence SHA-256 `366cc22709240d33f3a878edf79ca05670c259d3ada02601cd525a1dfb8143c1` Source locator `/rows/94` | | | | | 9 | [E5-Base-v2](https://benchize.com/models/e5-base-v2.md) | 0.4source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.395335 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.395335 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 104 scoresByTask {"AILACasedocs":0.27165,"AILAStatutes":0.19609,"GerDaLIRSmall":0.0409,"LeCaRDv2":0.2053,"LegalBenchConsumerContractsQA":0.71919,"LegalBenchCorporateLobbying":0.91916,"LegalQuAD":0.22319,"LegalSummarization":0.5872} scoresByTaskType {"Retrieval":0.395335} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(Law%2C%20v1)/scores) Source MTEB Original model label intfloat/e5-base-v2 Observed 2026-10-21T16:40:35.593Z Evidence SHA-256 `366cc22709240d33f3a878edf79ca05670c259d3ada02601cd525a1dfb8143c1` Source locator `/rows/103` | | | | | 10 | [All Mpnet Base V2](https://benchize.com/models/all-mpnet-base-v2.md) | 0.37source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.37395124999999996 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.37395124999999996 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 133 scoresByTask {"AILACasedocs":0.22515,"AILAStatutes":0.21275,"GerDaLIRSmall":0.03775,"LeCaRDv2":0.1809,"LegalBenchConsumerContractsQA":0.75245,"LegalBenchCorporateLobbying":0.89044,"LegalQuAD":0.10669,"LegalSummarization":0.58548} scoresByTaskType {"Retrieval":0.37395124999999996} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(Law%2C%20v1)/scores) Source MTEB Original model label sentence-transformers/all-mpnet-base-v2 Observed 2026-10-21T16:40:35.593Z Evidence SHA-256 `366cc22709240d33f3a878edf79ca05670c259d3ada02601cd525a1dfb8143c1` Source locator `/rows/132` | | | | | 11 | [all-MiniLM-L6-v2](https://benchize.com/models/all-minilm-l6-v2.md) | 0.35source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.35371874999999997 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.35371874999999997 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 158 scoresByTask {"AILACasedocs":0.19717,"AILAStatutes":0.20516,"GerDaLIRSmall":0.0241,"LeCaRDv2":0.17505,"LegalBenchConsumerContractsQA":0.656,"LegalBenchCorporateLobbying":0.86413,"LegalQuAD":0.11811,"LegalSummarization":0.59003} scoresByTaskType {"Retrieval":0.35371874999999997} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(Law%2C%20v1)/scores) Source MTEB Original model label sentence-transformers/all-MiniLM-L6-v2 Observed 2026-10-21T16:40:35.593Z Evidence SHA-256 `366cc22709240d33f3a878edf79ca05670c259d3ada02601cd525a1dfb8143c1` Source locator `/rows/158` | | | | | 12 | [all-MiniLM-L12-v2](https://benchize.com/models/all-minilm-l12-v2.md) | 0.34source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.33924875 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.33924875 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 168 scoresByTask {"AILACasedocs":0.16797,"AILAStatutes":0.20714,"GerDaLIRSmall":0.01351,"LeCaRDv2":0.18773,"LegalBenchConsumerContractsQA":0.60205,"LegalBenchCorporateLobbying":0.88691,"LegalQuAD":0.07442,"LegalSummarization":0.57426} scoresByTaskType {"Retrieval":0.33924875} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(Law%2C%20v1)/scores) Source MTEB Original model label sentence-transformers/all-MiniLM-L12-v2 Observed 2026-10-21T16:40:35.593Z Evidence SHA-256 `366cc22709240d33f3a878edf79ca05670c259d3ada02601cd525a1dfb8143c1` Source locator `/rows/167` | | | | --- Cite as: MTEB(Law, v1) · Legal — Benchize, https://benchize.com/benchmarks/mteb%3AMTEB(Law%2C%20v1) (retrieved 2026-10-21)