# MTEB(Medical, v1) · Medical > Source: Benchize (https://benchize.com) — https://benchize.com/benchmarks/mteb%3AMTEB(Medical%2C%20v1). When citing or reusing this content, credit "Benchize" and link to https://benchize.com/benchmarks/mteb%3AMTEB(Medical%2C%20v1). Medical information retrieval across clinical, biomedical, and consumer health domains, spanning retrieval, reranking, and clustering tasks. Canonical URL: https://benchize.com/benchmarks/mteb%3AMTEB(Medical%2C%20v1) Last updated: Wed, 21 Oct 2026 18:52:20 GMT Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations. Medical information retrieval across clinical, biomedical, and consumer health domains, spanning retrieval, reranking, and clustering tasks. Embeddings · Models tested: 8 · Score publishers: MTEB ## Model results | # | Model | Score | | | --- | --- | --- | --- | | 1 | [Text Embedding 3 Large](https://benchize.com/models/text-embedding-3-large.md) | 0.61source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.6096244821474407 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.5847954201029621 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct -1 ### Reported statistics experiments Not reported rank 21 scoresByTask {"CMedQAv2-reranking":0.751224,"CUREv1":0.5786790909090909,"CmedqaRetrieval":0.27435,"MedicalQARetrieval":0.79657,"MedrxivClusteringP2P.v2":0.3605684448601972,"MedrxivClusteringS2S.v2":0.343486,"NFCorpus":0.42071,"PublicHealthQA":0.87740625,"SciFact":0.7777,"SciFact-PL":0.71036,"TRECCOVID":0.79562,"TRECCOVID-PL":0.62882} scoresByTaskType {"Clustering":0.3520272224300986,"Reranking":0.751224,"Retrieval":0.6511350378787879} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(Medical%2C%20v1)/scores) Source MTEB Original model label openai/text-embedding-3-large Observed 2026-10-21T16:40:35.852Z Evidence SHA-256 `6d1534f25189a9c84e353ced1f8d3958b2563d7c00e9719485eea3dbb0d1f13d` Source locator `/rows/20` | | | | | 2 | [Text Embedding 3 Small](https://benchize.com/models/text-embedding-3-small.md) | 0.56source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.5560056744736648 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.530734246814894 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct -1 ### Reported statistics experiments Not reported rank 32 scoresByTask {"CMedQAv2-reranking":0.645397,"CUREv1":0.4684387878787879,"CmedqaRetrieval":0.21839,"MedicalQARetrieval":0.69971,"MedrxivClusteringP2P.v2":0.36448130580518867,"MedrxivClusteringS2S.v2":0.348256,"NFCorpus":0.38329,"PublicHealthQA":0.784165,"SciFact":0.73368,"SciFact-PL":0.59367,"TRECCOVID":0.77903,"TRECCOVID-PL":0.65356} scoresByTaskType {"Clustering":0.35636865290259434,"Reranking":0.645397,"Retrieval":0.5904370875420876} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(Medical%2C%20v1)/scores) Source MTEB Original model label openai/text-embedding-3-small Observed 2026-10-21T16:40:35.852Z Evidence SHA-256 `6d1534f25189a9c84e353ced1f8d3958b2563d7c00e9719485eea3dbb0d1f13d` Source locator `/rows/31` | | | | | 3 | [GTE-Large](https://benchize.com/models/gte-large.md) | 0.42source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.42105517361111117 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.34645970679012345 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct -1 ### Reported statistics experiments Not reported rank 49 scoresByTask {"CMedQAv2-reranking":0.221975,"CUREv1":0.33269333333333334,"CmedqaRetrieval":0.02458,"MedicalQARetrieval":0.72611,"MedrxivClusteringP2P.v2":0.366636,"MedrxivClusteringS2S.v2":0.355064,"NFCorpus":0.38173,"PublicHealthQA":0.51562375,"SciFact":0.74265,"SciFact-PL":0.38933,"TRECCOVID":0.7021999999999999,"TRECCOVID-PL":0.29407} scoresByTaskType {"Clustering":0.36085,"Reranking":0.221975,"Retrieval":0.45655412037037046} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(Medical%2C%20v1)/scores) Source MTEB Original model label thenlper/gte-large Observed 2026-10-21T16:40:35.852Z Evidence SHA-256 `6d1534f25189a9c84e353ced1f8d3958b2563d7c00e9719485eea3dbb0d1f13d` Source locator `/rows/48` | | | | | 4 | [E5-Large-v2](https://benchize.com/models/e5-large-v2.md) | 0.41source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.4124504384014651 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.3413990541317742 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 68 scoresByTask {"CMedQAv2-reranking":0.231346,"CUREv1":0.36773606060606057,"CmedqaRetrieval":0.03266,"MedicalQARetrieval":0.69902,"MedrxivClusteringP2P.v2":0.35215934606100385,"MedrxivClusteringS2S.v2":0.3385838541505167,"NFCorpus":0.37134,"PublicHealthQA":0.50533,"SciFact":0.72242,"SciFact-PL":0.39679,"TRECCOVID":0.66636,"TRECCOVID-PL":0.26566} scoresByTaskType {"Clustering":0.3453716001057603,"Reranking":0.231346,"Retrieval":0.44747956228956226} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(Medical%2C%20v1)/scores) Source MTEB Original model label intfloat/e5-large-v2 Observed 2026-10-21T16:40:35.852Z Evidence SHA-256 `6d1534f25189a9c84e353ced1f8d3958b2563d7c00e9719485eea3dbb0d1f13d` Source locator `/rows/67` | | | | | 5 | [GTE-Base](https://benchize.com/models/gte-base.md) | 0.4source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.40406993750000003 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.33602137962962964 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct -1 ### Reported statistics experiments Not reported rank 60 scoresByTask {"CMedQAv2-reranking":0.216,"CUREv1":0.31024,"CmedqaRetrieval":0.02579,"MedicalQARetrieval":0.71455,"MedrxivClusteringP2P.v2":0.364043,"MedrxivClusteringS2S.v2":0.349025,"NFCorpus":0.37897,"PublicHealthQA":0.45346125,"SciFact":0.76178,"SciFact-PL":0.34309,"TRECCOVID":0.68783,"TRECCOVID-PL":0.24406} scoresByTaskType {"Clustering":0.356534,"Reranking":0.216,"Retrieval":0.4355301388888889} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(Medical%2C%20v1)/scores) Source MTEB Original model label thenlper/gte-base Observed 2026-10-21T16:40:35.852Z Evidence SHA-256 `6d1534f25189a9c84e353ced1f8d3958b2563d7c00e9719485eea3dbb0d1f13d` Source locator `/rows/59` | | | | | 6 | [E5-Base-v2](https://benchize.com/models/e5-base-v2.md) | 0.4source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.4009421560937832 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.3370857601393061 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 77 scoresByTask {"CMedQAv2-reranking":0.234887,"CUREv1":0.3258451515151515,"CmedqaRetrieval":0.03486,"MedicalQARetrieval":0.68621,"MedrxivClusteringP2P.v2":0.3553594605417122,"MedrxivClusteringS2S.v2":0.33347301106853483,"NFCorpus":0.35389,"PublicHealthQA":0.44815125,"SciFact":0.7194400000000001,"SciFact-PL":0.4216,"TRECCOVID":0.69633,"TRECCOVID-PL":0.20126} scoresByTaskType {"Clustering":0.3444162358051235,"Reranking":0.234887,"Retrieval":0.43195404461279463} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(Medical%2C%20v1)/scores) Source MTEB Original model label intfloat/e5-base-v2 Observed 2026-10-21T16:40:35.852Z Evidence SHA-256 `6d1534f25189a9c84e353ced1f8d3958b2563d7c00e9719485eea3dbb0d1f13d` Source locator `/rows/76` | | | | | 7 | [all-MiniLM-L12-v2](https://benchize.com/models/all-minilm-l12-v2.md) | 0.33source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.33242872971505427 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.30211173228075855 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 110 scoresByTask {"CMedQAv2-reranking":0.20061498053824298,"CUREv1":0.1823127272727273,"CmedqaRetrieval":0.02584,"MedicalQARetrieval":0.62038,"MedrxivClusteringP2P.v2":0.37820451385464854,"MedrxivClusteringS2S.v2":0.35406753491503284,"NFCorpus":0.3225,"PublicHealthQA":0.380675,"SciFact":0.62639,"SciFact-PL":0.22476,"TRECCOVID":0.50816,"TRECCOVID-PL":0.16524} scoresByTaskType {"Clustering":0.3661360243848407,"Reranking":0.20061498053824298,"Retrieval":0.3395841919191919} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(Medical%2C%20v1)/scores) Source MTEB Original model label sentence-transformers/all-MiniLM-L12-v2 Observed 2026-10-21T16:40:35.852Z Evidence SHA-256 `6d1534f25189a9c84e353ced1f8d3958b2563d7c00e9719485eea3dbb0d1f13d` Source locator `/rows/110` | | | | | 8 | [All Mpnet Base V2](https://benchize.com/models/all-mpnet-base-v2.md) | 0.33source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.32701469954715073 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.30080162775484515 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 106 scoresByTask {"CMedQAv2-reranking":0.18831061522925535,"CUREv1":0.18313484848484848,"CmedqaRetrieval":0.01997,"MedicalQARetrieval":0.66517,"MedrxivClusteringP2P.v2":0.39861803270863766,"MedrxivClusteringS2S.v2":0.37023414814306715,"NFCorpus":0.33289,"PublicHealthQA":0.34269875,"SciFact":0.6557,"SciFact-PL":0.13309,"TRECCOVID":0.51326,"TRECCOVID-PL":0.1211} scoresByTaskType {"Clustering":0.3844260904258524,"Reranking":0.18831061522925535,"Retrieval":0.3296681776094277} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(Medical%2C%20v1)/scores) Source MTEB Original model label sentence-transformers/all-mpnet-base-v2 Observed 2026-10-21T16:40:35.852Z Evidence SHA-256 `6d1534f25189a9c84e353ced1f8d3958b2563d7c00e9719485eea3dbb0d1f13d` Source locator `/rows/105` | | | | --- Cite as: MTEB(Medical, v1) · Medical — Benchize, https://benchize.com/benchmarks/mteb%3AMTEB(Medical%2C%20v1) (retrieved 2026-10-21)