# RTEB(Health, beta) · RTEB Healthcare > Source: Benchize (https://benchize.com) — https://benchize.com/benchmarks/mteb%3ARTEB(Health%2C%20beta). When citing or reusing this content, credit "Benchize" and link to https://benchize.com/benchmarks/mteb%3ARTEB(Health%2C%20beta). Retrieval quality in the healthcare and medical domain across medical Q&A, healthcare information retrieval, and multilingual medical consultation, with tasks representative of real-world production retrieval demands. A domain-specific subset of RTEB. Includes both open and closed datasets; to submit results on private tasks, please [open an issue](https://github.com/embeddings-benchmark/mteb/issues).Note: We have temporarily removed the 'Private' column to read more about this decision out the [announcement](https://github.com/embeddings-benchmark/mteb/issues/3934). Canonical URL: https://benchize.com/benchmarks/mteb%3ARTEB(Health%2C%20beta) Last updated: Wed, 21 Oct 2026 18:52:20 GMT Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations. Retrieval quality in the healthcare and medical domain across medical Q&A, healthcare information retrieval, and multilingual medical consultation, with tasks representative of real-world production retrieval demands. A domain-specific subset of RTEB. Includes both open and closed datasets; to submit results on private tasks, please [open an issue](https://github.com/embeddings-benchmark/mteb/issues).Note: We have temporarily removed the 'Private' column to read more about this decision out the [announcement](https://github.com/embeddings-benchmark/mteb/issues/3934). Embeddings · Models tested: 14 · Score publishers: MTEB ## Model results | # | Model | Score | | | --- | --- | --- | --- | | 1 | [Qwen3 Embedding](https://benchize.com/models/qwen3-embedding.md) | 0.67source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.6703325757575758 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 8 scoresByTask {"CUREv1":0.6084751515151515,"ChatDoctorRetrieval":0.73219,"EnglishHealthcare1Retrieval":0.63545,"GermanHealthcare1Retrieval":0.8762} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(Health%2C%20beta)/scores) Source MTEB Original model label Qwen/Qwen3-Embedding-8B Observed 2026-10-21T16:40:40.988Z Evidence SHA-256 `bf62d4318f836a1a4f92c7d21e3acad553ff4cffb3162ea312270b15ce1b4e32` Source locator `/rows/7` | | | | | 2 | [Gemini Embedding 001](https://benchize.com/models/gemini-embedding-001.md) | 0.67source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.6654880303030304 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 10 scoresByTask {"CUREv1":0.5957460606060606,"ChatDoctorRetrieval":0.73523,"EnglishHealthcare1Retrieval":0.63378,"GermanHealthcare1Retrieval":0.87423} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(Health%2C%20beta)/scores) Source MTEB Original model label google/gemini-embedding-001 Observed 2026-10-21T16:40:40.988Z Evidence SHA-256 `bf62d4318f836a1a4f92c7d21e3acad553ff4cffb3162ea312270b15ce1b4e32` Source locator `/rows/9` | | | | | 3 | [Gemini Embedding 2](https://benchize.com/models/gemini-embedding-2.md) | 0.65source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.6463277272727272 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 17 scoresByTask {"CUREv1":0.5650954545454546,"ChatDoctorRetrieval":0.72756} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(Health%2C%20beta)/scores) Source MTEB Original model label google/gemini-embedding-2-preview Observed 2026-10-21T16:40:40.988Z Evidence SHA-256 `bf62d4318f836a1a4f92c7d21e3acad553ff4cffb3162ea312270b15ce1b4e32` Source locator `/rows/16` | | | | | 4 | [Text Embedding 3 Large](https://benchize.com/models/text-embedding-3-large.md) | 0.62source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.6227745454545455 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct -1 ### Reported statistics experiments Not reported rank 28 scoresByTask {"CUREv1":0.5786790909090909,"ChatDoctorRetrieval":0.66687,"EnglishHealthcare1Retrieval":0.56601,"GermanHealthcare1Retrieval":0.81089} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(Health%2C%20beta)/scores) Source MTEB Original model label openai/text-embedding-3-large Observed 2026-10-21T16:40:40.988Z Evidence SHA-256 `bf62d4318f836a1a4f92c7d21e3acad553ff4cffb3162ea312270b15ce1b4e32` Source locator `/rows/27` | | | | | 5 | [Bge m3](https://benchize.com/models/bge-m3.md) | 0.55source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.5496119696969697 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 46 scoresByTask {"CUREv1":0.5194939393939394,"ChatDoctorRetrieval":0.57973,"EnglishHealthcare1Retrieval":0.55187,"GermanHealthcare1Retrieval":0.72479} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(Health%2C%20beta)/scores) Source MTEB Original model label BAAI/bge-m3 Observed 2026-10-21T16:40:40.988Z Evidence SHA-256 `bf62d4318f836a1a4f92c7d21e3acad553ff4cffb3162ea312270b15ce1b4e32` Source locator `/rows/45` | | | | | 6 | [Multilingual-E5-Large](https://benchize.com/models/multilingual-e5-large.md) | 0.54source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.5424612121212121 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 49 scoresByTask {"CUREv1":0.5162124242424242,"ChatDoctorRetrieval":0.56871} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(Health%2C%20beta)/scores) Source MTEB Original model label intfloat/multilingual-e5-large Observed 2026-10-21T16:40:40.988Z Evidence SHA-256 `bf62d4318f836a1a4f92c7d21e3acad553ff4cffb3162ea312270b15ce1b4e32` Source locator `/rows/48` | | | | | 7 | [Text Embedding 3 Small](https://benchize.com/models/text-embedding-3-small.md) | 0.52source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.5233993939393939 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct -1 ### Reported statistics experiments Not reported rank 51 scoresByTask {"CUREv1":0.4684387878787879,"ChatDoctorRetrieval":0.57836,"EnglishHealthcare1Retrieval":0.53968,"GermanHealthcare1Retrieval":0.70356} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(Health%2C%20beta)/scores) Source MTEB Original model label openai/text-embedding-3-small Observed 2026-10-21T16:40:40.988Z Evidence SHA-256 `bf62d4318f836a1a4f92c7d21e3acad553ff4cffb3162ea312270b15ce1b4e32` Source locator `/rows/50` | | | | | 8 | [BGE Large EN V1.5](https://benchize.com/models/bge-large-en-v1-5.md) | 0.46source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.46060636363636365 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 62 scoresByTask {"CUREv1":0.33048272727272726,"ChatDoctorRetrieval":0.59073,"EnglishHealthcare1Retrieval":0.51401,"GermanHealthcare1Retrieval":0.37351} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(Health%2C%20beta)/scores) Source MTEB Original model label BAAI/bge-large-en-v1.5 Observed 2026-10-21T16:40:40.988Z Evidence SHA-256 `bf62d4318f836a1a4f92c7d21e3acad553ff4cffb3162ea312270b15ce1b4e32` Source locator `/rows/61` | | | | | 9 | [BGE Base EN V1.5](https://benchize.com/models/bge-base-en-v1-5.md) | 0.44source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.4359812121212121 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 66 scoresByTask {"CUREv1":0.3180324242424242,"ChatDoctorRetrieval":0.55393,"EnglishHealthcare1Retrieval":0.50141,"GermanHealthcare1Retrieval":0.34764} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(Health%2C%20beta)/scores) Source MTEB Original model label BAAI/bge-base-en-v1.5 Observed 2026-10-21T16:40:40.988Z Evidence SHA-256 `bf62d4318f836a1a4f92c7d21e3acad553ff4cffb3162ea312270b15ce1b4e32` Source locator `/rows/65` | | | | | 10 | [E5-Base-v2](https://benchize.com/models/e5-base-v2.md) | 0.41source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.41468757575757575 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 69 scoresByTask {"CUREv1":0.3258451515151515,"ChatDoctorRetrieval":0.50353} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(Health%2C%20beta)/scores) Source MTEB Original model label intfloat/e5-base-v2 Observed 2026-10-21T16:40:40.988Z Evidence SHA-256 `bf62d4318f836a1a4f92c7d21e3acad553ff4cffb3162ea312270b15ce1b4e32` Source locator `/rows/68` | | | | | 11 | [All Mpnet Base V2](https://benchize.com/models/all-mpnet-base-v2.md) | 0.38source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.37732742424242427 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 79 scoresByTask {"CUREv1":0.18313484848484848,"ChatDoctorRetrieval":0.57152,"EnglishHealthcare1Retrieval":0.46849,"GermanHealthcare1Retrieval":0.25016} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(Health%2C%20beta)/scores) Source MTEB Original model label sentence-transformers/all-mpnet-base-v2 Observed 2026-10-21T16:40:40.988Z Evidence SHA-256 `bf62d4318f836a1a4f92c7d21e3acad553ff4cffb3162ea312270b15ce1b4e32` Source locator `/rows/78` | | | | | 12 | [all-MiniLM-L12-v2](https://benchize.com/models/all-minilm-l12-v2.md) | 0.36source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.35762636363636363 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 81 scoresByTask {"CUREv1":0.1823127272727273,"ChatDoctorRetrieval":0.53294,"EnglishHealthcare1Retrieval":0.38081,"GermanHealthcare1Retrieval":0.31249} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(Health%2C%20beta)/scores) Source MTEB Original model label sentence-transformers/all-MiniLM-L12-v2 Observed 2026-10-21T16:40:40.988Z Evidence SHA-256 `bf62d4318f836a1a4f92c7d21e3acad553ff4cffb3162ea312270b15ce1b4e32` Source locator `/rows/80` | | | | | 13 | [all-MiniLM-L6-v2](https://benchize.com/models/all-minilm-l6-v2.md) | 0.35source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.34742954545454546 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 83 scoresByTask {"CUREv1":0.1653990909090909,"ChatDoctorRetrieval":0.52946,"EnglishHealthcare1Retrieval":0.41778,"GermanHealthcare1Retrieval":0.2513} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(Health%2C%20beta)/scores) Source MTEB Original model label sentence-transformers/all-MiniLM-L6-v2 Observed 2026-10-21T16:40:40.988Z Evidence SHA-256 `bf62d4318f836a1a4f92c7d21e3acad553ff4cffb3162ea312270b15ce1b4e32` Source locator `/rows/82` | | | | | 14 | [BGE Large ZH V1.5](https://benchize.com/models/bge-large-zh-v1-5.md) | 0.15source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.15035969696969698 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 100 scoresByTask {"CUREv1":0.11423939393939393,"ChatDoctorRetrieval":0.18648,"EnglishHealthcare1Retrieval":0.38579,"GermanHealthcare1Retrieval":0.09744} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(Health%2C%20beta)/scores) Source MTEB Original model label BAAI/bge-large-zh-v1.5 Observed 2026-10-21T16:40:40.988Z Evidence SHA-256 `bf62d4318f836a1a4f92c7d21e3acad553ff4cffb3162ea312270b15ce1b4e32` Source locator `/rows/99` | | | | --- Cite as: RTEB(Health, beta) · RTEB Healthcare — Benchize, https://benchize.com/benchmarks/mteb%3ARTEB(Health%2C%20beta) (retrieved 2026-10-21)