# MTEB(Code, v1) · Code

> Source: Benchize (https://benchize.com) — https://benchize.com/benchmarks/mteb%3AMTEB(Code%2C%20v1). When citing or reusing this content, credit "Benchize" and link to https://benchize.com/benchmarks/mteb%3AMTEB(Code%2C%20v1).

Code retrieval quality across a wide range of popular programming languages, covering code search, text-to-SQL, and code feedback tasks.

Canonical URL: https://benchize.com/benchmarks/mteb%3AMTEB(Code%2C%20v1)
Last updated: Wed, 21 Oct 2026 18:52:20 GMT

Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations.

Code retrieval quality across a wide range of popular programming languages, covering code search, text-to-SQL, and code feedback tasks.

Embeddings · Models tested: 2 · Score publishers: MTEB

## Model results

| # | Model | Score |  |
| --- | --- | --- | --- |
| 1 | [Qwen3 Embedding](https://benchize.com/models/qwen3-embedding.md) | 0.81source score |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.8068885149572648 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.8068885149572648 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 6 scoresByTask {"AppsRetrieval":0.91071,"COIRCodeSearchNetRetrieval":0.8951116666666667,"CodeEditSearchRetrieval":0.7696938461538461,"CodeFeedbackMT":0.93699,"CodeFeedbackST":0.89929,"CodeSearchNetCCRetrieval":0.9634683333333333,"CodeSearchNetRetrieval":0.9265683333333333,"CodeTransOceanContest":0.93733,"CodeTransOceanDL":0.32809,"CosQA":0.38042,"StackOverflowQA":0.94751,"SyntheticText2SQL":0.78748} scoresByTaskType {"Retrieval":0.8068885149572648} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(Code%2C%20v1)/scores) Source MTEB Original model label Qwen/Qwen3-Embedding-8B Observed 2026-10-21T16:40:39.168Z Evidence SHA-256 `c8855166b6b338358c1c699aa21e1fa3f710c2bf19c2a0b6e6db0136038657d9` Source locator `/rows/5` |  |  |  |
| 2 | [Qwen3 Embedding](https://benchize.com/models/qwen3-embedding.md) | 0.8source score |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.8006564209401711 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.8006564209401711 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 5 scoresByTask {"AppsRetrieval":0.89176,"COIRCodeSearchNetRetrieval":0.8792833333333334,"CodeEditSearchRetrieval":0.7648953846153846,"CodeFeedbackMT":0.93211,"CodeFeedbackST":0.89514,"CodeSearchNetCCRetrieval":0.9558516666666667,"CodeSearchNetRetrieval":0.9233866666666667,"CodeTransOceanContest":0.90993,"CodeTransOceanDL":0.35039,"CosQA":0.37982,"StackOverflowQA":0.94323,"SyntheticText2SQL":0.78208} scoresByTaskType {"Retrieval":0.8006564209401711} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(Code%2C%20v1)/scores) Source MTEB Original model label Qwen/Qwen3-Embedding-4B Observed 2026-10-21T16:40:39.168Z Evidence SHA-256 `c8855166b6b338358c1c699aa21e1fa3f710c2bf19c2a0b6e6db0136038657d9` Source locator `/rows/4` |  |  |  |
| 3 | [Gemini Embedding 001](https://benchize.com/models/gemini-embedding-001.md) | 0.76source score |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.7599641132478633 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.7599641132478633 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 14 scoresByTask {"AppsRetrieval":0.93751,"COIRCodeSearchNetRetrieval":0.8105950000000001,"CodeEditSearchRetrieval":0.8161476923076924,"CodeFeedbackMT":0.56279,"CodeFeedbackST":0.85329,"CodeSearchNetCCRetrieval":0.8468616666666667,"CodeSearchNetRetrieval":0.9133049999999999,"CodeTransOceanContest":0.89529,"CodeTransOceanDL":0.31467,"CosQA":0.50238,"StackOverflowQA":0.96713,"SyntheticText2SQL":0.6996} scoresByTaskType {"Retrieval":0.7599641132478633} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(Code%2C%20v1)/scores) Source MTEB Original model label google/gemini-embedding-001 Observed 2026-10-21T16:40:39.168Z Evidence SHA-256 `c8855166b6b338358c1c699aa21e1fa3f710c2bf19c2a0b6e6db0136038657d9` Source locator `/rows/13` |  |  |  |

---
Cite as: MTEB(Code, v1) · Code — Benchize, https://benchize.com/benchmarks/mteb%3AMTEB(Code%2C%20v1) (retrieved 2026-10-21)