# Qwen3 Embedding > Source: Benchize (https://benchize.com) — https://benchize.com/models/qwen3-embedding. When citing or reusing this content, credit "Benchize" and link to https://benchize.com/models/qwen3-embedding. Published benchmark results for this model, with source-reported metrics and evaluation settings. Canonical URL: https://benchize.com/models/qwen3-embedding Last updated: Wed, 21 Oct 2026 18:52:20 GMT Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations. Published benchmark results for this model, with source-reported metrics and evaluation settings. ## Benchmarks | Benchmark | Score | Rank | | | --- | --- | --- | --- | | [BEIR](https://benchize.com/benchmarks/mteb%3ABEIR.md) | 0.62source score | 2 / 15 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.6157822 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.6157822 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 73 ### Reported statistics experiments Not reported rank 7 scoresByTask {"ArguAna":0.7564,"CQADupstackRetrieval":0.502843,"ClimateFEVER":0.47426,"DBPedia":0.48226,"FEVER":0.91597,"FiQA2018":0.62654,"HotpotQA":0.74722,"MSMARCO":0.42721,"NFCorpus":0.411,"NQ":0.63133,"QuoraRetrieval":0.88062,"SCIDOCS":0.31444,"SciFact":0.78333,"TRECCOVID":0.92924,"Touche2020":0.35407} scoresByTaskType {"Retrieval":0.6157822} trainedOnTasks ["FEVER","HotpotQA","MSMARCO","NQ"] ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/BEIR/scores) Source MTEB Original model label Qwen/Qwen3-Embedding-4B Observed 2026-10-21T16:40:29.416Z Evidence SHA-256 `aa692eb1a79edbe38d3f54eb90a444bff3d6c0f7b0d66e7893c86efe737c8e26` Source locator `/rows/6` | | | | | [BEIR](https://benchize.com/benchmarks/mteb%3ABEIR.md) | 0.63source score | 1 / 15 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.6275818666666667 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.6275818666666667 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 73 ### Reported statistics experiments Not reported rank 2 scoresByTask {"ArguAna":0.76852,"CQADupstackRetrieval":0.529398,"ClimateFEVER":0.47355,"DBPedia":0.49683,"FEVER":0.91882,"FiQA2018":0.64567,"HotpotQA":0.76776,"MSMARCO":0.43603,"NFCorpus":0.41448,"NQ":0.65247,"QuoraRetrieval":0.88901,"SCIDOCS":0.32742,"SciFact":0.78457,"TRECCOVID":0.94991,"Touche2020":0.35929} scoresByTaskType {"Retrieval":0.6275818666666667} trainedOnTasks ["FEVER","HotpotQA","MSMARCO","NQ"] ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/BEIR/scores) Source MTEB Original model label Qwen/Qwen3-Embedding-8B Observed 2026-10-21T16:40:29.416Z Evidence SHA-256 `aa692eb1a79edbe38d3f54eb90a444bff3d6c0f7b0d66e7893c86efe737c8e26` Source locator `/rows/1` | | | | | [MTEB(nld, v1) · Dutch](https://benchize.com/benchmarks/mteb%3AMTEB(nld%2C%20v1).md) | 0.66source score | 1 / 11 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.6558998958333333 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.7011166111111111 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 2 scoresByTask {"ArguAna-NL.v2":0.63499,"BelebeleRetrieval":0.98583,"CovidDisinformationNLMultiLabelClassification":0.608165,"DutchBookReviewSentimentClassification.v2":0.964417,"DutchColaClassification":0.684114,"DutchGovernmentBiasClassification":0.621475,"DutchNewsArticlesClassification":0.622532,"DutchNewsArticlesClusteringP2P":0.449299,"DutchNewsArticlesClusteringS2S":0.384885,"DutchNewsArticlesRetrieval":0.80061,"DutchSarcasticHeadlinesClassification":0.786472,"IconclassClassification":0.608885,"IconclassClusteringS2S":0.423618,"LegalQANLRetrieval":0.78512,"MassiveIntentClassification":0.8384205,"MassiveScenarioClassification":0.876483,"MultiEURLEXMultilabelClassification":0.05044,"MultiHateClassification":0.8233,"NFCorpus-NL.v2":0.38244,"OpenTenderClassification":0.562879,"OpenTenderClusteringP2P":0.546106,"OpenTenderClusteringS2S":0.484264,"OpenTenderRetrieval":0.4766,"SCIDOCS-NL.v2":0.24858,"SIB200Classification":0.8387763333333332,"SIB200ClusteringS2S":0.564091,"SICK-NL-STS":0.841826,"SICKNLPairClassification":0.962273,"STSBenchmarkMultilingualSTS":0.8974219999999999,"SciFact-NL.v2":0.77203,"VABBClusteringP2P":0.605813,"VABBClusteringS2S":0.459657,"VABBMultiLabelClassification":0.585222,"VABBRetrieval":0.8027,"VaccinChatNLClassification":0.528526,"WebFAQRetrieval":0.78713,"WikipediaRerankingMultilingual":0.911737,"WikipediaRetrievalMultilingual":0.9259,"XLWICNLPairClassification":0.686148,"bBSARDNLRetrieval":0.41682} scoresByTaskType {"Classification":0.7296899861111111,"Clustering":0.48971662499999996,"MultilabelClassification":0.414609,"PairClassification":0.8242105,"Reranking":0.911737,"Retrieval":0.6682291666666665,"STS":0.869624} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(nld%2C%20v1)/scores) Source MTEB Original model label Qwen/Qwen3-Embedding-8B Observed 2026-10-21T16:40:34.651Z Evidence SHA-256 `9a76f8c975d4a52e0646df4cf0d33d81638e502e09c4917d880ac698f501788a` Source locator `/rows/1` | | | | | [FollowIR · Instruction Following](https://benchize.com/benchmarks/mteb%3AFollowIR.md) | 0.1source score | 2 / 16 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.10064133333333332 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.10064133333333332 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 3 scoresByTask {"Core17InstructionRetrieval":0.126043,"News21InstructionRetrieval":0.090212,"Robust04InstructionRetrieval":0.085669} scoresByTaskType {"InstructionReranking":0.10064133333333332} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/FollowIR/scores) Source MTEB Original model label Qwen/Qwen3-Embedding-8B Observed 2026-10-21T16:40:36.107Z Evidence SHA-256 `9727e715325c0f35c67173e5a59d96566fb3dded3f9f1558f9a7ddf230445ddb` Source locator `/rows/3` | | | | | [MTEB(cmn, v1) · Chinese](https://benchize.com/benchmarks/mteb%3AMTEB(cmn%2C%20v1).md) | 0.72source score | 2 / 3 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.7228334516129032 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.7351981964285713 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 83 ### Reported statistics experiments Not reported rank 14 scoresByTask {"AFQMC":0.508106,"ATEC":0.532428,"BQ":0.743034,"CLSClusteringP2P":0.711781,"CLSClusteringS2S":0.682058,"CMedQAv1-reranking":0.844303,"CMedQAv2-reranking":0.850626,"CmedqaRetrieval":0.50647,"Cmnli":0.840048,"CovidRetrieval":0.87373,"DuRetrieval":0.90102,"EcomRetrieval":0.7112,"IFlyTek":0.542362,"JDReview":0.862852,"LCQMC":0.795148,"MMarcoReranking":0.274541,"MMarcoRetrieval":0.8536,"MedicalRetrieval":0.63945,"MultilingualSentiment":0.8136,"Ocnli":0.826746,"OnlineShopping":0.8725,"PAWSX":0.446707,"QBQTC":0.401118,"STSB":0.861662,"T2Reranking":0.672706,"T2Retrieval":0.87942,"TNews":0.56442,"ThuNewsClusteringP2P":0.878822,"ThuNewsClusteringS2S":0.842879,"VideoRetrieval":0.7973,"Waimai":0.8772} scoresByTaskType {"Classification":0.755489,"Clustering":0.778885,"PairClassification":0.8333969999999999,"Reranking":0.660544,"Retrieval":0.77027375,"STS":0.6126004285714286} trainedOnTasks ["CMedQAv2-reranking","CmedqaRetrieval","DuRetrieval","MMarcoReranking","T2Retrieval"] ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(cmn%2C%20v1)/scores) Source MTEB Original model label Qwen/Qwen3-Embedding-4B Observed 2026-10-21T16:40:30.174Z Evidence SHA-256 `f29b711d6747ee5848d9b127e7517197a0d38a3c72a3ee75c810bd13b1c75370` Source locator `/rows/13` | | | | | [CoIR · Code Information Retrieval](https://benchize.com/benchmarks/mteb%3ACoIR.md) | 0.79source score | 2 / 3 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.7919594999999999 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.7919594999999999 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 7 scoresByTask {"AppsRetrieval":0.89176,"COIRCodeSearchNetRetrieval":0.8792833333333334,"CodeFeedbackMT":0.93211,"CodeFeedbackST":0.89514,"CodeSearchNetCCRetrieval":0.9558516666666667,"CodeTransOceanContest":0.90993,"CodeTransOceanDL":0.35039,"CosQA":0.37982,"StackOverflowQA":0.94323,"SyntheticText2SQL":0.78208} scoresByTaskType {"Retrieval":0.7919594999999999} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/CoIR/scores) Source MTEB Original model label Qwen/Qwen3-Embedding-4B Observed 2026-10-21T16:40:38.655Z Evidence SHA-256 `702b3cd3c4c0e45aa8a44651b56cf0945a7291e9b615807d81f74c44ee69a8bf` Source locator `/rows/6` | | | | | [MTEB(nld, v1) · Dutch](https://benchize.com/benchmarks/mteb%3AMTEB(nld%2C%20v1).md) | 0.64source score | 2 / 11 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.6367190416666666 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.684702246031746 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 7 scoresByTask {"ArguAna-NL.v2":0.60396,"BelebeleRetrieval":0.95388,"CovidDisinformationNLMultiLabelClassification":0.5793,"DutchBookReviewSentimentClassification.v2":0.961673,"DutchColaClassification":0.637074,"DutchGovernmentBiasClassification":0.627798,"DutchNewsArticlesClassification":0.618756,"DutchNewsArticlesClusteringP2P":0.452081,"DutchNewsArticlesClusteringS2S":0.374688,"DutchNewsArticlesRetrieval":0.7744,"DutchSarcasticHeadlinesClassification":0.738793,"IconclassClassification":0.580242,"IconclassClusteringS2S":0.375558,"LegalQANLRetrieval":0.78883,"MassiveIntentClassification":0.8233025,"MassiveScenarioClassification":0.8638735,"MultiEURLEXMultilabelClassification":0.0555,"MultiHateClassification":0.7962,"NFCorpus-NL.v2":0.37395,"OpenTenderClassification":0.555929,"OpenTenderClusteringP2P":0.506476,"OpenTenderClusteringS2S":0.43998,"OpenTenderRetrieval":0.48763,"SCIDOCS-NL.v2":0.23611,"SIB200Classification":0.8186926666666666,"SIB200ClusteringS2S":0.535347,"SICK-NL-STS":0.828748,"SICKNLPairClassification":0.957981,"STSBenchmarkMultilingualSTS":0.893601,"SciFact-NL.v2":0.76092,"VABBClusteringP2P":0.586011,"VABBClusteringS2S":0.453007,"VABBMultiLabelClassification":0.572011,"VABBRetrieval":0.78622,"VaccinChatNLClassification":0.457449,"WebFAQRetrieval":0.75161,"WikipediaRerankingMultilingual":0.891045,"WikipediaRetrievalMultilingual":0.91403,"XLWICNLPairClassification":0.672215,"bBSARDNLRetrieval":0.38389} scoresByTaskType {"Classification":0.7066485555555557,"Clustering":0.4653935,"MultilabelClassification":0.40227033333333334,"PairClassification":0.815098,"Reranking":0.891045,"Retrieval":0.6512858333333335,"STS":0.8611745} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(nld%2C%20v1)/scores) Source MTEB Original model label Qwen/Qwen3-Embedding-4B Observed 2026-10-21T16:40:34.651Z Evidence SHA-256 `9a76f8c975d4a52e0646df4cf0d33d81638e502e09c4917d880ac698f501788a` Source locator `/rows/6` | | | | | [FollowIR · Instruction Following](https://benchize.com/benchmarks/mteb%3AFollowIR.md) | 0.12source score | 1 / 16 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.11559966666666666 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.11559966666666666 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 1 scoresByTask {"Core17InstructionRetrieval":0.135289,"News21InstructionRetrieval":0.087106,"Robust04InstructionRetrieval":0.124404} scoresByTaskType {"InstructionReranking":0.11559966666666666} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/FollowIR/scores) Source MTEB Original model label Qwen/Qwen3-Embedding-4B Observed 2026-10-21T16:40:36.107Z Evidence SHA-256 `9727e715325c0f35c67173e5a59d96566fb3dded3f9f1558f9a7ddf230445ddb` Source locator `/rows/0` | | | | | [RTEB(Law, beta) · RTEB Legal](https://benchize.com/benchmarks/mteb%3ARTEB(Law%2C%20beta).md) | 0.67source score | 1 / 17 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.6724874999999999 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 17 scoresByTask {"AILACasedocs":0.46322,"AILAStatutes":0.85086,"FrenchLegal1Retrieval":0.89591,"GermanLegal1Retrieval":0.69769,"JapaneseLegal1Retrieval":0.78413,"LegalQuAD":0.66846,"LegalSummarization":0.70741} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(Law%2C%20beta)/scores) Source MTEB Original model label Qwen/Qwen3-Embedding-8B Observed 2026-10-21T16:40:41.494Z Evidence SHA-256 `7204bf17f439a2d3c2052309544ff33f53928c057dd204e20b275f942e4f5516` Source locator `/rows/16` | | | | | [CoREB(v1) · CoREB](https://benchize.com/benchmarks/mteb%3ACoREB(v1).md) | 0.59source score | 1 / 2 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.5895250000000001 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.5895250000000001 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 5 scoresByTask {"CorebC2CReranking":0.40392,"CorebC2CRetrieval":0.54934,"CorebC2TReranking":0.93515,"CorebC2TRetrieval":0.94252,"CorebT2CReranking":0.28394,"CorebT2CRetrieval":0.42228} scoresByTaskType {"Reranking":0.5410033333333334,"Retrieval":0.6380466666666668} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/CoREB(v1)/scores) Source MTEB Original model label Qwen/Qwen3-Embedding-8B Observed 2026-10-21T16:40:38.910Z Evidence SHA-256 `9d28b52b2c83341c15981918e7671117838603977e1190fc2258d3feb15c938d` Source locator `/rows/5` | | | | | [RTEB(Health, beta) · RTEB Healthcare](https://benchize.com/benchmarks/mteb%3ARTEB(Health%2C%20beta).md) | 0.67source score | 1 / 14 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.6703325757575758 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 8 scoresByTask {"CUREv1":0.6084751515151515,"ChatDoctorRetrieval":0.73219,"EnglishHealthcare1Retrieval":0.63545,"GermanHealthcare1Retrieval":0.8762} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(Health%2C%20beta)/scores) Source MTEB Original model label Qwen/Qwen3-Embedding-8B Observed 2026-10-21T16:40:40.988Z Evidence SHA-256 `bf62d4318f836a1a4f92c7d21e3acad553ff4cffb3162ea312270b15ce1b4e32` Source locator `/rows/7` | | | | | [CoREB(v1) · CoREB](https://benchize.com/benchmarks/mteb%3ACoREB(v1).md) | 0.56source score | 2 / 2 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.5645883333333334 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.5645883333333334 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 15 scoresByTask {"CorebC2CReranking":0.38025,"CorebC2CRetrieval":0.48473,"CorebC2TReranking":0.91246,"CorebC2TRetrieval":0.91698,"CorebT2CReranking":0.27769,"CorebT2CRetrieval":0.41542} scoresByTaskType {"Reranking":0.5234666666666666,"Retrieval":0.6057100000000001} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/CoREB(v1)/scores) Source MTEB Original model label Qwen/Qwen3-Embedding-4B Observed 2026-10-21T16:40:38.910Z Evidence SHA-256 `9d28b52b2c83341c15981918e7671117838603977e1190fc2258d3feb15c938d` Source locator `/rows/14` | | | | | [MTEB(kor, v2) · Korean](https://benchize.com/benchmarks/mteb%3AMTEB(kor%2C%20v2).md) | 0.77source score | 2 / 2 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.7694064083333334 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.7467482067901235 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 85 ### Reported statistics experiments Not reported rank 2 scoresByTask {"AutoRAGRetrieval":0.84314,"BelebeleRetrieval":0.9483366666666667,"KLUE-NLI":0.783378,"KLUE-STS":0.892954,"KLUE-TC":0.673877,"KlueMrcDomainClustering":0.870177,"KlueYnatMrcCategoryClustering":0.745475,"Ko-StrategyQA":0.82697,"KorNLI":0.867713,"KorSTS":0.899716,"LawIRKo":0.7769,"MIRACLReranking":0.67252,"MIRACLRetrieval":0.68028,"MrTidyRetrieval":0.6076,"MultiLongDocRetrieval":0.502245,"PawsXPairClassification":0.6073955,"PublicHealthQA":0.86926,"SIB200ClusteringS2S":0.51149,"SQuADKorV1Retrieval":0.90445,"STS17":0.904251} scoresByTaskType {"Classification":0.673877,"Clustering":0.7090473333333334,"PairClassification":0.7528288333333334,"Reranking":0.67252,"Retrieval":0.7732424074074075,"STS":0.8989736666666667} trainedOnTasks ["MIRACLReranking","MIRACLRetrieval","MrTidyRetrieval"] ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(kor%2C%20v2)/scores) Source MTEB Original model label Qwen/Qwen3-Embedding-4B Observed 2026-10-21T16:40:34.371Z Evidence SHA-256 `e1954767ff1c78bb6e47d1883fb79b56cb2a2d19d2749611fb5bb71bd86c2169` Source locator `/rows/1` | | | | | [RTEB(fra, beta) · RTEB French](https://benchize.com/benchmarks/mteb%3ARTEB(fra%2C%20beta).md) | 0.6source score | 1 / 17 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.5951390909090909 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 13 scoresByTask {"CUREv1":0.5951390909090909,"French1Retrieval":0.86754,"FrenchLegal1Retrieval":0.89591} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(fra%2C%20beta)/scores) Source MTEB Original model label Qwen/Qwen3-Embedding-8B Observed 2026-10-21T16:40:40.473Z Evidence SHA-256 `ec979a256821300f551b7822b61d94415dd4bf631591e9b647f2b6ae5b4b60f4` Source locator `/rows/12` | | | | | [MTEB(rus, v1.1) · Russian](https://benchize.com/benchmarks/mteb%3AMTEB(rus%2C%20v1.1).md) | 0.7source score | 2 / 8 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.7013252826086955 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.674575761904762 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 91 ### Reported statistics experiments Not reported rank 8 scoresByTask {"CEDRClassification":0.510096,"GeoreviewClassification":0.609082,"GeoreviewClusteringP2P":0.767674,"HeadlineClassification":0.835498,"InappropriatenessClassification":0.758594,"KinopoiskClassification":0.739133,"MIRACLReranking":0.65189,"MIRACLRetrievalHardNegatives.v2":0.71019,"MassiveIntentClassification":0.8268610000000001,"MassiveScenarioClassification":0.8730994999999999,"RUParaPhraserSTS":0.765856,"RiaNewsRetrievalHardNegatives.v2":0.8442,"RuBQReranking":0.722786,"RuBQRetrieval":0.73648,"RuReviewsClassification":0.759473,"RuSTSBenchmarkSTS":0.88774,"RuSciBenchGRNTIClassification":0.682031,"RuSciBenchGRNTIClusteringP2P":0.633937,"RuSciBenchOECDClassification":0.541943,"RuSciBenchOECDClusteringP2P":0.550563,"STS22":0.701387,"SensitiveTopicsClassification":0.355713,"TERRa":0.666255} scoresByTaskType {"Classification":0.7361905,"Clustering":0.6507246666666666,"MultilabelClassification":0.4329045,"PairClassification":0.666255,"Reranking":0.687338,"Retrieval":0.7636233333333333,"STS":0.7849943333333332} trainedOnTasks ["MIRACLReranking","MIRACLRetrievalHardNegatives.v2"] ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(rus%2C%20v1.1)/scores) Source MTEB Original model label Qwen/Qwen3-Embedding-4B Observed 2026-10-21T16:40:39.422Z Evidence SHA-256 `ac823b2b6938144aafb5350443bcb7c1f622d0aa834bf0b375d59b7ee34ed05e` Source locator `/rows/7` | | | | | [MTEB(rus, v1.1) · Russian](https://benchize.com/benchmarks/mteb%3AMTEB(rus%2C%20v1.1).md) | 0.71source score | 1 / 8 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.7141666086956522 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.6923460555555556 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 91 ### Reported statistics experiments Not reported rank 4 scoresByTask {"CEDRClassification":0.530499,"GeoreviewClassification":0.590869,"GeoreviewClusteringP2P":0.784751,"HeadlineClassification":0.85415,"InappropriatenessClassification":0.752051,"KinopoiskClassification":0.742133,"MIRACLReranking":0.6691,"MIRACLRetrievalHardNegatives.v2":0.73363,"MassiveIntentClassification":0.8369575,"MassiveScenarioClassification":0.8863004999999999,"RUParaPhraserSTS":0.760648,"RiaNewsRetrievalHardNegatives.v2":0.84895,"RuBQReranking":0.734738,"RuBQRetrieval":0.7631,"RuReviewsClassification":0.756006,"RuSTSBenchmarkSTS":0.891558,"RuSciBenchGRNTIClassification":0.706836,"RuSciBenchGRNTIClusteringP2P":0.653119,"RuSciBenchOECDClassification":0.566064,"RuSciBenchOECDClusteringP2P":0.563635,"STS22":0.726335,"SensitiveTopicsClassification":0.361084,"TERRa":0.713318} scoresByTaskType {"Classification":0.7434852222222221,"Clustering":0.6671683333333333,"MultilabelClassification":0.4457915,"PairClassification":0.713318,"Reranking":0.701919,"Retrieval":0.7818933333333334,"STS":0.7928470000000001} trainedOnTasks ["MIRACLReranking","MIRACLRetrievalHardNegatives.v2"] ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(rus%2C%20v1.1)/scores) Source MTEB Original model label Qwen/Qwen3-Embedding-8B Observed 2026-10-21T16:40:39.422Z Evidence SHA-256 `ac823b2b6938144aafb5350443bcb7c1f622d0aa834bf0b375d59b7ee34ed05e` Source locator `/rows/3` | | | | | [MTEB(Code, v1) · Code](https://benchize.com/benchmarks/mteb%3AMTEB(Code%2C%20v1).md) | 0.8source score | 2 / 3 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.8006564209401711 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.8006564209401711 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 5 scoresByTask {"AppsRetrieval":0.89176,"COIRCodeSearchNetRetrieval":0.8792833333333334,"CodeEditSearchRetrieval":0.7648953846153846,"CodeFeedbackMT":0.93211,"CodeFeedbackST":0.89514,"CodeSearchNetCCRetrieval":0.9558516666666667,"CodeSearchNetRetrieval":0.9233866666666667,"CodeTransOceanContest":0.90993,"CodeTransOceanDL":0.35039,"CosQA":0.37982,"StackOverflowQA":0.94323,"SyntheticText2SQL":0.78208} scoresByTaskType {"Retrieval":0.8006564209401711} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(Code%2C%20v1)/scores) Source MTEB Original model label Qwen/Qwen3-Embedding-4B Observed 2026-10-21T16:40:39.168Z Evidence SHA-256 `c8855166b6b338358c1c699aa21e1fa3f710c2bf19c2a0b6e6db0136038657d9` Source locator `/rows/4` | | | | | [RTEB(deu, beta) · RTEB German](https://benchize.com/benchmarks/mteb%3ARTEB(deu%2C%20beta).md) | 0.67source score | 1 / 17 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.66846 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 29 scoresByTask {"German1Retrieval":0.96967,"GermanHealthcare1Retrieval":0.8762,"GermanLegal1Retrieval":0.69769,"LegalQuAD":0.66846} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(deu%2C%20beta)/scores) Source MTEB Original model label Qwen/Qwen3-Embedding-8B Observed 2026-10-21T16:40:40.727Z Evidence SHA-256 `70250aaee4788084a090cdccd91621a3c80bbf5076195bc3f215bcb392e7637d` Source locator `/rows/28` | | | | | [RTEB(fin, beta) · RTEB Finance](https://benchize.com/benchmarks/mteb%3ARTEB(fin%2C%20beta).md) | 0.73source score | 3 / 13 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.7269933333333333 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 27 scoresByTask {"EnglishFinance1Retrieval":0.75375,"EnglishFinance2Retrieval":0.64954,"EnglishFinance3Retrieval":0.78063,"EnglishFinance4Retrieval":0.55381,"FinQARetrieval":0.63435,"FinanceBenchRetrieval":0.82751,"HC3FinanceRetrieval":0.71912} scoresByTaskType Not reported trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/RTEB(fin%2C%20beta)/scores) Source MTEB Original model label Qwen/Qwen3-Embedding-8B Observed 2026-10-21T16:40:40.217Z Evidence SHA-256 `e372e75484a69b00e1a4f9619cc0d72b27ed359ea6b25f0c413f1c9551e05c7e` Source locator `/rows/27` | | | | | [CoIR · Code Information Retrieval](https://benchize.com/benchmarks/mteb%3ACoIR.md) | 0.8source score | 1 / 3 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.79864 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.79864 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 8 scoresByTask {"AppsRetrieval":0.91071,"COIRCodeSearchNetRetrieval":0.8951116666666667,"CodeFeedbackMT":0.93699,"CodeFeedbackST":0.89929,"CodeSearchNetCCRetrieval":0.9634683333333333,"CodeTransOceanContest":0.93733,"CodeTransOceanDL":0.32809,"CosQA":0.38042,"StackOverflowQA":0.94751,"SyntheticText2SQL":0.78748} scoresByTaskType {"Retrieval":0.79864} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/CoIR/scores) Source MTEB Original model label Qwen/Qwen3-Embedding-8B Observed 2026-10-21T16:40:38.655Z Evidence SHA-256 `702b3cd3c4c0e45aa8a44651b56cf0945a7291e9b615807d81f74c44ee69a8bf` Source locator `/rows/7` | | | | | [MTEB(Code, v1) · Code](https://benchize.com/benchmarks/mteb%3AMTEB(Code%2C%20v1).md) | 0.81source score | 1 / 3 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.8068885149572648 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.8068885149572648 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 6 scoresByTask {"AppsRetrieval":0.91071,"COIRCodeSearchNetRetrieval":0.8951116666666667,"CodeEditSearchRetrieval":0.7696938461538461,"CodeFeedbackMT":0.93699,"CodeFeedbackST":0.89929,"CodeSearchNetCCRetrieval":0.9634683333333333,"CodeSearchNetRetrieval":0.9265683333333333,"CodeTransOceanContest":0.93733,"CodeTransOceanDL":0.32809,"CosQA":0.38042,"StackOverflowQA":0.94751,"SyntheticText2SQL":0.78748} scoresByTaskType {"Retrieval":0.8068885149572648} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(Code%2C%20v1)/scores) Source MTEB Original model label Qwen/Qwen3-Embedding-8B Observed 2026-10-21T16:40:39.168Z Evidence SHA-256 `c8855166b6b338358c1c699aa21e1fa3f710c2bf19c2a0b6e6db0136038657d9` Source locator `/rows/5` | | | | | [MTEB(cmn, v1) · Chinese](https://benchize.com/benchmarks/mteb%3AMTEB(cmn%2C%20v1).md) | 0.74source score | 1 / 3 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.7385685967741935 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.7501917698412699 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 83 ### Reported statistics experiments Not reported rank 8 scoresByTask {"AFQMC":0.528344,"ATEC":0.539912,"BQ":0.763131,"CLSClusteringP2P":0.742709,"CLSClusteringS2S":0.706935,"CMedQAv1-reranking":0.86132,"CMedQAv2-reranking":0.863852,"CmedqaRetrieval":0.52522,"Cmnli":0.843295,"CovidRetrieval":0.87653,"DuRetrieval":0.90939,"EcomRetrieval":0.72979,"IFlyTek":0.547441,"JDReview":0.88743,"LCQMC":0.801298,"MMarcoReranking":0.271429,"MMarcoRetrieval":0.8664,"MedicalRetrieval":0.65467,"MultilingualSentiment":0.8236165,"Ocnli":0.841364,"OnlineShopping":0.907,"PAWSX":0.543655,"QBQTC":0.407749,"STSB":0.862705,"T2Reranking":0.682946,"T2Retrieval":0.88987,"TNews":0.56733,"ThuNewsClusteringP2P":0.887944,"ThuNewsClusteringS2S":0.865571,"VideoRetrieval":0.80468,"Waimai":0.8921} scoresByTaskType {"Classification":0.7708195833333334,"Clustering":0.80078975,"PairClassification":0.8423295,"Reranking":0.66988675,"Retrieval":0.78206875,"STS":0.6352562857142858} trainedOnTasks ["CMedQAv2-reranking","CmedqaRetrieval","DuRetrieval","MMarcoReranking","T2Retrieval"] ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(cmn%2C%20v1)/scores) Source MTEB Original model label Qwen/Qwen3-Embedding-8B Observed 2026-10-21T16:40:30.174Z Evidence SHA-256 `f29b711d6747ee5848d9b127e7517197a0d38a3c72a3ee75c810bd13b1c75370` Source locator `/rows/7` | | | | | [MTEB(kor, v2) · Korean](https://benchize.com/benchmarks/mteb%3AMTEB(kor%2C%20v2).md) | 0.78source score | 1 / 2 | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.7773353333333334 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.7544947901234568 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 85 ### Reported statistics experiments Not reported rank 1 scoresByTask {"AutoRAGRetrieval":0.82765,"BelebeleRetrieval":0.9827066666666667,"KLUE-NLI":0.781156,"KLUE-STS":0.8913,"KLUE-TC":0.690967,"KlueMrcDomainClustering":0.753214,"KlueYnatMrcCategoryClustering":0.811067,"Ko-StrategyQA":0.83633,"KorNLI":0.876054,"KorSTS":0.900656,"LawIRKo":0.81712,"MIRACLReranking":0.67406,"MIRACLRetrieval":0.67829,"MrTidyRetrieval":0.61873,"MultiLongDocRetrieval":0.504565,"PawsXPairClassification":0.660622,"PublicHealthQA":0.87211,"SIB200ClusteringS2S":0.562952,"SQuADKorV1Retrieval":0.90628,"STS17":0.900877} scoresByTaskType {"Classification":0.690967,"Clustering":0.7090776666666668,"PairClassification":0.7726106666666667,"Reranking":0.67406,"Retrieval":0.7826424074074075,"STS":0.897611} trainedOnTasks ["MIRACLReranking","MIRACLRetrieval","MrTidyRetrieval"] ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(kor%2C%20v2)/scores) Source MTEB Original model label Qwen/Qwen3-Embedding-8B Observed 2026-10-21T16:40:34.371Z Evidence SHA-256 `e1954767ff1c78bb6e47d1883fb79b56cb2a2d19d2749611fb5bb71bd86c2169` Source locator `/rows/0` | | | | --- Cite as: Qwen3 Embedding — Benchize, https://benchize.com/models/qwen3-embedding (retrieved 2026-10-21)