# MTEB(deu, v1) · German > Source: Benchize (https://benchize.com) — https://benchize.com/benchmarks/mteb%3AMTEB(deu%2C%20v1). When citing or reusing this content, credit "Benchize" and link to https://benchize.com/benchmarks/mteb%3AMTEB(deu%2C%20v1). German text embedding quality across classification, clustering, pair classification, reranking, retrieval, and semantic similarity. Canonical URL: https://benchize.com/benchmarks/mteb%3AMTEB(deu%2C%20v1) Last updated: Wed, 21 Oct 2026 18:52:20 GMT Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations. German text embedding quality across classification, clustering, pair classification, reranking, retrieval, and semantic similarity. Embeddings · Models tested: 10 · Score publishers: [MTEB](https://arxiv.org/html/2401.02709v1) ## Model results | # | Model | Score | | | --- | --- | --- | --- | | 1 | [Multilingual-E5-Large](https://benchize.com/models/multilingual-e5-large.md) | 0.55source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.549381552631579 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.5504384166666666 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 94 ### Reported statistics experiments Not reported rank 19 scoresByTask {"AmazonCounterfactualClassification":0.696521,"AmazonReviewsClassification":0.43118999999999996,"BlurbsClusteringP2P":0.415229,"BlurbsClusteringS2S":0.167998,"FalseFriendsGermanEnglish":0.534444,"GerDaLIR":0.06533,"GermanDPR":0.82895,"GermanQuAD-Retrieval":0.932214,"GermanSTSBenchmark":0.840798,"MIRACLReranking":0.5361,"MTOPDomainClassification":0.8987885,"MTOPIntentClassification":0.671986,"MassiveIntentClassification":0.645248,"MassiveScenarioClassification":0.704144,"PawsXPairClassification":0.547291,"STS22":0.590732,"TenKGnadClusteringP2P":0.448306,"TenKGnadClusteringS2S":0.30835,"XMarket":0.17463} scoresByTaskType {"Classification":0.67464625,"Clustering":0.33497075,"PairClassification":0.5408675000000001,"Reranking":0.5361,"Retrieval":0.500281,"STS":0.715765} trainedOnTasks ["MIRACLReranking"] ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(deu%2C%20v1)/scores) Source MTEB Original model label intfloat/multilingual-e5-large Observed 2026-10-21T16:40:33.254Z Evidence SHA-256 `3049d3866e4630fda80cc24a54b97fabf1229366932e83607c39ce357fcc2e20` Source locator `/rows/18` | | | | | 2 | [E5-Large-v2](https://benchize.com/models/e5-large-v2.md) | 0.46source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.4570787001467767 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.4458933806231613 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 54 scoresByTask {"AmazonCounterfactualClassification":0.5789899458694433,"AmazonReviewsClassification":0.34681,"BlurbsClusteringP2P":0.311928,"BlurbsClusteringS2S":0.12395,"FalseFriendsGermanEnglish":0.479048,"GerDaLIR":0.02662,"GermanDPR":0.71683,"GermanQuAD-Retrieval":0.847142,"GermanSTSBenchmark":0.7332000953653802,"MIRACLReranking":0.34863,"MTOPDomainClassification":0.8190345,"MTOPIntentClassification":0.5314825,"MassiveIntentClassification":0.49284290709678996,"MassiveScenarioClassification":0.597874,"PawsXPairClassification":0.4966913544571445,"STS22":0.384461,"TenKGnadClusteringP2P":0.448537,"TenKGnadClusteringS2S":0.246054,"XMarket":0.15437} scoresByTaskType {"Classification":0.5611723088277055,"Clustering":0.28261725,"PairClassification":0.4878696772285722,"Reranking":0.34863,"Retrieval":0.4362405,"STS":0.5588305476826901} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(deu%2C%20v1)/scores) Source MTEB Original model label intfloat/e5-large-v2 Observed 2026-10-21T16:40:33.254Z Evidence SHA-256 `3049d3866e4630fda80cc24a54b97fabf1229366932e83607c39ce357fcc2e20` Source locator `/rows/53` | | | | | 3 | [GTE-Large](https://benchize.com/models/gte-large.md) | 0.43source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.43101357894736836 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.4234298194444444 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct -1 ### Reported statistics experiments Not reported rank 64 scoresByTask {"AmazonCounterfactualClassification":0.549092,"AmazonReviewsClassification":0.27824,"BlurbsClusteringP2P":0.30087,"BlurbsClusteringS2S":0.126276,"FalseFriendsGermanEnglish":0.4788,"GerDaLIR":0.02118,"GermanDPR":0.70453,"GermanQuAD-Retrieval":0.796378,"GermanSTSBenchmark":0.698542,"MIRACLReranking":0.2932,"MTOPDomainClassification":0.7568665,"MTOPIntentClassification":0.4235545,"MassiveIntentClassification":0.420738,"MassiveScenarioClassification":0.5785195000000001,"PawsXPairClassification":0.5220095,"STS22":0.396443,"TenKGnadClusteringP2P":0.434555,"TenKGnadClusteringS2S":0.251424,"XMarket":0.15804} scoresByTaskType {"Classification":0.5011684166666667,"Clustering":0.27828125000000004,"PairClassification":0.50040475,"Reranking":0.2932,"Retrieval":0.42003199999999996,"STS":0.5474924999999999} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(deu%2C%20v1)/scores) Source MTEB Original model label thenlper/gte-large Observed 2026-10-21T16:40:33.254Z Evidence SHA-256 `3049d3866e4630fda80cc24a54b97fabf1229366932e83607c39ce357fcc2e20` Source locator `/rows/63` | | | | | 4 | [BGE Large EN V1.5](https://benchize.com/models/bge-large-en-v1-5.md) | 0.43source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.42971089474555224 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.4221368767227986 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 94 ### Reported statistics experiments Not reported rank 69 scoresByTask {"AmazonCounterfactualClassification":0.555737701151538,"AmazonReviewsClassification":0.27731,"BlurbsClusteringP2P":0.290518,"BlurbsClusteringS2S":0.123002,"FalseFriendsGermanEnglish":0.4777,"GerDaLIR":0.01608,"GermanDPR":0.6845,"GermanQuAD-Retrieval":0.798223,"GermanSTSBenchmark":0.6719234776654263,"MIRACLReranking":0.30904,"MTOPDomainClassification":0.757369,"MTOPIntentClassification":0.4424905,"MassiveIntentClassification":0.4290362680863269,"MassiveScenarioClassification":0.5877215,"PawsXPairClassification":0.503915553262202,"STS22":0.402674,"TenKGnadClusteringP2P":0.44524,"TenKGnadClusteringS2S":0.246796,"XMarket":0.14523} scoresByTaskType {"Classification":0.5082774948729775,"Clustering":0.276389,"PairClassification":0.49080777663110103,"Reranking":0.30904,"Retrieval":0.41100825,"STS":0.5372987388327131} trainedOnTasks ["AmazonReviewsClassification"] ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(deu%2C%20v1)/scores) Source MTEB Original model label BAAI/bge-large-en-v1.5 Observed 2026-10-21T16:40:33.254Z Evidence SHA-256 `3049d3866e4630fda80cc24a54b97fabf1229366932e83607c39ce357fcc2e20` Source locator `/rows/68` | | | | | 5 | [E5-Base-v2](https://benchize.com/models/e5-base-v2.md) | 0.42source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.4243806025801734 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.4067674933565626 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 68 scoresByTask {"AmazonCounterfactualClassification":0.5712274034794276,"AmazonReviewsClassification":0.30455,"BlurbsClusteringP2P":0.290935,"BlurbsClusteringS2S":0.124096,"FalseFriendsGermanEnglish":0.473636,"GerDaLIR":0.01662,"GermanDPR":0.63724,"GermanQuAD-Retrieval":0.792491,"GermanSTSBenchmark":0.720826882387422,"MIRACLReranking":0.25629,"MTOPDomainClassification":0.7747085,"MTOPIntentClassification":0.4685565,"MassiveIntentClassification":0.46185388963739193,"MassiveScenarioClassification":0.5705910000000001,"PawsXPairClassification":0.49472127351905526,"STS22":0.29163,"TenKGnadClusteringP2P":0.422042,"TenKGnadClusteringS2S":0.248566,"XMarket":0.14265} scoresByTaskType {"Classification":0.5252478821861366,"Clustering":0.27140975,"PairClassification":0.48417863675952766,"Reranking":0.25629,"Retrieval":0.39725024999999997,"STS":0.506228441193711} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(deu%2C%20v1)/scores) Source MTEB Original model label intfloat/e5-base-v2 Observed 2026-10-21T16:40:33.254Z Evidence SHA-256 `3049d3866e4630fda80cc24a54b97fabf1229366932e83607c39ce357fcc2e20` Source locator `/rows/67` | | | | | 6 | [GTE-Base](https://benchize.com/models/gte-base.md) | 0.41source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.4087007631578947 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.39600148611111113 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct -1 ### Reported statistics experiments Not reported rank 77 scoresByTask {"AmazonCounterfactualClassification":0.5762594999999999,"AmazonReviewsClassification":0.2701,"BlurbsClusteringP2P":0.256075,"BlurbsClusteringS2S":0.117383,"FalseFriendsGermanEnglish":0.479152,"GerDaLIR":0.01468,"GermanDPR":0.63639,"GermanQuAD-Retrieval":0.758991,"GermanSTSBenchmark":0.690791,"MIRACLReranking":0.24342,"MTOPDomainClassification":0.707246,"MTOPIntentClassification":0.44691000000000003,"MassiveIntentClassification":0.4128385,"MassiveScenarioClassification":0.534618,"PawsXPairClassification":0.5099695,"STS22":0.311206,"TenKGnadClusteringP2P":0.414081,"TenKGnadClusteringS2S":0.230864,"XMarket":0.15434} scoresByTaskType {"Classification":0.4913286666666667,"Clustering":0.25460075,"PairClassification":0.49456075,"Reranking":0.24342,"Retrieval":0.39110025,"STS":0.5009985} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(deu%2C%20v1)/scores) Source MTEB Original model label thenlper/gte-base Observed 2026-10-21T16:40:33.254Z Evidence SHA-256 `3049d3866e4630fda80cc24a54b97fabf1229366932e83607c39ce357fcc2e20` Source locator `/rows/76` | | | | | 7 | [BGE Base EN V1.5](https://benchize.com/models/bge-base-en-v1-5.md) | 0.4source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.4046827209005197 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.3939370993435756 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 94 ### Reported statistics experiments Not reported rank 84 scoresByTask {"AmazonCounterfactualClassification":0.5621159625405521,"AmazonReviewsClassification":0.26310999999999996,"BlurbsClusteringP2P":0.251541,"BlurbsClusteringS2S":0.113774,"FalseFriendsGermanEnglish":0.477742,"GerDaLIR":0.01246,"GermanDPR":0.62378,"GermanQuAD-Retrieval":0.761978,"GermanSTSBenchmark":0.6557169829445715,"MIRACLReranking":0.25832,"MTOPDomainClassification":0.6905615,"MTOPIntentClassification":0.442921,"MassiveIntentClassification":0.4112485449398972,"MassiveScenarioClassification":0.5382385,"PawsXPairClassification":0.4997622066848535,"STS22":0.326736,"TenKGnadClusteringP2P":0.421134,"TenKGnadClusteringS2S":0.220722,"XMarket":0.15711} scoresByTaskType {"Classification":0.48469925124674157,"Clustering":0.25179275,"PairClassification":0.48875210334242675,"Reranking":0.25832,"Retrieval":0.388832,"STS":0.49122649147228575} trainedOnTasks ["AmazonReviewsClassification"] ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(deu%2C%20v1)/scores) Source MTEB Original model label BAAI/bge-base-en-v1.5 Observed 2026-10-21T16:40:33.254Z Evidence SHA-256 `3049d3866e4630fda80cc24a54b97fabf1229366932e83607c39ce357fcc2e20` Source locator `/rows/83` | | | | | 8 | [All Mpnet Base V2](https://benchize.com/models/all-mpnet-base-v2.md) | 0.39source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.38969202631578953 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.37589355555555554 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 97 scoresByTask {"AmazonCounterfactualClassification":0.55289,"AmazonReviewsClassification":0.26126000000000005,"BlurbsClusteringP2P":0.250311,"BlurbsClusteringS2S":0.106229,"FalseFriendsGermanEnglish":0.474828,"GerDaLIR":0.01531,"GermanDPR":0.56919,"GermanQuAD-Retrieval":0.710141,"GermanSTSBenchmark":0.6463464999999999,"MIRACLReranking":0.2343,"MTOPDomainClassification":0.7195435,"MTOPIntentClassification":0.443256,"MassiveIntentClassification":0.4370675,"MassiveScenarioClassification":0.531937,"PawsXPairClassification":0.505075,"STS22":0.270132,"TenKGnadClusteringP2P":0.394077,"TenKGnadClusteringS2S":0.199835,"XMarket":0.08242} scoresByTaskType {"Classification":0.4909923333333333,"Clustering":0.23761300000000002,"PairClassification":0.4899515,"Reranking":0.2343,"Retrieval":0.34426525,"STS":0.45823925} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(deu%2C%20v1)/scores) Source MTEB Original model label sentence-transformers/all-mpnet-base-v2 Observed 2026-10-21T16:40:33.254Z Evidence SHA-256 `3049d3866e4630fda80cc24a54b97fabf1229366932e83607c39ce357fcc2e20` Source locator `/rows/96` | | | | | 9 | [all-MiniLM-L12-v2](https://benchize.com/models/all-minilm-l12-v2.md) | 0.37source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.3713581052631579 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.3597168055555556 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 113 scoresByTask {"AmazonCounterfactualClassification":0.5773915000000001,"AmazonReviewsClassification":0.26251,"BlurbsClusteringP2P":0.174435,"BlurbsClusteringS2S":0.100872,"FalseFriendsGermanEnglish":0.480149,"GerDaLIR":0.00547,"GermanDPR":0.50251,"GermanQuAD-Retrieval":0.668981,"GermanSTSBenchmark":0.6656150000000001,"MIRACLReranking":0.23327,"MTOPDomainClassification":0.718011,"MTOPIntentClassification":0.432284,"MassiveIntentClassification":0.4374255,"MassiveScenarioClassification":0.516958,"PawsXPairClassification":0.48806099999999997,"STS22":0.225291,"TenKGnadClusteringP2P":0.304545,"TenKGnadClusteringS2S":0.158085,"XMarket":0.10394} scoresByTaskType {"Classification":0.4907633333333334,"Clustering":0.18448425000000002,"PairClassification":0.484105,"Reranking":0.23327,"Retrieval":0.32022525,"STS":0.44545300000000004} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(deu%2C%20v1)/scores) Source MTEB Original model label sentence-transformers/all-MiniLM-L12-v2 Observed 2026-10-21T16:40:33.254Z Evidence SHA-256 `3049d3866e4630fda80cc24a54b97fabf1229366932e83607c39ce357fcc2e20` Source locator `/rows/112` | | | | | 10 | [all-MiniLM-L6-v2](https://benchize.com/models/all-minilm-l6-v2.md) | 0.37source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.3671895729327787 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.3504189100070438 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 112 scoresByTask {"AmazonCounterfactualClassification":0.5789933922121845,"AmazonReviewsClassification":0.26589,"BlurbsClusteringP2P":0.199438,"BlurbsClusteringS2S":0.093845,"FalseFriendsGermanEnglish":0.47974416537089537,"GerDaLIR":0.01069,"GermanDPR":0.47834,"GermanQuAD-Retrieval":0.6371823956442826,"GermanSTSBenchmark":0.63928061999339,"MIRACLReranking":0.16265,"MTOPDomainClassification":0.7043227867703392,"MTOPIntentClassification":0.4548095261381975,"MassiveIntentClassification":0.42826644660347046,"MassiveScenarioClassification":0.507593,"PawsXPairClassification":0.4959920130423115,"STS22":0.31044353994772356,"TenKGnadClusteringP2P":0.302958,"TenKGnadClusteringS2S":0.133183,"XMarket":0.09298} scoresByTaskType {"Classification":0.48997919195403195,"Clustering":0.18235600000000002,"PairClassification":0.4878680892066034,"Reranking":0.16265,"Retrieval":0.3047980989110706,"STS":0.4748620799705568} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/MTEB(deu%2C%20v1)/scores) Source MTEB Original model label sentence-transformers/all-MiniLM-L6-v2 Observed 2026-10-21T16:40:33.254Z Evidence SHA-256 `3049d3866e4630fda80cc24a54b97fabf1229366932e83607c39ce357fcc2e20` Source locator `/rows/111` | | | | --- Cite as: MTEB(deu, v1) · German — Benchize, https://benchize.com/benchmarks/mteb%3AMTEB(deu%2C%20v1) (retrieved 2026-10-21)