# ChemTEB · Chemical > Source: Benchize (https://benchize.com) — https://benchize.com/benchmarks/mteb%3AChemTEB. When citing or reusing this content, credit "Benchize" and link to https://benchize.com/benchmarks/mteb%3AChemTEB. Chemical domain text embedding quality across bitext mining, classification, clustering, pair classification, and retrieval. Canonical URL: https://benchize.com/benchmarks/mteb%3AChemTEB Last updated: Wed, 21 Oct 2026 18:52:20 GMT Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations. Chemical domain text embedding quality across bitext mining, classification, clustering, pair classification, and retrieval. Embeddings · Models tested: 13 · Score publishers: [MTEB](https://arxiv.org/abs/2412.00532) ## Model results | # | Model | Score | | | --- | --- | --- | --- | | 1 | [Text Embedding 3 Large](https://benchize.com/models/text-embedding-3-large.md) | 0.76source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.7594954351851853 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.5684121205882353 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct -1 ### Reported statistics experiments Not reported rank 3 scoresByTask {"ChemHotpotQARetrieval":0.8321900000000001,"ChemNQRetrieval":0.62537,"PubChemAISentenceParaphrasePC":0.904486,"PubChemSMILESBitextMining":0.00596825,"PubChemSMILESPC":0.13746,"PubChemSynonymPC":0.735234,"PubChemWikiPairClassification":0.9558185,"PubChemWikiParagraphsPC":0.512724,"SDSEyeProtectionClassification":0.7043,"SDSGlovesClassification":0.7036,"WikipediaBioMetChemClassification":0.995909,"WikipediaBiolumNeurochemClassification":0.984694,"WikipediaChemEngSpecialtiesClassification":0.781452,"WikipediaChemFieldsClassification":0.578726,"WikipediaChemistryTopicsClassification":0.93658,"WikipediaChemistryTopicsClustering":0.789998,"WikipediaCompChemSpectroscopyClassification":0.803167,"WikipediaCryobiologySeparationClassification":0.961803,"WikipediaCrystallographyAnalyticalClassification":0.982818,"WikipediaGreenhouseEnantiopureClassification":0.986404,"WikipediaIsotopesFissionClassification":0.933333,"WikipediaLuminescenceClassification":0.92439,"WikipediaOrganicInorganicClassification":0.910646,"WikipediaSaltsSemiconductorsClassification":0.906061,"WikipediaSolidStateColloidalClassification":0.843018,"WikipediaSpecialtiesInChemistryClustering":0.408899,"WikipediaTheoreticalAppliedClassification":0.661328} scoresByTaskType {"BitextMining":0.00596825,"Classification":0.8587193529411765,"Clustering":0.5994485,"PairClassification":0.6491445,"Retrieval":0.72878} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/ChemTEB/scores) Source MTEB Original model label openai/text-embedding-3-large Observed 2026-10-21T16:40:30.425Z Evidence SHA-256 `a686e5d3d53f427eaafcd06cf50605dd45e3b4e0a7aaae31f5e8c757b4adbbed` Source locator `/rows/3` | | | | | 2 | [Text Embedding 3 Small](https://benchize.com/models/text-embedding-3-small.md) | 0.73source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.7318446574074073 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.5253170288235294 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct -1 ### Reported statistics experiments Not reported rank 9 scoresByTask {"ChemHotpotQARetrieval":0.7836766666666667,"ChemNQRetrieval":0.57431,"PubChemAISentenceParaphrasePC":0.927259,"PubChemSMILESBitextMining":0.00242275,"PubChemSMILESPC":0.114266,"PubChemSynonymPC":0.670247,"PubChemWikiPairClassification":0.9092403333333333,"PubChemWikiParagraphsPC":0.433094,"SDSEyeProtectionClassification":0.7713,"SDSGlovesClassification":0.67045,"WikipediaBioMetChemClassification":0.99295,"WikipediaBiolumNeurochemClassification":0.968367,"WikipediaChemEngSpecialtiesClassification":0.741935,"WikipediaChemFieldsClassification":0.554994,"WikipediaChemistryTopicsClassification":0.89905,"WikipediaChemistryTopicsClustering":0.782465,"WikipediaCompChemSpectroscopyClassification":0.790045,"WikipediaCryobiologySeparationClassification":0.946352,"WikipediaCrystallographyAnalyticalClassification":0.96323,"WikipediaGreenhouseEnantiopureClassification":0.977193,"WikipediaIsotopesFissionClassification":0.908333,"WikipediaLuminescenceClassification":0.908537,"WikipediaOrganicInorganicClassification":0.888593,"WikipediaSaltsSemiconductorsClassification":0.89596,"WikipediaSolidStateColloidalClassification":0.826802,"WikipediaSpecialtiesInChemistryClustering":0.196018,"WikipediaTheoreticalAppliedClassification":0.662716} scoresByTaskType {"BitextMining":0.00242275,"Classification":0.8451062941176471,"Clustering":0.4892415,"PairClassification":0.6108212666666667,"Retrieval":0.6789933333333333} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/ChemTEB/scores) Source MTEB Original model label openai/text-embedding-3-small Observed 2026-10-21T16:40:30.425Z Evidence SHA-256 `a686e5d3d53f427eaafcd06cf50605dd45e3b4e0a7aaae31f5e8c757b4adbbed` Source locator `/rows/8` | | | | | 3 | [Text Embedding Ada 002](https://benchize.com/models/text-embedding-ada-002.md) | 0.73source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.7250024197530864 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.5211490909803922 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct -1 ### Reported statistics experiments Not reported rank 10 scoresByTask {"ChemHotpotQARetrieval":0.8047733333333333,"ChemNQRetrieval":0.53004,"PubChemAISentenceParaphrasePC":0.94319,"PubChemSMILESBitextMining":0.003408,"PubChemSMILESPC":0.111315,"PubChemSynonymPC":0.630975,"PubChemWikiPairClassification":0.919218,"PubChemWikiParagraphsPC":0.326533,"SDSEyeProtectionClassification":0.70615,"SDSGlovesClassification":0.61885,"WikipediaBioMetChemClassification":0.994343,"WikipediaBiolumNeurochemClassification":0.969388,"WikipediaChemEngSpecialtiesClassification":0.737097,"WikipediaChemFieldsClassification":0.559091,"WikipediaChemistryTopicsClassification":0.887648,"WikipediaChemistryTopicsClustering":0.755327,"WikipediaCompChemSpectroscopyClassification":0.79638,"WikipediaCryobiologySeparationClassification":0.939914,"WikipediaCrystallographyAnalyticalClassification":0.967698,"WikipediaGreenhouseEnantiopureClassification":0.982018,"WikipediaIsotopesFissionClassification":0.909524,"WikipediaLuminescenceClassification":0.904878,"WikipediaOrganicInorganicClassification":0.908365,"WikipediaSaltsSemiconductorsClassification":0.90303,"WikipediaSolidStateColloidalClassification":0.836486,"WikipediaSpecialtiesInChemistryClustering":0.260943,"WikipediaTheoreticalAppliedClassification":0.668483} scoresByTaskType {"BitextMining":0.003408,"Classification":0.8405495882352941,"Clustering":0.508135,"PairClassification":0.5862461999999999,"Retrieval":0.6674066666666667} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/ChemTEB/scores) Source MTEB Original model label openai/text-embedding-ada-002 Observed 2026-10-21T16:40:30.425Z Evidence SHA-256 `a686e5d3d53f427eaafcd06cf50605dd45e3b4e0a7aaae31f5e8c757b4adbbed` Source locator `/rows/9` | | | | | 4 | [BGE Large EN V1.5](https://benchize.com/models/bge-large-en-v1-5.md) | 0.71source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.7089782438271605 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.5069501209803923 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 11 scoresByTask {"ChemHotpotQARetrieval":0.8786200000000001,"ChemNQRetrieval":0.59904,"PubChemAISentenceParaphrasePC":0.963245,"PubChemSMILESBitextMining":0.00170475,"PubChemSMILESPC":0.111874,"PubChemSynonymPC":0.631272,"PubChemWikiPairClassification":0.8664748333333333,"PubChemWikiParagraphsPC":0.327063,"SDSEyeProtectionClassification":0.76275,"SDSGlovesClassification":0.70235,"WikipediaBioMetChemClassification":0.995909,"WikipediaBiolumNeurochemClassification":0.967347,"WikipediaChemEngSpecialtiesClassification":0.390323,"WikipediaChemFieldsClassification":0.538906,"WikipediaChemistryTopicsClassification":0.885748,"WikipediaChemistryTopicsClustering":0.733455,"WikipediaCompChemSpectroscopyClassification":0.761538,"WikipediaCryobiologySeparationClassification":0.949356,"WikipediaCrystallographyAnalyticalClassification":0.970103,"WikipediaGreenhouseEnantiopureClassification":0.983333,"WikipediaIsotopesFissionClassification":0.917857,"WikipediaLuminescenceClassification":0.904878,"WikipediaOrganicInorganicClassification":0.903802,"WikipediaSaltsSemiconductorsClassification":0.864646,"WikipediaSolidStateColloidalClassification":0.824324,"WikipediaSpecialtiesInChemistryClustering":0.050384,"WikipediaTheoreticalAppliedClassification":0.65611} scoresByTaskType {"BitextMining":0.00170475,"Classification":0.8223105882352941,"Clustering":0.3919195,"PairClassification":0.5799857666666667,"Retrieval":0.7388300000000001} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/ChemTEB/scores) Source MTEB Original model label BAAI/bge-large-en-v1.5 Observed 2026-10-21T16:40:30.425Z Evidence SHA-256 `a686e5d3d53f427eaafcd06cf50605dd45e3b4e0a7aaae31f5e8c757b4adbbed` Source locator `/rows/10` | | | | | 5 | [BGE Base EN V1.5](https://benchize.com/models/bge-base-en-v1-5.md) | 0.7source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.7047731450617284 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.5165618284313724 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 16 scoresByTask {"ChemHotpotQARetrieval":0.8624033333333333,"ChemNQRetrieval":0.61175,"PubChemAISentenceParaphrasePC":0.955084,"PubChemSMILESBitextMining":0.001799,"PubChemSMILESPC":0.111079,"PubChemSynonymPC":0.607787,"PubChemWikiPairClassification":0.8549525833333332,"PubChemWikiParagraphsPC":0.306797,"SDSEyeProtectionClassification":0.70745,"SDSGlovesClassification":0.6339,"WikipediaBioMetChemClassification":0.994256,"WikipediaBiolumNeurochemClassification":0.962245,"WikipediaChemEngSpecialtiesClassification":0.341129,"WikipediaChemFieldsClassification":0.535956,"WikipediaChemistryTopicsClassification":0.881948,"WikipediaChemistryTopicsClustering":0.773769,"WikipediaCompChemSpectroscopyClassification":0.752941,"WikipediaCryobiologySeparationClassification":0.948927,"WikipediaCrystallographyAnalyticalClassification":0.971134,"WikipediaGreenhouseEnantiopureClassification":0.986404,"WikipediaIsotopesFissionClassification":0.894048,"WikipediaLuminescenceClassification":0.904878,"WikipediaOrganicInorganicClassification":0.893916,"WikipediaSaltsSemiconductorsClassification":0.885859,"WikipediaSolidStateColloidalClassification":0.82545,"WikipediaSpecialtiesInChemistryClustering":0.158,"WikipediaTheoreticalAppliedClassification":0.665013} scoresByTaskType {"BitextMining":0.001799,"Classification":0.8109090588235294,"Clustering":0.46588450000000003,"PairClassification":0.5671399166666666,"Retrieval":0.7370766666666666} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/ChemTEB/scores) Source MTEB Original model label BAAI/bge-base-en-v1.5 Observed 2026-10-21T16:40:30.425Z Evidence SHA-256 `a686e5d3d53f427eaafcd06cf50605dd45e3b4e0a7aaae31f5e8c757b4adbbed` Source locator `/rows/15` | | | | | 6 | [All Mpnet Base V2](https://benchize.com/models/all-mpnet-base-v2.md) | 0.7source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.698010549382716 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.4927463968627451 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 23 scoresByTask {"ChemHotpotQARetrieval":0.6846399999999999,"ChemNQRetrieval":0.52953,"PubChemAISentenceParaphrasePC":0.952239,"PubChemSMILESBitextMining":0.00087975,"PubChemSMILESPC":0.097491,"PubChemSynonymPC":0.578878,"PubChemWikiPairClassification":0.8186730833333332,"PubChemWikiParagraphsPC":0.198167,"SDSEyeProtectionClassification":0.68225,"SDSGlovesClassification":0.61675,"WikipediaBioMetChemClassification":0.994082,"WikipediaBiolumNeurochemClassification":0.960204,"WikipediaChemEngSpecialtiesClassification":0.491935,"WikipediaChemFieldsClassification":0.540311,"WikipediaChemistryTopicsClassification":0.890261,"WikipediaChemistryTopicsClustering":0.682674,"WikipediaCompChemSpectroscopyClassification":0.817647,"WikipediaCryobiologySeparationClassification":0.951073,"WikipediaCrystallographyAnalyticalClassification":0.964605,"WikipediaGreenhouseEnantiopureClassification":0.98114,"WikipediaIsotopesFissionClassification":0.911905,"WikipediaLuminescenceClassification":0.914634,"WikipediaOrganicInorganicClassification":0.888973,"WikipediaSaltsSemiconductorsClassification":0.878788,"WikipediaSolidStateColloidalClassification":0.832207,"WikipediaSpecialtiesInChemistryClustering":0.326357,"WikipediaTheoreticalAppliedClassification":0.659991} scoresByTaskType {"BitextMining":0.00087975,"Classification":0.8221621176470588,"Clustering":0.5045155,"PairClassification":0.5290896166666667,"Retrieval":0.6070849999999999} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/ChemTEB/scores) Source MTEB Original model label sentence-transformers/all-mpnet-base-v2 Observed 2026-10-21T16:40:30.425Z Evidence SHA-256 `a686e5d3d53f427eaafcd06cf50605dd45e3b4e0a7aaae31f5e8c757b4adbbed` Source locator `/rows/22` | | | | | 7 | [all-MiniLM-L6-v2](https://benchize.com/models/all-minilm-l6-v2.md) | 0.7source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.6960103950617283 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.4950644019607844 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 32 scoresByTask {"ChemHotpotQARetrieval":0.7254333333333333,"ChemNQRetrieval":0.54939,"PubChemAISentenceParaphrasePC":0.933402,"PubChemSMILESBitextMining":0.001496,"PubChemSMILESPC":0.104968,"PubChemSynonymPC":0.609142,"PubChemWikiPairClassification":0.7511763333333333,"PubChemWikiParagraphsPC":0.287745,"SDSEyeProtectionClassification":0.7382,"SDSGlovesClassification":0.6192,"WikipediaBioMetChemClassification":0.991036,"WikipediaBiolumNeurochemClassification":0.954082,"WikipediaChemEngSpecialtiesClassification":0.572581,"WikipediaChemFieldsClassification":0.517984,"WikipediaChemistryTopicsClassification":0.861283,"WikipediaChemistryTopicsClustering":0.694442,"WikipediaCompChemSpectroscopyClassification":0.771493,"WikipediaCryobiologySeparationClassification":0.920601,"WikipediaCrystallographyAnalyticalClassification":0.946392,"WikipediaGreenhouseEnantiopureClassification":0.974561,"WikipediaIsotopesFissionClassification":0.897619,"WikipediaLuminescenceClassification":0.904878,"WikipediaOrganicInorganicClassification":0.862738,"WikipediaSaltsSemiconductorsClassification":0.877778,"WikipediaSolidStateColloidalClassification":0.802027,"WikipediaSpecialtiesInChemistryClustering":0.272977,"WikipediaTheoreticalAppliedClassification":0.649656} scoresByTaskType {"BitextMining":0.001496,"Classification":0.8154181764705882,"Clustering":0.4837095,"PairClassification":0.5372866666666667,"Retrieval":0.6374116666666667} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/ChemTEB/scores) Source MTEB Original model label sentence-transformers/all-MiniLM-L6-v2 Observed 2026-10-21T16:40:30.425Z Evidence SHA-256 `a686e5d3d53f427eaafcd06cf50605dd45e3b4e0a7aaae31f5e8c757b4adbbed` Source locator `/rows/31` | | | | | 8 | [Bge m3](https://benchize.com/models/bge-m3.md) | 0.7source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.695761824074074 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.5026239805882353 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 38 scoresByTask {"ChemHotpotQARetrieval":0.8198433333333334,"ChemNQRetrieval":0.5896,"PubChemAISentenceParaphrasePC":0.969501,"PubChemSMILESBitextMining":0.00072375,"PubChemSMILESPC":0.093988,"PubChemSynonymPC":0.607477,"PubChemWikiPairClassification":0.9221951666666667,"PubChemWikiParagraphsPC":0.176727,"SDSEyeProtectionClassification":0.7575,"SDSGlovesClassification":0.64415,"WikipediaBioMetChemClassification":0.982245,"WikipediaBiolumNeurochemClassification":0.967347,"WikipediaChemEngSpecialtiesClassification":0.684677,"WikipediaChemFieldsClassification":0.470718,"WikipediaChemistryTopicsClassification":0.818527,"WikipediaChemistryTopicsClustering":0.722788,"WikipediaCompChemSpectroscopyClassification":0.757466,"WikipediaCryobiologySeparationClassification":0.9103,"WikipediaCrystallographyAnalyticalClassification":0.896564,"WikipediaGreenhouseEnantiopureClassification":0.972368,"WikipediaIsotopesFissionClassification":0.897619,"WikipediaLuminescenceClassification":0.886585,"WikipediaOrganicInorganicClassification":0.84943,"WikipediaSaltsSemiconductorsClassification":0.868687,"WikipediaSolidStateColloidalClassification":0.739865,"WikipediaSpecialtiesInChemistryClustering":0.171523,"WikipediaTheoreticalAppliedClassification":0.607155} scoresByTaskType {"BitextMining":0.00072375,"Classification":0.8065413529411765,"Clustering":0.4471555,"PairClassification":0.5539776333333334,"Retrieval":0.7047216666666667} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/ChemTEB/scores) Source MTEB Original model label BAAI/bge-m3 Observed 2026-10-21T16:40:30.425Z Evidence SHA-256 `a686e5d3d53f427eaafcd06cf50605dd45e3b4e0a7aaae31f5e8c757b4adbbed` Source locator `/rows/37` | | | | | 9 | [E5-Large-v2](https://benchize.com/models/e5-large-v2.md) | 0.69source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.6924048580246913 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.502006191372549 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 26 scoresByTask {"ChemHotpotQARetrieval":0.8434233333333333,"ChemNQRetrieval":0.69439,"PubChemAISentenceParaphrasePC":0.95779,"PubChemSMILESBitextMining":0.002263,"PubChemSMILESPC":0.108279,"PubChemSynonymPC":0.642903,"PubChemWikiPairClassification":0.8654358333333333,"PubChemWikiParagraphsPC":0.205092,"SDSEyeProtectionClassification":0.7206,"SDSGlovesClassification":0.61215,"WikipediaBioMetChemClassification":0.990601,"WikipediaBiolumNeurochemClassification":0.953061,"WikipediaChemEngSpecialtiesClassification":0.369355,"WikipediaChemFieldsClassification":0.503793,"WikipediaChemistryTopicsClassification":0.859857,"WikipediaChemistryTopicsClustering":0.755299,"WikipediaCompChemSpectroscopyClassification":0.765611,"WikipediaCryobiologySeparationClassification":0.934335,"WikipediaCrystallographyAnalyticalClassification":0.945704,"WikipediaGreenhouseEnantiopureClassification":0.974561,"WikipediaIsotopesFissionClassification":0.897619,"WikipediaLuminescenceClassification":0.878049,"WikipediaOrganicInorganicClassification":0.884791,"WikipediaSaltsSemiconductorsClassification":0.879798,"WikipediaSolidStateColloidalClassification":0.800676,"WikipediaSpecialtiesInChemistryClustering":0.009366,"WikipediaTheoreticalAppliedClassification":0.640129} scoresByTaskType {"BitextMining":0.002263,"Classification":0.8006288235294118,"Clustering":0.3823325,"PairClassification":0.5558999666666666,"Retrieval":0.7689066666666666} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/ChemTEB/scores) Source MTEB Original model label intfloat/e5-large-v2 Observed 2026-10-21T16:40:30.425Z Evidence SHA-256 `a686e5d3d53f427eaafcd06cf50605dd45e3b4e0a7aaae31f5e8c757b4adbbed` Source locator `/rows/25` | | | | | 10 | [all-MiniLM-L12-v2](https://benchize.com/models/all-minilm-l12-v2.md) | 0.69source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.6901196697530865 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.49693888215686266 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 36 scoresByTask {"ChemHotpotQARetrieval":0.7119633333333333,"ChemNQRetrieval":0.56998,"PubChemAISentenceParaphrasePC":0.939622,"PubChemSMILESBitextMining":0.001264,"PubChemSMILESPC":0.110471,"PubChemSynonymPC":0.594779,"PubChemWikiPairClassification":0.82651875,"PubChemWikiParagraphsPC":0.246654,"SDSEyeProtectionClassification":0.6641,"SDSGlovesClassification":0.5728,"WikipediaBioMetChemClassification":0.989817,"WikipediaBiolumNeurochemClassification":0.95,"WikipediaChemEngSpecialtiesClassification":0.529839,"WikipediaChemFieldsClassification":0.512165,"WikipediaChemistryTopicsClassification":0.844656,"WikipediaChemistryTopicsClustering":0.708602,"WikipediaCompChemSpectroscopyClassification":0.744344,"WikipediaCryobiologySeparationClassification":0.924464,"WikipediaCrystallographyAnalyticalClassification":0.950859,"WikipediaGreenhouseEnantiopureClassification":0.977193,"WikipediaIsotopesFissionClassification":0.904762,"WikipediaLuminescenceClassification":0.908537,"WikipediaOrganicInorganicClassification":0.858935,"WikipediaSaltsSemiconductorsClassification":0.878788,"WikipediaSolidStateColloidalClassification":0.782432,"WikipediaSpecialtiesInChemistryClustering":0.284527,"WikipediaTheoreticalAppliedClassification":0.645159} scoresByTaskType {"BitextMining":0.001264,"Classification":0.802285294117647,"Clustering":0.49656449999999996,"PairClassification":0.54360895,"Retrieval":0.6409716666666667} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/ChemTEB/scores) Source MTEB Original model label sentence-transformers/all-MiniLM-L12-v2 Observed 2026-10-21T16:40:30.425Z Evidence SHA-256 `a686e5d3d53f427eaafcd06cf50605dd45e3b4e0a7aaae31f5e8c757b4adbbed` Source locator `/rows/35` | | | | | 11 | [Multilingual-E5-Large](https://benchize.com/models/multilingual-e5-large.md) | 0.68source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.6827171080246913 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.4846361107843137 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 34 scoresByTask {"ChemHotpotQARetrieval":0.7978533333333333,"ChemNQRetrieval":0.66172,"PubChemAISentenceParaphrasePC":0.966415,"PubChemSMILESBitextMining":0.0020812499999999998,"PubChemSMILESPC":0.10766,"PubChemSynonymPC":0.639594,"PubChemWikiPairClassification":0.9452433333333333,"PubChemWikiParagraphsPC":0.191996,"SDSEyeProtectionClassification":0.7115,"SDSGlovesClassification":0.6371,"WikipediaBioMetChemClassification":0.987728,"WikipediaBiolumNeurochemClassification":0.957143,"WikipediaChemEngSpecialtiesClassification":0.320161,"WikipediaChemFieldsClassification":0.487578,"WikipediaChemistryTopicsClassification":0.846318,"WikipediaChemistryTopicsClustering":0.65198,"WikipediaCompChemSpectroscopyClassification":0.746606,"WikipediaCryobiologySeparationClassification":0.919742,"WikipediaCrystallographyAnalyticalClassification":0.929553,"WikipediaGreenhouseEnantiopureClassification":0.973684,"WikipediaIsotopesFissionClassification":0.907143,"WikipediaLuminescenceClassification":0.879268,"WikipediaOrganicInorganicClassification":0.885551,"WikipediaSaltsSemiconductorsClassification":0.854545,"WikipediaSolidStateColloidalClassification":0.787162,"WikipediaSpecialtiesInChemistryClustering":0.006477,"WikipediaTheoreticalAppliedClassification":0.63156} scoresByTaskType {"BitextMining":0.0020812499999999998,"Classification":0.7919024705882353,"Clustering":0.3292285,"PairClassification":0.5701816666666667,"Retrieval":0.7297866666666666} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/ChemTEB/scores) Source MTEB Original model label intfloat/multilingual-e5-large Observed 2026-10-21T16:40:30.425Z Evidence SHA-256 `a686e5d3d53f427eaafcd06cf50605dd45e3b4e0a7aaae31f5e8c757b4adbbed` Source locator `/rows/33` | | | | | 12 | [E5-Base-v2](https://benchize.com/models/e5-base-v2.md) | 0.68source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.6826520956790124 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.4806744268627451 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 35 scoresByTask {"ChemHotpotQARetrieval":0.8261966666666667,"ChemNQRetrieval":0.62051,"PubChemAISentenceParaphrasePC":0.953089,"PubChemSMILESBitextMining":0.001386,"PubChemSMILESPC":0.107705,"PubChemSynonymPC":0.629222,"PubChemWikiPairClassification":0.8577719166666666,"PubChemWikiParagraphsPC":0.201773,"SDSEyeProtectionClassification":0.72675,"SDSGlovesClassification":0.63055,"WikipediaBioMetChemClassification":0.991471,"WikipediaBiolumNeurochemClassification":0.956122,"WikipediaChemEngSpecialtiesClassification":0.377419,"WikipediaChemFieldsClassification":0.502271,"WikipediaChemistryTopicsClassification":0.846318,"WikipediaChemistryTopicsClustering":0.652387,"WikipediaCompChemSpectroscopyClassification":0.753846,"WikipediaCryobiologySeparationClassification":0.927468,"WikipediaCrystallographyAnalyticalClassification":0.944674,"WikipediaGreenhouseEnantiopureClassification":0.973246,"WikipediaIsotopesFissionClassification":0.891667,"WikipediaLuminescenceClassification":0.882927,"WikipediaOrganicInorganicClassification":0.884791,"WikipediaSaltsSemiconductorsClassification":0.851515,"WikipediaSolidStateColloidalClassification":0.792568,"WikipediaSpecialtiesInChemistryClustering":0.008186,"WikipediaTheoreticalAppliedClassification":0.639777} scoresByTaskType {"BitextMining":0.001386,"Classification":0.7984341176470588,"Clustering":0.33028650000000004,"PairClassification":0.5499121833333334,"Retrieval":0.7233533333333333} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/ChemTEB/scores) Source MTEB Original model label intfloat/e5-base-v2 Observed 2026-10-21T16:40:30.425Z Evidence SHA-256 `a686e5d3d53f427eaafcd06cf50605dd45e3b4e0a7aaae31f5e8c757b4adbbed` Source locator `/rows/34` | | | | | 13 | [multi-qa-mpnet-base-dot-v1](https://benchize.com/models/multi-qa-mpnet-base-dot-v1.md) | 0.67source score | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `mean_task` \| 0.6683318024691358 \| source_score \| source_published_aggregate \| Higher is better \| \| `mean_task_type` \| 0.4687830501960784 \| source_score \| source_published_aggregate \| Higher is better \| ### Configuration zeroShotPct 100 ### Reported statistics experiments Not reported rank 43 scoresByTask {"ChemHotpotQARetrieval":0.6965166666666667,"ChemNQRetrieval":0.52805,"PubChemAISentenceParaphrasePC":0.97479,"PubChemSMILESBitextMining":0.000556,"PubChemSMILESPC":0.100256,"PubChemSynonymPC":0.60265,"PubChemWikiPairClassification":0.762253,"PubChemWikiParagraphsPC":0.180455,"SDSEyeProtectionClassification":0.6999,"SDSGlovesClassification":0.5952,"WikipediaBioMetChemClassification":0.982942,"WikipediaBiolumNeurochemClassification":0.95102,"WikipediaChemEngSpecialtiesClassification":0.446774,"WikipediaChemFieldsClassification":0.447055,"WikipediaChemistryTopicsClassification":0.832779,"WikipediaChemistryTopicsClustering":0.666115,"WikipediaCompChemSpectroscopyClassification":0.749321,"WikipediaCryobiologySeparationClassification":0.920172,"WikipediaCrystallographyAnalyticalClassification":0.913746,"WikipediaGreenhouseEnantiopureClassification":0.969737,"WikipediaIsotopesFissionClassification":0.888095,"WikipediaLuminescenceClassification":0.897561,"WikipediaOrganicInorganicClassification":0.840684,"WikipediaSaltsSemiconductorsClassification":0.859596,"WikipediaSolidStateColloidalClassification":0.764189,"WikipediaSpecialtiesInChemistryClustering":0.176483,"WikipediaTheoreticalAppliedClassification":0.598063} scoresByTaskType {"BitextMining":0.000556,"Classification":0.7856961176470588,"Clustering":0.421299,"PairClassification":0.5240807999999999,"Retrieval":0.6122833333333333} trainedOnTasks Not reported ### Source [Original source](https://mteb-leaderboard-backend.hf.space/v1/benchmarks/ChemTEB/scores) Source MTEB Original model label sentence-transformers/multi-qa-mpnet-base-dot-v1 Observed 2026-10-21T16:40:30.425Z Evidence SHA-256 `a686e5d3d53f427eaafcd06cf50605dd45e3b4e0a7aaae31f5e8c757b4adbbed` Source locator `/rows/42` | | | | --- Cite as: ChemTEB · Chemical — Benchize, https://benchize.com/benchmarks/mteb%3AChemTEB (retrieved 2026-10-21)