# Spanish

> Source: Benchize (https://benchize.com) — https://benchize.com/benchmarks/scale%3Aspanish. When citing or reusing this content, credit "Benchize" and link to https://benchize.com/benchmarks/scale%3Aspanish.

The Scale AI Multilingual Prompts Dataset, composed of 1,000 prompts per language, is tailored to enhance models’ interaction capabilities across multiple languages. This dataset specifically aims to refine chatbots' proficiency in engaging with Spanish users from Spain, Mexico and the rest of Latin America, reflecting complexity of global communication. This dataset introduces single-turn prompts across a diversified range of scenarios, aiming to evaluate and improve models’ responses in both general and culturally nuanced conversations.

Canonical URL: https://benchize.com/benchmarks/scale%3Aspanish
Last updated: Wed, 21 Oct 2026 18:52:20 GMT

Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations.

The Scale AI Multilingual Prompts Dataset, composed of 1,000 prompts per language, is tailored to enhance models’ interaction capabilities across multiple languages. This dataset specifically aims to refine chatbots' proficiency in engaging with Spanish users from Spain, Mexico and the rest of Latin America, reflecting complexity of global communication. This dataset introduces single-turn prompts across a diversified range of scenarios, aiming to evaluate and improve models’ responses in both general and culturally nuanced conversations.

Language & multilingual · Models tested: 5 · Score publishers: [scale](https://labs.scale.com/leaderboard/spanish)

## Model results

| # | Model | Score | ± |  |
| --- | --- | --- | --- | --- |
| 1 | [O3 Mini](https://benchize.com/models/o3-mini.md) | 1,079source score | CI 1,046–1,112 |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 1079 \| source_score \| reported \| Higher is better \| ### Configuration Reasoning effort unknown Model configuration o3-mini sourceModelVersion o3-mini-2025-01-31 (high) thinkingEnabled Not reported ### Reported statistics Uncertainty Confidence interval: 1,046–1,112 contaminationWarning Not reported rank 8 reportedConfidenceHalfWidth 33 ### Source [Original source](https://labs.scale.com/leaderboard/spanish) Source scale Original model label o3-mini Observed 2026-10-21T16:35:44.884Z Evidence SHA-256 `20dbd29f5dee622033d82f3adac6f1fd3067ca0737ea686c945855c6ce1c38ac` Source locator `/rows/7` |  |  |  |  |
| 2 | [GPT-4 Turbo Preview](https://benchize.com/models/gpt-4-turbo-preview.md) | 1,020source score | CI 998–1,042 |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 1020 \| source_score \| reported \| Higher is better \| ### Configuration Reasoning effort unknown Model configuration GPT-4 Turbo Preview sourceModelVersion gpt-4-0125-preview thinkingEnabled Not reported ### Reported statistics Uncertainty Confidence interval: 998–1,042 contaminationWarning Not reported rank 14 reportedConfidenceHalfWidth 22 ### Source [Original source](https://labs.scale.com/leaderboard/spanish) Source scale Original model label GPT-4 Turbo Preview Observed 2026-10-21T16:35:44.884Z Evidence SHA-256 `20dbd29f5dee622033d82f3adac6f1fd3067ca0737ea686c945855c6ce1c38ac` Source locator `/rows/13` |  |  |  |  |
| 3 | [Gemini 1.5 Flash](https://benchize.com/models/gemini-1-5-flash.md) | 980source score | CI 952–1,008 |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 980 \| source_score \| reported \| Higher is better \| ### Configuration Reasoning effort unknown Model configuration Gemini 1.5 Flash sourceModelVersion gemini-1.5-flash-preview-0514 thinkingEnabled Not reported ### Reported statistics Uncertainty Confidence interval: 952–1,008 contaminationWarning Not reported rank 18 reportedConfidenceHalfWidth 28 ### Source [Original source](https://labs.scale.com/leaderboard/spanish) Source scale Original model label Gemini 1.5 Flash Observed 2026-10-21T16:35:44.884Z Evidence SHA-256 `20dbd29f5dee622033d82f3adac6f1fd3067ca0737ea686c945855c6ce1c38ac` Source locator `/rows/17` |  |  |  |  |
| 4 | [Gemma 2 27B](https://benchize.com/models/gemma-2-27b-it.md) | 951source score | CI 925–977 |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 951 \| source_score \| reported \| Higher is better \| ### Configuration Reasoning effort unknown Model configuration Gemma 2 27B sourceModelVersion gemma-2-27b thinkingEnabled Not reported ### Reported statistics Uncertainty Confidence interval: 925–977 contaminationWarning Not reported rank 19 reportedConfidenceHalfWidth 26 ### Source [Original source](https://labs.scale.com/leaderboard/spanish) Source scale Original model label Gemma 2 27B Observed 2026-10-21T16:35:44.884Z Evidence SHA-256 `20dbd29f5dee622033d82f3adac6f1fd3067ca0737ea686c945855c6ce1c38ac` Source locator `/rows/18` |  |  |  |  |
| 5 | [Claude 3 Opus](https://benchize.com/models/claude-3-opus.md) | 919source score | CI 897–941 |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 919 \| source_score \| reported \| Higher is better \| ### Configuration Reasoning effort unknown Model configuration Claude 3 Opus sourceModelVersion claude-3-opus-20240229 thinkingEnabled Not reported ### Reported statistics Uncertainty Confidence interval: 897–941 contaminationWarning Not reported rank 21 reportedConfidenceHalfWidth 22 ### Source [Original source](https://labs.scale.com/leaderboard/spanish) Source scale Original model label Claude 3 Opus Observed 2026-10-21T16:35:44.884Z Evidence SHA-256 `20dbd29f5dee622033d82f3adac6f1fd3067ca0737ea686c945855c6ce1c38ac` Source locator `/rows/20` |  |  |  |  |

---
Cite as: Spanish — Benchize, https://benchize.com/benchmarks/scale%3Aspanish (retrieved 2026-10-21)
