# Qwen3.5 397B A17BNon-thinking

> Source: Benchize (https://benchize.com) — https://benchize.com/models/qwen3-5-397b-a17b-off. When citing or reusing this content, credit "Benchize" and link to https://benchize.com/models/qwen3-5-397b-a17b-off.

Alibaba

Canonical URL: https://benchize.com/models/qwen3-5-397b-a17b-off
Last updated: Thu, 22 Oct 2026 06:30:09 GMT

Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations.

Alibaba

## Benchmarks

| Benchmark | Score | ± | Rank | Source |  |
| --- | --- | --- | --- | --- | --- |
| [OTIS Mock AIME 2024–2025](https://benchize.com/benchmarks/epoch-ai%3Aotis_mock_aime_2024_2025.md) | 82.22% | SE ±5.76 pp | 59 / 124 | [epoch ai · OTIS Mock AIME 2024-2025](https://epoch.ai/data/benchmark_data.zip#file=otis_mock_aime_2024_2025.csv) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.8222222222222222 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.8222222222222222 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion OTIS Mock AIME 2024-2025 reasoningBudget Not reported Reasoning effort none sourceModelVersion qwen3.5-397b-a17b_none ### Reported statistics Uncertainty Standard error: ±5.76 pp standardError 0.057637747950250916 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=otis_mock_aime_2024_2025.csv) Source epoch ai Original model label qwen3.5-397b-a17b Source version OTIS Mock AIME 2024-2025 Evaluated 2026-08-07T00:12:04.000Z Observed 2026-10-22T03:00:05.281Z Evidence SHA-256 `b7c9da8c0587c82f1e0d814ceb496c24308380b997a16203b6e5d39eb07f4f50` Source locator `/rows/99` |  |  |  |  |  |
| [FrontierMath Tiers 1–3 v2 (private)](https://benchize.com/benchmarks/epoch-ai%3Afrontiermath_tiers_1_3_v2.md) | 31.23% | SE ±2.75 pp | 36 / 50 | [epoch ai · FrontierMath-Tiers-1-3-v2-Private](https://epoch.ai/data/benchmark_data.zip#file=frontiermath_tiers_1_3_v2.csv) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.312280701754386 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.312280701754386 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion FrontierMath-Tiers-1-3-v2-Private reasoningBudget Not reported Reasoning effort none sourceModelVersion qwen3.5-397b-a17b_none ### Reported statistics Uncertainty Standard error: ±2.75 pp standardError 0.027499133473298815 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=frontiermath_tiers_1_3_v2.csv) Source epoch ai Original model label qwen3.5-397b-a17b Source version FrontierMath-Tiers-1-3-v2-Private Evaluated 2026-08-30T22:34:18.000Z Observed 2026-10-22T03:00:05.281Z Evidence SHA-256 `d3458d4272f99e04212525904a59fffffa7a94e827c62b26e36e3fd3e15fe587` Source locator `/rows/22` |  |  |  |  |  |
| [BullshitBench v2](https://benchize.com/benchmarks/bullshitbench%3Av2.md) | 69% | — | 28 / 191 | [bullshitbench · v2](https://api.github.com/repos/petergpt/bullshit-benchmark/contents/data/v2/latest/leaderboard.csv?ref=3c655234d15967738f95da696e3f938d4862dcf7) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `green_rate` \| 0.69 \| score_fraction \| all_attempts \| Higher is better \| \| `red_rate` \| 0.15 \| score_fraction \| all_attempts \| Lower is better \| \| `refusal_rate` \| 0.0 \| score_fraction \| all_attempts \| Lower is better \| \| `avg_score` \| 1.5267 \| score \| judge_grade_0_to_2 \| Higher is better \| ### Configuration Reasoning effort none suite v2 thinkingEnabled false ### Reported statistics acceptedCount 15 answeredCount 100 clearCount 69 errorCount 0 partialCount 16 rank 40 refusalCount 0 sampleSize 100 ### Source [Original source](https://api.github.com/repos/petergpt/bullshit-benchmark/contents/data/v2/latest/leaderboard.csv?ref=3c655234d15967738f95da696e3f938d4862dcf7) Source bullshitbench Original model label qwen/qwen3.5-397b-a17b Source version v2 Observed 2026-10-22T03:10:12.603Z Evidence SHA-256 `98b485e08764d1c97144bc4f7b28ced1a96d50850947c775870dfda0e5d749b5` Source locator `/rows/39` |  |  |  |  |  |
| [GPQA Diamond](https://benchize.com/benchmarks/gpqa-diamond.md) | 86.36% | SE ±2.45 pp | 43 / 126 | [epoch ai · GPQA diamond](https://epoch.ai/data/benchmark_data.zip#file=gpqa_diamond.csv) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.8636363636363636 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.8636363636363636 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion GPQA diamond reasoningBudget Not reported Reasoning effort none sourceModelVersion qwen3.5-397b-a17b_none ### Reported statistics Uncertainty Standard error: ±2.45 pp standardError 0.02445015597318985 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=gpqa_diamond.csv) Source epoch ai Original model label qwen3.5-397b-a17b Source version GPQA diamond Evaluated 2026-08-07T00:24:02.000Z Observed 2026-10-22T03:00:05.281Z Evidence SHA-256 `9ef0b938bdd8406b029d595983ee8ad3a80bd9d64b82605b91b5ce39ba650c39` Source locator `/rows/90` |  |  |  |  |  |
| [Mystery Game Puzzles](https://benchize.com/benchmarks/epoch-ai%3Amystery_game_puzzles.md) | 18% | SE ±3.86 pp | 45 / 72 | [epoch ai · Mystery Game Puzzles](https://epoch.ai/data/benchmark_data.zip#file=mystery_game_puzzles.csv) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.18 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.18 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion Mystery Game Puzzles reasoningBudget Not reported Reasoning effort none sourceModelVersion qwen3.5-397b-a17b_none ### Reported statistics Uncertainty Standard error: ±3.86 pp standardError 0.03861229196653691 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=mystery_game_puzzles.csv) Source epoch ai Original model label qwen3.5-397b-a17b Source version Mystery Game Puzzles Evaluated 2026-08-27T18:47:58.000Z Observed 2026-10-22T03:00:05.281Z Evidence SHA-256 `f66941ed5e9520190b66af57d2b6fd62a9582077dd25ab8764ce651bc0eca00a` Source locator `/rows/49` |  |  |  |  |  |

---
Cite as: Qwen3.5 397B A17BNon-thinking — Benchize, https://benchize.com/models/qwen3-5-397b-a17b-off (retrieved 2026-10-22)