# Qwen3.8 27BNon-thinking

> Source: Benchize (https://benchize.com) — https://benchize.com/models/qwen3-8-27b-off. When citing or reusing this content, credit "Benchize" and link to https://benchize.com/models/qwen3-8-27b-off.

Alibaba

Canonical URL: https://benchize.com/models/qwen3-8-27b-off
Last updated: Thu, 22 Oct 2026 06:30:09 GMT

Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations.

Alibaba

## Benchmarks

| Benchmark | Score | Rank | Cost | Source |  |
| --- | --- | --- | --- | --- | --- |
| [BullshitBench v2](https://benchize.com/benchmarks/bullshitbench%3Av2.md) | 79% | 11 / 191 | — | [bullshitbench · v2](https://api.github.com/repos/petergpt/bullshit-benchmark/contents/data/v2/latest/leaderboard.csv?ref=3c655234d15967738f95da696e3f938d4862dcf7) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `green_rate` \| 0.79 \| score_fraction \| all_attempts \| Higher is better \| \| `red_rate` \| 0.12 \| score_fraction \| all_attempts \| Lower is better \| \| `refusal_rate` \| 0.0 \| score_fraction \| all_attempts \| Lower is better \| \| `avg_score` \| 1.63 \| score \| judge_grade_0_to_2 \| Higher is better \| ### Configuration Reasoning effort none suite v2 thinkingEnabled false ### Reported statistics acceptedCount 12 answeredCount 100 clearCount 79 errorCount 0 partialCount 9 rank 26 refusalCount 0 sampleSize 100 ### Source [Original source](https://api.github.com/repos/petergpt/bullshit-benchmark/contents/data/v2/latest/leaderboard.csv?ref=3c655234d15967738f95da696e3f938d4862dcf7) Source bullshitbench Original model label qwen/qwen3.8-27b Source version v2 Observed 2026-10-22T03:10:12.603Z Evidence SHA-256 `98b485e08764d1c97144bc4f7b28ced1a96d50850947c775870dfda0e5d749b5` Source locator `/rows/25` |  |  |  |  |  |
| [ARC-AGI-1](https://benchize.com/benchmarks/arc-prize%3Av1_Semi_Private.md) | 34% | 190 / 245 | 0.04usd per task | [arc prize · v1](https://arcprize.org/media/data/leaderboard/v1.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.34 \| score_fraction \| v1_Semi_Private \| Higher is better \| \| `cost_per_task` \| 0.04125527700000001 \| usd_per_task \| v1_Semi_Private \| Lower is better \| ### Configuration evaluationSplit v1_Semi_Private harness Not reported modelGroup alibaba-qwen3-8-27b modelType CoT sourceModelVersion alibaba-qwen3-8-27b-none thinkingEnabled false ### Source [Original source](https://arcprize.org/media/data/leaderboard/v1.json) Source arc prize Original model label Qwen3.8-27B (None) Source version v1 Observed 2026-10-22T05:20:04.066Z Evidence SHA-256 `2bf68d22dafba37047d07ad833ebc0e8199c9aa2f9eeaed50c75c1b704462836` Source locator `/evaluations/261` |  |  |  |  |  |
| [ARC-AGI-2](https://benchize.com/benchmarks/arc-prize%3Av2_Semi_Private.md) | 1.53% | 206 / 243 | 0.06usd per task | [arc prize · v2](https://arcprize.org/media/data/leaderboard/v2.json) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.015277777777777777 \| score_fraction \| v2_Semi_Private \| Higher is better \| \| `cost_per_task` \| 0.05891859291666669 \| usd_per_task \| v2_Semi_Private \| Lower is better \| ### Configuration evaluationSplit v2_Semi_Private harness Not reported modelGroup alibaba-qwen3-8-27b modelType CoT sourceModelVersion alibaba-qwen3-8-27b-none thinkingEnabled false ### Source [Original source](https://arcprize.org/media/data/leaderboard/v2.json) Source arc prize Original model label Qwen3.8-27B (None) Source version v2 Observed 2026-10-22T05:20:04.306Z Evidence SHA-256 `4351eb696e78113b0459e9bb5f0258318b905efef34f473dcea51ce641b0d94d` Source locator `/evaluations/263` |  |  |  |  |  |

---
Cite as: Qwen3.8 27BNon-thinking — Benchize, https://benchize.com/models/qwen3-8-27b-off (retrieved 2026-10-22)