# ZeroBench main w/ python (pass@5)

> Source: Benchize (https://benchize.com) — https://benchize.com/benchmarks/zero-bench-main-python. When citing or reusing this content, credit "Benchize" and link to https://benchize.com/benchmarks/zero-bench-main-python.

ZeroBench main-set pass@5 over five runs with Python assistance.

Canonical URL: https://benchize.com/benchmarks/zero-bench-main-python
Last updated: Wed, 21 Oct 2026 18:05:10 GMT

Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations.

ZeroBench main-set pass@5 over five runs with Python assistance.

Multimodal · Models tested: 5 · Score publishers: [moonshot k3](https://www.kimi.ai/blog/kimi-k3)

## Model results

| # | Model | Score |  |
| --- | --- | --- | --- |
| 1 | [Claude Fable 5](https://benchize.com/models/claude-fable-5-max.md)Max | 46% |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `pass_at_5` \| 46.0 \| percent \| main_pass_at_5 \| Higher is better \| ### Configuration Fallback policy unspecified fallbackEnabled true Reasoning effort max runs 5 sourceFallbackLabel with fallback subset main thinkingEnabled true tools ["python"] toolsEnabled true trials 5 Fallback is enabled for refusals; this does not mean every task used a fallback model. ### Reported statistics runCount 5 ### Source Score publisher [Moonshot AI](https://www.kimi.ai/blog/kimi-k3) Collected via [moonshot k3](https://www.kimi.ai/blog/kimi-k3) Publisher reference Referenced by the collection source; the upstream result has not been independently captured. Benchmark [https://www.kimi.ai/blog/kimi-k3](https://www.kimi.ai/blog/kimi-k3) [Collected via](https://www.kimi.ai/blog/kimi-k3) Source Moonshot AI Original model label Claude Fable 5 (max, with fallback) Source version sha256:0e806bbad76dc8e8dbc899a86051e3406bdd5995fe6c6aa1b2176dde4fb28e6c Observed 2026-10-21T16:31:44.130Z Evidence SHA-256 `0e806bbad76dc8e8dbc899a86051e3406bdd5995fe6c6aa1b2176dde4fb28e6c` Source locator `/flight/sheet/data/31/scores/1` |  |  |  |
| 2 | [GPT-5.5](https://benchize.com/models/gpt-5-5-xhigh.md)Extra high | 41% |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `pass_at_5` \| 41.0 \| percent \| main_pass_at_5 \| Higher is better \| ### Configuration Reasoning effort xhigh runs 5 subset main thinkingEnabled true tools ["python"] toolsEnabled true trials 5 ### Reported statistics runCount 5 ### Source Score publisher [Moonshot AI](https://www.kimi.ai/blog/kimi-k3) Collected via [moonshot k3](https://www.kimi.ai/blog/kimi-k3) Publisher reference Referenced by the collection source; the upstream result has not been independently captured. Benchmark [https://www.kimi.ai/blog/kimi-k3](https://www.kimi.ai/blog/kimi-k3) [Collected via](https://www.kimi.ai/blog/kimi-k3) Source Moonshot AI Original model label GPT 5.5 (xhigh) Source version sha256:0e806bbad76dc8e8dbc899a86051e3406bdd5995fe6c6aa1b2176dde4fb28e6c Observed 2026-10-21T16:31:44.130Z Evidence SHA-256 `0e806bbad76dc8e8dbc899a86051e3406bdd5995fe6c6aa1b2176dde4fb28e6c` Source locator `/flight/sheet/data/31/scores/4` |  |  |  |
| 2 | [Kimi K3](https://benchize.com/models/kimi-k3-max.md)Max | 41% |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `pass_at_5` \| 41.0 \| percent \| main_pass_at_5 \| Higher is better \| ### Configuration Reasoning effort max runs 5 subset main Temperature 1 thinkingEnabled true tools ["python"] toolsEnabled true topP 1 trials 5 ### Reported statistics runCount 5 ### Source Score publisher [Moonshot AI](https://www.kimi.ai/blog/kimi-k3) Collected via [moonshot k3](https://www.kimi.ai/blog/kimi-k3) Publisher reference Referenced by the collection source; the upstream result has not been independently captured. Benchmark [https://www.kimi.ai/blog/kimi-k3](https://www.kimi.ai/blog/kimi-k3) [Collected via](https://www.kimi.ai/blog/kimi-k3) Source Moonshot AI Original model label Kimi K3 (max) Source version sha256:0e806bbad76dc8e8dbc899a86051e3406bdd5995fe6c6aa1b2176dde4fb28e6c Observed 2026-10-21T16:31:44.130Z Evidence SHA-256 `0e806bbad76dc8e8dbc899a86051e3406bdd5995fe6c6aa1b2176dde4fb28e6c` Source locator `/flight/sheet/data/31/scores/0` |  |  |  |
| 4 | [GPT-5.6 Sol](https://benchize.com/models/gpt-5-6-sol-max.md)Max | 35% |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `pass_at_5` \| 35.0 \| percent \| main_pass_at_5 \| Higher is better \| ### Configuration Reasoning effort max runs 5 subset main thinkingEnabled true tools ["python"] toolsEnabled true trials 5 ### Reported statistics runCount 5 ### Source Score publisher [Moonshot AI](https://www.kimi.ai/blog/kimi-k3) Collected via [moonshot k3](https://www.kimi.ai/blog/kimi-k3) Publisher reference Referenced by the collection source; the upstream result has not been independently captured. Benchmark [https://www.kimi.ai/blog/kimi-k3](https://www.kimi.ai/blog/kimi-k3) [Collected via](https://www.kimi.ai/blog/kimi-k3) Source Moonshot AI Original model label GPT 5.6 Sol (max) Source version sha256:0e806bbad76dc8e8dbc899a86051e3406bdd5995fe6c6aa1b2176dde4fb28e6c Observed 2026-10-21T16:31:44.130Z Evidence SHA-256 `0e806bbad76dc8e8dbc899a86051e3406bdd5995fe6c6aa1b2176dde4fb28e6c` Source locator `/flight/sheet/data/31/scores/2` |  |  |  |
| 5 | [Claude Opus 4.8](https://benchize.com/models/claude-opus-4-8-max.md)Max | 34% |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `pass_at_5` \| 34.0 \| percent \| main_pass_at_5 \| Higher is better \| ### Configuration Reasoning effort max runs 5 subset main thinkingEnabled true tools ["python"] toolsEnabled true trials 5 ### Reported statistics runCount 5 ### Source Score publisher [Moonshot AI](https://www.kimi.ai/blog/kimi-k3) Collected via [moonshot k3](https://www.kimi.ai/blog/kimi-k3) Publisher reference Referenced by the collection source; the upstream result has not been independently captured. Benchmark [https://www.kimi.ai/blog/kimi-k3](https://www.kimi.ai/blog/kimi-k3) [Collected via](https://www.kimi.ai/blog/kimi-k3) Source Moonshot AI Original model label Claude Opus 4.8 (max) Source version sha256:0e806bbad76dc8e8dbc899a86051e3406bdd5995fe6c6aa1b2176dde4fb28e6c Observed 2026-10-21T16:31:44.130Z Evidence SHA-256 `0e806bbad76dc8e8dbc899a86051e3406bdd5995fe6c6aa1b2176dde4fb28e6c` Source locator `/flight/sheet/data/31/scores/3` |  |  |  |

---
Cite as: ZeroBench main w/ python (pass@5) — Benchize, https://benchize.com/benchmarks/zero-bench-main-python (retrieved 2026-10-21)