# Inkling SmallExtra high > Source: Benchize (https://benchize.com) — https://benchize.com/models/inkling-small-xhigh. When citing or reusing this content, credit "Benchize" and link to https://benchize.com/models/inkling-small-xhigh. Thinking Machines Canonical URL: https://benchize.com/models/inkling-small-xhigh Last updated: Thu, 22 Oct 2026 06:20:09 GMT Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations. Thinking Machines ## Benchmarks | Benchmark | Score | ± | Rank | Cost | Source | | | --- | --- | --- | --- | --- | --- | --- | | [Mystery Game Puzzles](https://benchize.com/benchmarks/epoch-ai%3Amystery_game_puzzles.md) | 6% | SE ±2.39 pp | 70 / 72 | — | [epoch ai · Mystery Game Puzzles](https://epoch.ai/data/benchmark_data.zip#file=mystery_game_puzzles.csv) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.06 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.06 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion Mystery Game Puzzles reasoningBudget Not reported Reasoning effort xhigh sourceModelVersion inkling-small_xhigh ### Reported statistics Uncertainty Standard error: ±2.39 pp standardError 0.023868325657594204 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=mystery_game_puzzles.csv) Source epoch ai Original model label inkling-small Source version Mystery Game Puzzles Evaluated 2026-08-15T01:02:40.000Z Observed 2026-10-22T03:00:05.281Z Evidence SHA-256 `f66941ed5e9520190b66af57d2b6fd62a9582077dd25ab8764ce651bc0eca00a` Source locator `/rows/94` | | | | | | | | [SimpleQA Verified](https://benchize.com/benchmarks/epoch-ai%3Asimpleqa_verified.md) | 19.1% | SE ±1.24 pp | 37 / 40 | — | [epoch ai · SimpleQA Verified](https://epoch.ai/data/benchmark_data.zip#file=simpleqa_verified.csv) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.191 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.191 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion SimpleQA Verified reasoningBudget Not reported Reasoning effort xhigh sourceModelVersion inkling-small_xhigh ### Reported statistics Uncertainty Standard error: ±1.24 pp standardError 0.012436787112179482 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=simpleqa_verified.csv) Source epoch ai Original model label inkling-small Source version SimpleQA Verified Evaluated 2026-08-27T19:36:17.000Z Observed 2026-10-22T03:00:05.281Z Evidence SHA-256 `e2d3fae377f0ddd3d079bcc3971b9b9388a0a950289effe7b521177ea2e988cc` Source locator `/rows/31` | | | | | | | | [ARC-AGI-2](https://benchize.com/benchmarks/arc-prize%3Av2_Semi_Private.md) | 40.14% | — | 109 / 243 | 0.23usd per task | [arc prize · v2](https://arcprize.org/media/data/leaderboard/v2.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.40138888888888885 \| score_fraction \| v2_Semi_Private \| Higher is better \| \| `cost_per_task` \| 0.23255201249999993 \| usd_per_task \| v2_Semi_Private \| Lower is better \| ### Configuration evaluationSplit v2_Semi_Private harness Not reported modelGroup thinky-inkling-small modelType CoT Reasoning effort xhigh sourceModelVersion thinky-inkling-small-xhigh thinkingEnabled true ### Source [Original source](https://arcprize.org/media/data/leaderboard/v2.json) Source arc prize Original model label Inkling Small (XHigh) Source version v2 Observed 2026-10-22T05:20:04.306Z Evidence SHA-256 `4351eb696e78113b0459e9bb5f0258318b905efef34f473dcea51ce641b0d94d` Source locator `/evaluations/177` | | | | | | | | [FrontierMath Tiers 1–3 v2 (private)](https://benchize.com/benchmarks/epoch-ai%3Afrontiermath_tiers_1_3_v2.md) | 46.32% | SE ±2.96 pp | 30 / 50 | — | [epoch ai · FrontierMath-Tiers-1-3-v2-Private](https://epoch.ai/data/benchmark_data.zip#file=frontiermath_tiers_1_3_v2.csv) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.4631578947368421 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.4631578947368421 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion FrontierMath-Tiers-1-3-v2-Private reasoningBudget Not reported Reasoning effort xhigh sourceModelVersion inkling-small_xhigh ### Reported statistics Uncertainty Standard error: ±2.96 pp standardError 0.02958888847874604 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=frontiermath_tiers_1_3_v2.csv) Source epoch ai Original model label inkling-small Source version FrontierMath-Tiers-1-3-v2-Private Evaluated 2026-08-14T19:59:09.000Z Observed 2026-10-22T03:00:05.281Z Evidence SHA-256 `d3458d4272f99e04212525904a59fffffa7a94e827c62b26e36e3fd3e15fe587` Source locator `/rows/74` | | | | | | | | [OTIS Mock AIME 2024–2025](https://benchize.com/benchmarks/epoch-ai%3Aotis_mock_aime_2024_2025.md) | 90% | SE ±3.96 pp | 43 / 124 | — | [epoch ai · OTIS Mock AIME 2024-2025](https://epoch.ai/data/benchmark_data.zip#file=otis_mock_aime_2024_2025.csv) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.9 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.9 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion OTIS Mock AIME 2024-2025 reasoningBudget Not reported Reasoning effort xhigh sourceModelVersion inkling-small_xhigh ### Reported statistics Uncertainty Standard error: ±3.96 pp standardError 0.03964807305493795 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=otis_mock_aime_2024_2025.csv) Source epoch ai Original model label inkling-small Source version OTIS Mock AIME 2024-2025 Evaluated 2026-08-14T14:19:47.000Z Observed 2026-10-22T03:00:05.281Z Evidence SHA-256 `b7c9da8c0587c82f1e0d814ceb496c24308380b997a16203b6e5d39eb07f4f50` Source locator `/rows/69` | | | | | | | | [GPQA Diamond](https://benchize.com/benchmarks/gpqa-diamond.md) | 88.51% | SE ±1.91 pp | 36 / 126 | — | [epoch ai · GPQA diamond](https://epoch.ai/data/benchmark_data.zip#file=gpqa_diamond.csv) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.88510101010101 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.88510101010101 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion GPQA diamond reasoningBudget Not reported Reasoning effort xhigh sourceModelVersion inkling-small_xhigh ### Reported statistics Uncertainty Standard error: ±1.91 pp standardError 0.019100012831823398 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=gpqa_diamond.csv) Source epoch ai Original model label inkling-small Source version GPQA diamond Evaluated 2026-08-14T14:19:47.000Z Observed 2026-10-22T03:00:05.281Z Evidence SHA-256 `9ef0b938bdd8406b029d595983ee8ad3a80bd9d64b82605b91b5ce39ba650c39` Source locator `/rows/61` | | | | | | | | [ARC-AGI-1](https://benchize.com/benchmarks/arc-prize%3Av1_Semi_Private.md) | 84% | — | 106 / 245 | 0.11usd per task | [arc prize · v1](https://arcprize.org/media/data/leaderboard/v1.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.84 \| score_fraction \| v1_Semi_Private \| Higher is better \| \| `cost_per_task` \| 0.11498211 \| usd_per_task \| v1_Semi_Private \| Lower is better \| ### Configuration evaluationSplit v1_Semi_Private harness Not reported modelGroup thinky-inkling-small modelType CoT Reasoning effort xhigh sourceModelVersion thinky-inkling-small-xhigh thinkingEnabled true ### Source [Original source](https://arcprize.org/media/data/leaderboard/v1.json) Source arc prize Original model label Inkling Small (XHigh) Source version v1 Observed 2026-10-22T05:20:04.066Z Evidence SHA-256 `2bf68d22dafba37047d07ad833ebc0e8199c9aa2f9eeaed50c75c1b704462836` Source locator `/evaluations/176` | | | | | | | | [FrontierMath Tier 4 v2 (private)](https://benchize.com/benchmarks/epoch-ai%3Afrontiermath_tier_4_v2.md) | 17.07% | SE ±5.95 pp | 35 / 39 | — | [epoch ai · FrontierMath-Tier-4-v2-Private](https://epoch.ai/data/benchmark_data.zip#file=frontiermath_tier_4_v2.csv) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.17073170731707318 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.17073170731707318 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion FrontierMath-Tier-4-v2-Private reasoningBudget Not reported Reasoning effort xhigh sourceModelVersion inkling-small_xhigh ### Reported statistics Uncertainty Standard error: ±5.95 pp standardError 0.05949419959829495 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=frontiermath_tier_4_v2.csv) Source epoch ai Original model label inkling-small Source version FrontierMath-Tier-4-v2-Private Evaluated 2026-08-14T19:59:09.000Z Observed 2026-10-22T03:00:05.281Z Evidence SHA-256 `2bbef8e82ac84071e3ce42bf744f4fc39dff04a549ccb1a288e3800918bc2e55` Source locator `/rows/28` | | | | | | | --- Cite as: Inkling SmallExtra high — Benchize, https://benchize.com/models/inkling-small-xhigh (retrieved 2026-10-22)