# InklingExtra high > Source: Benchize (https://benchize.com) — https://benchize.com/models/inkling-xhigh. When citing or reusing this content, credit "Benchize" and link to https://benchize.com/models/inkling-xhigh. Thinking Machines Canonical URL: https://benchize.com/models/inkling-xhigh Last updated: Thu, 22 Oct 2026 04:30:12 GMT Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations. Thinking Machines ## Benchmarks | Benchmark | Score | ± | Rank | Source | | | --- | --- | --- | --- | --- | --- | | [OTIS Mock AIME 2024–2025](https://benchize.com/benchmarks/epoch-ai%3Aotis_mock_aime_2024_2025.md) | 88.89% | SE ±3.92 pp | 44 / 124 | [epoch ai · OTIS Mock AIME 2024-2025](https://epoch.ai/data/benchmark_data.zip#file=otis_mock_aime_2024_2025.csv) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.8888888888888888 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.8888888888888888 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion OTIS Mock AIME 2024-2025 reasoningBudget Not reported Reasoning effort xhigh sourceModelVersion Inkling_xhigh ### Reported statistics Uncertainty Standard error: ±3.92 pp standardError 0.039171949640122654 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=otis_mock_aime_2024_2025.csv) Source epoch ai Original model label Inkling Source version OTIS Mock AIME 2024-2025 Evaluated 2026-08-05T18:55:39.000Z Observed 2026-10-22T03:00:05.281Z Evidence SHA-256 `b7c9da8c0587c82f1e0d814ceb496c24308380b997a16203b6e5d39eb07f4f50` Source locator `/rows/139` | | | | | | | [GPQA Diamond](https://benchize.com/benchmarks/gpqa-diamond.md) | 88.26% | SE ±1.94 pp | 38 / 126 | [epoch ai · GPQA diamond](https://epoch.ai/data/benchmark_data.zip#file=gpqa_diamond.csv) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.8825757575757576 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.8825757575757576 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion GPQA diamond reasoningBudget Not reported Reasoning effort xhigh sourceModelVersion Inkling_xhigh ### Reported statistics Uncertainty Standard error: ±1.94 pp standardError 0.019355903133033585 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=gpqa_diamond.csv) Source epoch ai Original model label Inkling Source version GPQA diamond Evaluated 2026-08-05T18:55:39.000Z Observed 2026-10-22T03:00:05.281Z Evidence SHA-256 `9ef0b938bdd8406b029d595983ee8ad3a80bd9d64b82605b91b5ce39ba650c39` Source locator `/rows/132` | | | | | | | [FrontierMath Tier 4 v2 (private)](https://benchize.com/benchmarks/epoch-ai%3Afrontiermath_tier_4_v2.md) | 4.88% | SE ±3.41 pp | 37 / 39 | [epoch ai · FrontierMath-Tier-4-v2-Private](https://epoch.ai/data/benchmark_data.zip#file=frontiermath_tier_4_v2.csv) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.04878048780487805 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.04878048780487805 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion FrontierMath-Tier-4-v2-Private reasoningBudget Not reported Reasoning effort xhigh sourceModelVersion Inkling_xhigh ### Reported statistics Uncertainty Standard error: ±3.41 pp standardError 0.03405912205797303 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=frontiermath_tier_4_v2.csv) Source epoch ai Original model label Inkling Source version FrontierMath-Tier-4-v2-Private Evaluated 2026-08-06T20:14:32.000Z Observed 2026-10-22T03:00:05.281Z Evidence SHA-256 `2bbef8e82ac84071e3ce42bf744f4fc39dff04a549ccb1a288e3800918bc2e55` Source locator `/rows/30` | | | | | | | [WeirdML v3](https://benchize.com/benchmarks/weirdml%3Av3.md) | 0.04source score | Range 0.02–0.05 | 25 / 25 | [weirdml · b0120fe](https://htihle.github.io/assets/data/weirdml_v3.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.03749979545454545 \| source_score \| reported \| Higher is better \| \| `mean_final_best` \| 0.04127497727272727 \| source_score \| reported \| Higher is better \| ### Configuration budget {"kind":"equivalent_tokens","limit":50000000,"start":500000} harness opencode Reasoning effort xhigh sourceConfiguration inkling-deepinfra-xhigh-opencode ### Reported statistics Uncertainty Reported interval: 0.02–0.05 interval [0.01985640078234439,0.05499253978619413] intervalMethod {"assumptions":"Independent fresh runs; approximately normal scores; shared variance prior. Pool fitted within analysis mode, including incomplete models; pool estimation uncertainty is not propagated.","confidence":0.95,"draws":10000,"fixed_tasks":true,"method":"partially_pooled_variance","pool":{"degrees_of_freedom":1533,"fallback":false,"prior_df":4,"variance":0.0026383113392869583},"seed":20260915,"unit":"run"} runCount 30 taskCount 11 ### Source [Original source](https://htihle.github.io/assets/data/weirdml_v3.json) Source weirdml Original model label Inkling (xhigh, DeepInfra) Source version b0120fe Observed 2026-10-21T16:33:04.394Z Evidence SHA-256 `82c3a8de423b23ca0af9761429299a2f21edb0b819e947fdc863f8b5ea4a49b8` Source locator `/rows/25` | | | | | | | [SimpleQA Verified](https://benchize.com/benchmarks/epoch-ai%3Asimpleqa_verified.md) | 40.3% | SE ±1.55 pp | 29 / 40 | [epoch ai · SimpleQA Verified](https://epoch.ai/data/benchmark_data.zip#file=simpleqa_verified.csv) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.403 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.403 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion SimpleQA Verified reasoningBudget Not reported Reasoning effort xhigh sourceModelVersion Inkling_xhigh ### Reported statistics Uncertainty Standard error: ±1.55 pp standardError 0.015518757419066513 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=simpleqa_verified.csv) Source epoch ai Original model label Inkling Source version SimpleQA Verified Evaluated 2026-08-27T19:36:45.000Z Observed 2026-10-22T03:00:05.281Z Evidence SHA-256 `e2d3fae377f0ddd3d079bcc3971b9b9388a0a950289effe7b521177ea2e988cc` Source locator `/rows/28` | | | | | | | [WeirdML v3](https://benchize.com/benchmarks/weirdml%3Av3.md) | 0.04source score | Range 0.03–0.05 | 24 / 25 | [weirdml · b0120fe](https://htihle.github.io/assets/data/weirdml_v3.json) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.03902983636363636 \| source_score \| reported \| Higher is better \| \| `mean_final_best` \| 0.04378938181818182 \| source_score \| reported \| Higher is better \| ### Configuration budget {"kind":"equivalent_tokens","limit":50000000,"start":500000} harness opencode Reasoning effort xhigh sourceConfiguration inkling-together-xhigh-opencode ### Reported statistics Uncertainty Reported interval: 0.03–0.05 interval [0.029404779908751285,0.048350442661368856] intervalMethod {"assumptions":"Independent fresh runs; approximately normal scores; shared variance prior. Pool fitted within analysis mode, including incomplete models; pool estimation uncertainty is not propagated.","confidence":0.95,"draws":10000,"fixed_tasks":true,"method":"partially_pooled_variance","pool":{"degrees_of_freedom":1533,"fallback":false,"prior_df":4,"variance":0.0026383113392869583},"seed":20260915,"unit":"run"} runCount 75 taskCount 11 ### Source [Original source](https://htihle.github.io/assets/data/weirdml_v3.json) Source weirdml Original model label Inkling (xhigh, Together) Source version b0120fe Observed 2026-10-21T16:33:04.394Z Evidence SHA-256 `82c3a8de423b23ca0af9761429299a2f21edb0b819e947fdc863f8b5ea4a49b8` Source locator `/rows/24` | | | | | | | [FrontierMath Tiers 1–3 v2 (private)](https://benchize.com/benchmarks/epoch-ai%3Afrontiermath_tiers_1_3_v2.md) | 33.33% | SE ±2.8 pp | 35 / 50 | [epoch ai · FrontierMath-Tiers-1-3-v2-Private](https://epoch.ai/data/benchmark_data.zip#file=frontiermath_tiers_1_3_v2.csv) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.3333333333333333 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.3333333333333333 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion FrontierMath-Tiers-1-3-v2-Private reasoningBudget Not reported Reasoning effort xhigh sourceModelVersion Inkling_xhigh ### Reported statistics Uncertainty Standard error: ±2.8 pp standardError 0.02797271194322297 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=frontiermath_tiers_1_3_v2.csv) Source epoch ai Original model label Inkling Source version FrontierMath-Tiers-1-3-v2-Private Evaluated 2026-08-06T20:14:32.000Z Observed 2026-10-22T03:00:05.281Z Evidence SHA-256 `d3458d4272f99e04212525904a59fffffa7a94e827c62b26e36e3fd3e15fe587` Source locator `/rows/76` | | | | | | | [Chess Puzzles](https://benchize.com/benchmarks/epoch-ai%3Achess_puzzles.md) | 21% | SE ±4.09 pp | 47 / 64 | [epoch ai · Chess Puzzles](https://epoch.ai/data/benchmark_data.zip#file=chess_puzzles.csv) | | | ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 0.21 \| score_fraction \| Best score (across scorers) \| Higher is better \| \| `mean_score` \| 0.21 \| score_fraction \| mean_score \| Higher is better \| ### Configuration benchmarkVersion Chess Puzzles reasoningBudget Not reported Reasoning effort xhigh sourceModelVersion Inkling_xhigh ### Reported statistics Uncertainty Standard error: ±4.09 pp standardError 0.040936018074033236 ### Source [Original source](https://epoch.ai/data/benchmark_data.zip#file=chess_puzzles.csv) Source epoch ai Original model label Inkling Source version Chess Puzzles Evaluated 2026-10-13T12:49:23.000Z Observed 2026-10-22T03:00:05.281Z Evidence SHA-256 `a5b99d6d35252907b04e9a802873a9754ecc0248be92a1ebbd2ef0450e4bb015` Source locator `/rows/146` | | | | | | --- Cite as: InklingExtra high — Benchize, https://benchize.com/models/inkling-xhigh (retrieved 2026-10-22)