# GPT-6 Astra

> Source: Benchize (https://benchize.com) — https://benchize.com/models/gpt-6-astra. When citing or reusing this content, credit "Benchize" and link to https://benchize.com/models/gpt-6-astra.

OpenAI

Canonical URL: https://benchize.com/models/gpt-6-astra
Last updated: Wed, 21 Oct 2026 18:05:10 GMT

Reproduction and quotation must name Benchize, link to the canonical HTML URL, and retain individual source citations.

OpenAI

## Benchmarks

| Benchmark | Score | ± | Rank | Cost | Source |  |
| --- | --- | --- | --- | --- | --- | --- |
| [Rapidata SVG generation — Alignment](https://benchize.com/benchmarks/rapidata%3Asvg%3Arlb_1MFkk9yZHssERh.md) | 1,360.7elo | CI 1,340.71–1,380.69 | 6 / 37 | — | [rapidata · v1](https://api.rapidata.ai/benchmark/bmk_1MFkc3sXfbKCqf/standings/query?leaderboard_id%5Beq%5D=rlb_1MFkk9yZHssERh) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 1360.6982472245038 \| elo \| rlb_1MFkk9yZHssERh \| Higher is better \| ### Configuration benchmarkId bmk_1MFkc3sXfbKCqf criterion rlb_1MFkk9yZHssERh participantId par_1UTasGEdHyT3rB sourceModelVersion gpt-6-astra weighted false ### Reported statistics Uncertainty Confidence interval: 1,340.71–1,380.69 confidenceIntervalLowerOffset 19.989123338743184 confidenceIntervalUpperOffset 19.98912333874341 totalMatches 7301 wins 4727 ### Source [Original source](https://api.rapidata.ai/benchmark/bmk_1MFkc3sXfbKCqf/standings/query?leaderboard_id%5Beq%5D=rlb_1MFkk9yZHssERh) Source rapidata Original model label gpt-6-astra Source version v1 Observed 2026-10-21T16:37:40.342Z Evidence SHA-256 `2f5c8d08728735790b500d930d71b66f04253f1209f7c1c3da0db0846c163fcf` Source locator `/items/8` |  |  |  |  |  |  |
| [Remote Labor Index (RLI)](https://benchize.com/benchmarks/scale%3Arli.md) | 20.83source score | CI 20.83–20.83 | 1 / 4 | — | [scale](https://labs.scale.com/leaderboard/rli) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 20.83 \| source_score \| reported \| Higher is better \| ### Configuration Reasoning effort unknown Model configuration GPT 6 Astra sourceModelVersion Not reported thinkingEnabled Not reported ### Reported statistics Uncertainty Confidence interval: 20.83–20.83 contaminationWarning Not reported rank 2 reportedConfidenceHalfWidth 0 ### Source [Original source](https://labs.scale.com/leaderboard/rli) Source scale Original model label GPT 6 Astra Observed 2026-10-21T16:35:35.546Z Evidence SHA-256 `d08c60517bef10b77b75d2b765ba3f22d2457693fb4bdf28a6e5d89e7e2b50a8` Source locator `/rows/1` |  |  |  |  |  |  |
| [Rapidata SVG generation — Overall preference](https://benchize.com/benchmarks/rapidata%3Asvg%3Aoverall.md) | 1,356.69elo | CI 1,345.29–1,368.1 | 4 / 37 | — | [rapidata · v1](https://api.rapidata.ai/benchmark/bmk_1MFkc3sXfbKCqf/standings/query) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 1356.6946805777643 \| elo \| overall \| Higher is better \| ### Configuration benchmarkId bmk_1MFkc3sXfbKCqf criterion overall participantId par_1UTasGEdHyT3rB sourceModelVersion gpt-6-astra weighted false ### Reported statistics Uncertainty Confidence interval: 1,345.29–1,368.1 confidenceIntervalLowerOffset 11.409004354258741 confidenceIntervalUpperOffset 11.409004354258514 totalMatches 21903.720440791414 wins 14239.139044925736 ### Source [Original source](https://api.rapidata.ai/benchmark/bmk_1MFkc3sXfbKCqf/standings/query) Source rapidata Original model label gpt-6-astra Source version v1 Observed 2026-10-21T16:37:39.078Z Evidence SHA-256 `4b73ff7e4ca0ecfd64f7888c2d64f3398a058c945c4644acd54eddb330e16d66` Source locator `/items/6` |  |  |  |  |  |  |
| [OpenVibeEval Accessibility](https://benchize.com/benchmarks/openvibeeval%3Aaccessibility.md) | 85 | — | 3 / 26 | — | [openvibeeval](https://openvibeeval.com/leaderboard/) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `adjusted_score` \| 85 \| score \| sample_size_adjusted_accessibility \| Higher is better \| ### Configuration Reasoning effort unknown Model configuration GPT-6 Astra thinkingEnabled Not reported ### Reported statistics runCount 8 ### Source [Original source](https://openvibeeval.com/leaderboard/) Source openvibeeval Original model label GPT-6 Astra Evaluated 2026-09-08 Observed 2026-10-21T16:32:04.885Z Evidence SHA-256 `9b2e7d6060910e3dc7083a6a7f67377601ce78806b2b6b7693cf8d047dd63fbb` Source locator `/rows/2` |  |  |  |  |  |  |
| [SimpleBench](https://benchize.com/benchmarks/simplebench%3Aavg-at-5.md) | 83.6% | — | 3 / 62 | — | [simplebench](https://simple-bench.com/static/js/leaderboard-data.js) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `accuracy` \| 83.6 \| percent \| average_at_5 \| Higher is better \| ### Configuration Reasoning effort unknown Model configuration GPT-6 Astra thinkingEnabled Not reported ### Reported statistics rank 4th ### Source [Original source](https://simple-bench.com/static/js/leaderboard-data.js) Source simplebench Original model label GPT-6 Astra Observed 2026-10-21T16:32:13.183Z Evidence SHA-256 `b2d0285ad3e4e15750ed20d39897e7558d1c05e8962e90c861b06f93c8019dc9` Source locator `/rows/5` |  |  |  |  |  |  |
| [Humanity's Last Exam (Text Only)](https://benchize.com/benchmarks/scale%3Ahumanitys_last_exam_text_only.md) | 54.17source score | CI 52.08–56.26 | 1 / 25 | — | [scale](https://labs.scale.com/leaderboard/humanitys_last_exam_text_only) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 54.17 \| source_score \| reported \| Higher is better \| ### Configuration Reasoning effort unknown Model configuration GPT 6 Astra sourceModelVersion Not reported thinkingEnabled Not reported ### Reported statistics Uncertainty Confidence interval: 52.08–56.26 contaminationWarning Potential contamination warning: This model was evaluated after the public release of HLE, allowing model builder access to the prompts and solutions. rank 1 reportedConfidenceHalfWidth 2.09 ### Source [Original source](https://labs.scale.com/leaderboard/humanitys_last_exam_text_only) Source scale Original model label GPT 6 Astra Observed 2026-10-21T16:35:33.193Z Evidence SHA-256 `4004825ae58bdcc249c0d26dab811842c6d172b2a67bc35e69949fbf12ead757` Source locator `/rows/0` |  |  |  |  |  |  |
| [Rapidata Text-to-3D with LLM code — Alignment](https://benchize.com/benchmarks/rapidata%3Atext-to-3d-code%3Arlb_1YVpXug2nDeUlV.md) | 1,601.59elo | CI 1,574.75–1,628.44 | 1 / 9 | — | [rapidata](https://api.rapidata.ai/benchmark/bmk_1YVpXgN69Mv8I9/standings/query?leaderboard_id%5Beq%5D=rlb_1YVpXug2nDeUlV) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 1601.5911749599952 \| elo \| rlb_1YVpXug2nDeUlV \| Higher is better \| ### Configuration benchmarkId bmk_1YVpXgN69Mv8I9 criterion rlb_1YVpXug2nDeUlV participantId par_1YVpXvemRZ4Nlp sourceModelVersion gpt-6-astra weighted false ### Reported statistics Uncertainty Confidence interval: 1,574.75–1,628.44 confidenceIntervalLowerOffset 26.84419869707085 confidenceIntervalUpperOffset 26.84419869707085 totalMatches 5395 wins 4305.5 ### Source [Original source](https://api.rapidata.ai/benchmark/bmk_1YVpXgN69Mv8I9/standings/query?leaderboard_id%5Beq%5D=rlb_1YVpXug2nDeUlV) Source rapidata Original model label gpt-6-astra Source version Observed 2026-10-21T16:37:42.991Z Evidence SHA-256 `a2223beea99910879fd4c5ded70604d3d62dcff1f04a3b617d13f28f03a75948` Source locator `/items/0` |  |  |  |  |  |  |
| [FrontierSWE v2 abs](https://benchize.com/benchmarks/frontierswe%3Av2%3Aabs.md) | 65.51source score | — | 1 / 15 | — | [frontierswe](https://www.frontierswe.com/) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `overall` \| 65.50757455882352 \| source_score \| mean \| Higher is better \| \| `overall_best` \| 73.00460588235295 \| source_score \| best \| Higher is better \| \| `overall_worst` \| 55.11057647058822 \| source_score \| worst \| Higher is better \| \| `implementation` \| 86.94589999999998 \| source_score \| mean \| Higher is better \| \| `performance` \| 48.312129166666665 \| source_score \| mean \| Higher is better \| \| `research` \| 59.11228285714285 \| source_score \| mean \| Higher is better \| ### Configuration aggregation mean harness proximus normalization abs Reasoning effort unknown ### Source [Original source](https://www.frontierswe.com/) Source frontierswe Original model label GPT-6 Astra Observed 2026-10-21T16:31:27.602Z Evidence SHA-256 `818e027068cf61ff1aadd8281b6e49e9c6795221015210601b5e34d0d223e5b5` Source locator `/rows/0` |  |  |  |  |  |  |
| [PRBench Legal](https://benchize.com/benchmarks/scale%3Aprbench-legal.md) | 48.36source score | CI 46.72–50 | 13 / 26 | — | [scale](https://labs.scale.com/leaderboard/prbench-legal) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 48.36 \| source_score \| reported \| Higher is better \| ### Configuration Reasoning effort unknown Model configuration GPT 6 Astra sourceModelVersion Not reported thinkingEnabled Not reported ### Reported statistics Uncertainty Confidence interval: 46.72–50 contaminationWarning Not reported rank 17 reportedConfidenceHalfWidth 1.64 ### Source [Original source](https://labs.scale.com/leaderboard/prbench-legal) Source scale Original model label GPT 6 Astra Observed 2026-10-21T16:35:35.197Z Evidence SHA-256 `9e2ca4e9350870cf508bf5fff603d0b795c81f7974a0ab980312bbbfa0785067` Source locator `/rows/16` |  |  |  |  |  |  |
| [Humanity’s Last Exam (HLE)](https://benchize.com/benchmarks/hle.md) | 54.8source score | CI 52.86–56.74 | 1 / 17 | — | [scale](https://labs.scale.com/leaderboard/humanitys_last_exam) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 54.8 \| source_score \| reported \| Higher is better \| ### Configuration Reasoning effort unknown Model configuration GPT 6 Astra sourceModelVersion Not reported thinkingEnabled Not reported ### Reported statistics Uncertainty Confidence interval: 52.86–56.74 contaminationWarning Potential contamination warning: This model was evaluated after the public release of HLE, allowing model builder access to the prompts and solutions. rank 1 reportedConfidenceHalfWidth 1.94 ### Source [Original source](https://labs.scale.com/leaderboard/humanitys_last_exam) Source scale Original model label GPT 6 Astra Observed 2026-10-21T16:35:32.694Z Evidence SHA-256 `9970bf9ee4f6b6b167633a94634adae7ac9c906447d6db087a8dc9877c1b71e0` Source locator `/rows/0` |  |  |  |  |  |  |
| [Longform Creative Writing](https://benchize.com/benchmarks/eq-bench%3Alongform-writing.md) | 82.8% | — | 6 / 93 | — | [eq bench · longform-writing](https://eqbench.com/creative_writing_longform.js) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `overall_score_100` \| 82.8 \| percent \| overall \| Higher is better \| \| `chapter1_avg` \| 17.07 \| rubric_score \| overall \| Higher is better \| \| `chapter2_avg` \| 16.70 \| rubric_score \| overall \| Higher is better \| \| `chapter3_avg` \| 16.66 \| rubric_score \| overall \| Higher is better \| \| `chapter4_avg` \| 16.65 \| rubric_score \| overall \| Higher is better \| \| `chapter5_avg` \| 16.69 \| rubric_score \| overall \| Higher is better \| \| `chapter6_avg` \| 16.37 \| rubric_score \| overall \| Higher is better \| \| `chapter7_avg` \| 15.95 \| rubric_score \| overall \| Higher is better \| \| `chapter8_avg` \| 16.72 \| rubric_score \| overall \| Higher is better \| \| `final_judgement_avg` \| 16.54 \| rubric_score \| overall \| Higher is better \| ### Configuration interactiveAdjustments none protocol longform-writing sourceModelVersion gpt-6-astra ### Source [Original source](https://eqbench.com/creative_writing_longform.js) Source eq bench Original model label gpt-6-astra Source version longform-writing Observed 2026-10-21T16:35:02.575Z Evidence SHA-256 `3ba283ce357ac7620e16db640a961879c30fe3ddc50a27de9a8ed4290784825c` Source locator `/leaderboardDataLongformV3/130` |  |  |  |  |  |  |
| [Vending-Bench 2](https://benchize.com/benchmarks/vendingbench%3Av2.md) | — | — | — | $15,514.7 | [vendingbench](https://andonlabs.com/_app/immutable/chunks/Cjn0_qj9.js) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `final_balance` \| 15514.701666666668 \| USD \| one_simulated_year \| Higher is better \| \| `geometric_mean_balance` \| 15345.095599163022 \| USD \| positive_final_balances \| Higher is better \| ### Configuration Reasoning effort unknown Model configuration GPT-6 Astra thinkingEnabled Not reported ### Reported statistics confidenceHalfWidth95 2105.9892811457103 positiveBalanceRuns 6 runCount 6 standardDeviation 2631.938338049865 standardError 1074.4843271151583 ### Source [Original source](https://andonlabs.com/_app/immutable/chunks/Cjn0_qj9.js) Source vendingbench Original model label GPT-6 Astra Observed 2026-10-21T16:36:40.592Z Evidence SHA-256 `1a0b043147050298c405bcb743d73e425d532464202231cd18c27f836fa5f223` Source locator `/rows/35` |  |  |  |  |  |  |
| [Rapidata Text-to-3D with LLM code — Creativity](https://benchize.com/benchmarks/rapidata%3Atext-to-3d-code%3Arlb_1YVqTDVUylKrUp.md) | 1,380.48elo | CI 1,355.1–1,405.87 | 2 / 9 | — | [rapidata](https://api.rapidata.ai/benchmark/bmk_1YVpXgN69Mv8I9/standings/query?leaderboard_id%5Beq%5D=rlb_1YVqTDVUylKrUp) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 1380.4832545526676 \| elo \| rlb_1YVqTDVUylKrUp \| Higher is better \| ### Configuration benchmarkId bmk_1YVpXgN69Mv8I9 criterion rlb_1YVqTDVUylKrUp participantId par_1YVpXvemRZ4Nlp sourceModelVersion gpt-6-astra weighted false ### Reported statistics Uncertainty Confidence interval: 1,355.1–1,405.87 confidenceIntervalLowerOffset 25.384161943711433 confidenceIntervalUpperOffset 25.384161943711433 totalMatches 4837 wins 3397 ### Source [Original source](https://api.rapidata.ai/benchmark/bmk_1YVpXgN69Mv8I9/standings/query?leaderboard_id%5Beq%5D=rlb_1YVqTDVUylKrUp) Source rapidata Original model label gpt-6-astra Source version Observed 2026-10-21T16:37:42.177Z Evidence SHA-256 `4ce251bc655221de3fef117b85e05f775323a39098049de2bbfd4835ca2c6293` Source locator `/items/1` |  |  |  |  |  |  |
| [DistressBench](https://benchize.com/benchmarks/scale%3Adistressbench.md) | 74.31source score | CI 73.21–75.41 | 9 / 27 | — | [scale](https://labs.scale.com/leaderboard/distressbench) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 74.31 \| source_score \| reported \| Higher is better \| ### Configuration Reasoning effort unknown Model configuration gpt-6-astra sourceModelVersion gpt-6-astra thinkingEnabled Not reported ### Reported statistics Uncertainty Confidence interval: 73.21–75.41 contaminationWarning Not reported rank 11 reportedConfidenceHalfWidth 1.1 ### Source [Original source](https://labs.scale.com/leaderboard/distressbench) Source scale Original model label gpt-6-astra Observed 2026-10-21T16:35:27.403Z Evidence SHA-256 `6ca6a76569e51fde037c8e2610bdf7bc39d99b54c69b6b4dc0dba9ec2a4e24da` Source locator `/rows/10` |  |  |  |  |  |  |
| [Rapidata Text-to-3D with LLM code — Overall preference](https://benchize.com/benchmarks/rapidata%3Atext-to-3d-code%3Aoverall.md) | 1,563.27elo | CI 1,550.03–1,576.51 | 2 / 9 | — | [rapidata](https://api.rapidata.ai/benchmark/bmk_1YVpXgN69Mv8I9/standings/query) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 1563.273396479865 \| elo \| overall \| Higher is better \| ### Configuration benchmarkId bmk_1YVpXgN69Mv8I9 criterion overall participantId par_1YVpXvemRZ4Nlp sourceModelVersion gpt-6-astra weighted false ### Reported statistics Uncertainty Confidence interval: 1,550.03–1,576.51 confidenceIntervalLowerOffset 13.239461901409186 confidenceIntervalUpperOffset 13.239461901409186 totalMatches 21022.199013629226 wins 16502.345586566662 ### Source [Original source](https://api.rapidata.ai/benchmark/bmk_1YVpXgN69Mv8I9/standings/query) Source rapidata Original model label gpt-6-astra Source version Observed 2026-10-21T16:37:41.757Z Evidence SHA-256 `048d6dec5a711f63fb70b09a6495cf440b0bf6f34f80156b97832c611e7a2913` Source locator `/items/1` |  |  |  |  |  |  |
| [PRBench Finance](https://benchize.com/benchmarks/scale%3Aprbench-finance.md) | 47.54source score | CI 45.85–49.23 | 12 / 22 | — | [scale](https://labs.scale.com/leaderboard/prbench-finance) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 47.54 \| source_score \| reported \| Higher is better \| ### Configuration Reasoning effort unknown Model configuration GPT 6 Astra sourceModelVersion Not reported thinkingEnabled Not reported ### Reported statistics Uncertainty Confidence interval: 45.85–49.23 contaminationWarning Not reported rank 16 reportedConfidenceHalfWidth 1.69 ### Source [Original source](https://labs.scale.com/leaderboard/prbench-finance) Source scale Original model label GPT 6 Astra Observed 2026-10-21T16:35:34.798Z Evidence SHA-256 `948d67409f0ae9c93fd41428f634cfc93c7815a21f43690cecb9095c9d3ec8f1` Source locator `/rows/15` |  |  |  |  |  |  |
| [Rapidata Text-to-3D with LLM code — Preference](https://benchize.com/benchmarks/rapidata%3Atext-to-3d-code%3Arlb_1YVpXugYHlm63x.md) | 1,690.55elo | CI 1,662.29–1,718.82 | 2 / 9 | — | [rapidata](https://api.rapidata.ai/benchmark/bmk_1YVpXgN69Mv8I9/standings/query?leaderboard_id%5Beq%5D=rlb_1YVpXugYHlm63x) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 1690.5526812771686 \| elo \| rlb_1YVpXugYHlm63x \| Higher is better \| ### Configuration benchmarkId bmk_1YVpXgN69Mv8I9 criterion rlb_1YVpXugYHlm63x participantId par_1YVpXvemRZ4Nlp sourceModelVersion gpt-6-astra weighted false ### Reported statistics Uncertainty Confidence interval: 1,662.29–1,718.82 confidenceIntervalLowerOffset 28.26515151674994 confidenceIntervalUpperOffset 28.26515151674994 totalMatches 5395 wins 4412 ### Source [Original source](https://api.rapidata.ai/benchmark/bmk_1YVpXgN69Mv8I9/standings/query?leaderboard_id%5Beq%5D=rlb_1YVpXugYHlm63x) Source rapidata Original model label gpt-6-astra Source version Observed 2026-10-21T16:37:43.410Z Evidence SHA-256 `a30cb5e42eb353cd3fadbb4c6519873ad22d3f0528a4e569fbbe40160928d934` Source locator `/items/1` |  |  |  |  |  |  |
| [Creative Writing v3](https://benchize.com/benchmarks/eq-bench%3Acreative-writing-v3.md) | 2,173.3elo | — | 1 / 90 | — | [eq bench · creative-writing-v3](https://eqbench.com/creative_writing.js) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo_score` \| 2173.3 \| elo \| overall \| Higher is better \| \| `creative_writing_score` \| 16.80 \| rubric_score \| overall \| Higher is better \| ### Configuration interactiveAdjustments none protocol creative-writing-v3 sourceModelVersion gpt-6-astra ### Source [Original source](https://eqbench.com/creative_writing.js) Source eq bench Original model label gpt-6-astra Source version creative-writing-v3 Observed 2026-10-21T16:35:01.421Z Evidence SHA-256 `722ddb132e8d3a5e5c39b8d445f8475f3f7e24893a007260c6f3e3cce5c1ee18` Source locator `/leaderboardDataCreativeWritingV3/0` |  |  |  |  |  |  |
| [HiL-Bench (Human-in-Loop Benchmark)](https://benchize.com/benchmarks/scale%3Ahil.md) | 65.32source score | CI 60.13–70.51 | 1 / 22 | — | [scale](https://labs.scale.com/leaderboard/hil) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 65.32 \| source_score \| reported \| Higher is better \| ### Configuration Reasoning effort unknown Model configuration GPT 6 Astra sourceModelVersion Not reported thinkingEnabled Not reported ### Reported statistics Uncertainty Confidence interval: 60.13–70.51 contaminationWarning Not reported rank 3 reportedConfidenceHalfWidth 5.19 ### Source [Original source](https://labs.scale.com/leaderboard/hil) Source scale Original model label GPT 6 Astra Observed 2026-10-21T16:35:30.082Z Evidence SHA-256 `043a333e27453edada150667c7f4439b2aab463f37928c2153c6aa79f33dd1b2` Source locator `/rows/2` |  |  |  |  |  |  |
| [Rapidata SVG generation — Coherence](https://benchize.com/benchmarks/rapidata%3Asvg%3Arlb_1MFkkBzpuU8fTG.md) | 1,374.31elo | CI 1,354.59–1,394.03 | 1 / 37 | — | [rapidata · v1](https://api.rapidata.ai/benchmark/bmk_1MFkc3sXfbKCqf/standings/query?leaderboard_id%5Beq%5D=rlb_1MFkkBzpuU8fTG) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 1374.3127829226553 \| elo \| rlb_1MFkkBzpuU8fTG \| Higher is better \| ### Configuration benchmarkId bmk_1MFkc3sXfbKCqf criterion rlb_1MFkkBzpuU8fTG participantId par_1UTasGEdHyT3rB sourceModelVersion gpt-6-astra weighted false ### Reported statistics Uncertainty Confidence interval: 1,354.59–1,394.03 confidenceIntervalLowerOffset 19.72016797553306 confidenceIntervalUpperOffset 19.72016797553306 totalMatches 7301 wins 4810 ### Source [Original source](https://api.rapidata.ai/benchmark/bmk_1MFkc3sXfbKCqf/standings/query?leaderboard_id%5Beq%5D=rlb_1MFkkBzpuU8fTG) Source rapidata Original model label gpt-6-astra Source version v1 Observed 2026-10-21T16:37:39.715Z Evidence SHA-256 `aa3cb94ff16f544c58adeea35b9087d281c785058b8ce1ae0f98a7ff84920930` Source locator `/items/2` |  |  |  |  |  |  |
| [TubeLab Scriptwriting](https://benchize.com/benchmarks/tubelab%3Ascriptwriting.md) | 56.7% | — | 16 / 16 | 1.78ratio | [tubelab](https://tubelab.net/_next/static/chunks/pages/benchmark/scriptwriting-7ad7196ff3093ad4.js) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `quality` \| 56.7 \| percent \| source_reported \| Higher is better \| \| `craft` \| 56.7 \| percent \| source_reported \| Higher is better \| \| `relative_cost_per_script` \| 1.78 \| ratio \| source_reported \| Lower is better \| \| `script_time` \| 2.8 \| minutes \| source_reported \| Lower is better \| \| `hook` \| 5.7 \| score_out_of_10 \| craft_rubric \| Higher is better \| \| `retention` \| 5.7 \| score_out_of_10 \| craft_rubric \| Higher is better \| \| `storytelling` \| 4.8 \| score_out_of_10 \| craft_rubric \| Higher is better \| \| `voiceMatch` \| 5 \| score_out_of_10 \| craft_rubric \| Higher is better \| \| `pacing` \| 5.1 \| score_out_of_10 \| craft_rubric \| Higher is better \| \| `clarity` \| 7.8 \| score_out_of_10 \| craft_rubric \| Higher is better \| ### Configuration judgingProtocol blind_model_judges Reasoning effort unknown taskCount 12 ### Reported statistics confidence {"high":64.7,"low":49} headToHead {"losses":12,"ties":0,"winPercent":0,"wins":0} rank 22 ### Source [Original source](https://tubelab.net/_next/static/chunks/pages/benchmark/scriptwriting-7ad7196ff3093ad4.js) Source tubelab Original model label GPT-6 Astra Observed 2026-10-21T16:34:03.856Z Evidence SHA-256 `72f9d867f388256af8fc6dca12e8c7b6f1ddcbb97f0712da339b73102686761f` Source locator `/rows/21` |  |  |  |  |  |  |
| [Humanity's Last Exam (Diamond)](https://benchize.com/benchmarks/scale%3Ahle-diamond.md) | 60.6source score | CI 57.6–63.6 | 1 / 12 | — | [scale](https://labs.scale.com/leaderboard/hle-diamond) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `score` \| 60.6 \| source_score \| reported \| Higher is better \| ### Configuration Reasoning effort unknown Model configuration gpt-6-astra sourceModelVersion Not reported thinkingEnabled Not reported ### Reported statistics Uncertainty Confidence interval: 57.6–63.6 contaminationWarning Potential contamination warning: This model was evaluated after the public release of HLE, allowing model builder access to the prompts and solutions. rank 1 reportedConfidenceHalfWidth 3 ### Source [Original source](https://labs.scale.com/leaderboard/hle-diamond) Source scale Original model label gpt-6-astra Observed 2026-10-21T16:35:27.820Z Evidence SHA-256 `c60d42f5aacdf787d9ccc8b70817766d86707776a7f8b44ef0337cb9ae60bf20` Source locator `/rows/0` |  |  |  |  |  |  |
| [Rapidata Text-to-3D with LLM code — Coherence](https://benchize.com/benchmarks/rapidata%3Atext-to-3d-code%3Arlb_1YVpXufudyOLlc.md) | 1,619.89elo | CI 1,592.55–1,647.24 | 1 / 9 | — | [rapidata](https://api.rapidata.ai/benchmark/bmk_1YVpXgN69Mv8I9/standings/query?leaderboard_id%5Beq%5D=rlb_1YVpXufudyOLlc) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 1619.891659474101 \| elo \| rlb_1YVpXufudyOLlc \| Higher is better \| ### Configuration benchmarkId bmk_1YVpXgN69Mv8I9 criterion rlb_1YVpXufudyOLlc participantId par_1YVpXvemRZ4Nlp sourceModelVersion gpt-6-astra weighted false ### Reported statistics Uncertainty Confidence interval: 1,592.55–1,647.24 confidenceIntervalLowerOffset 27.346539418484326 confidenceIntervalUpperOffset 27.346539418484326 totalMatches 5395 wins 4387.5 ### Source [Original source](https://api.rapidata.ai/benchmark/bmk_1YVpXgN69Mv8I9/standings/query?leaderboard_id%5Beq%5D=rlb_1YVpXufudyOLlc) Source rapidata Original model label gpt-6-astra Source version Observed 2026-10-21T16:37:42.585Z Evidence SHA-256 `59243752590bb5f22389edbe87b8cc11b00e9a6fc49b5b94753544fc8780e58d` Source locator `/items/0` |  |  |  |  |  |  |
| [Rapidata SVG generation — Preference](https://benchize.com/benchmarks/rapidata%3Asvg%3Arlb_1MFkkEMFnCNyKl.md) | 1,356.24elo | CI 1,336.26–1,376.22 | 7 / 37 | — | [rapidata · v1](https://api.rapidata.ai/benchmark/bmk_1MFkc3sXfbKCqf/standings/query?leaderboard_id%5Beq%5D=rlb_1MFkkEMFnCNyKl) |  |
| ### Original source values \| Metric \| Value \| Unit \| Scope \| Direction \| \| --- \| --- \| --- \| --- \| --- \| \| `elo` \| 1356.236073065835 \| elo \| rlb_1MFkkEMFnCNyKl \| Higher is better \| ### Configuration benchmarkId bmk_1MFkc3sXfbKCqf criterion rlb_1MFkkEMFnCNyKl participantId par_1UTasGEdHyT3rB sourceModelVersion gpt-6-astra weighted false ### Reported statistics Uncertainty Confidence interval: 1,336.26–1,376.22 confidenceIntervalLowerOffset 19.979692916684144 confidenceIntervalUpperOffset 19.979692916683916 totalMatches 7301 wins 4702 ### Source [Original source](https://api.rapidata.ai/benchmark/bmk_1MFkc3sXfbKCqf/standings/query?leaderboard_id%5Beq%5D=rlb_1MFkkEMFnCNyKl) Source rapidata Original model label gpt-6-astra Source version v1 Observed 2026-10-21T16:37:40.980Z Evidence SHA-256 `b70f07a4924c82499996aba613ca8ec2d0aee9ec9ebd404e45c8bf250206cf40` Source locator `/items/10` |  |  |  |  |  |  |

---
Cite as: GPT-6 Astra — Benchize, https://benchize.com/models/gpt-6-astra (retrieved 2026-10-21)
