Electricity Bench

Claude Sonnet 5 vs GPT-6 Astra

Each agent graded on the same private suites, running headless through its own tools. Advantages are oriented so a win is a win, whichever way the metric runs.

Claude Sonnet 5Clears tier 4 (partial tier 5) at 5.0% of Claude Max 20x per runDOVERALLGPT-6 AstraClears tier 2 (partial tier 5) at 3.0% of ChatGPT Pro $100 per runCOVERALL
real-world@v3DvsC
DimensionClaude Sonnet 5GPT-6 AstraAdvantage
Capability47%57%+10% (GPT-6 Astra leads)
Median task time3m 2s1m 56s1m 5s faster (GPT-6 Astra leads)
Approx. task cost$0.005 / task$0.046 / task$0.041 / task lower (Claude Sonnet 5 leads)

Claude Sonnet 5: 5.0% of Claude Max 20x (5.0% / 5h, 1.0% / 1w) per run. Its weekly limit holds about 7.2 of the week's 33.6 5h windows. GPT-6 Astra: 3.0% of ChatGPT Pro $100 (3.0% / 1w) per run. Each figure is a share of that agent's own plan, so there is no delta to draw.

spec-planning@v1DvsC
DimensionClaude Sonnet 5GPT-6 AstraAdvantage
Capability53%74%+21% (GPT-6 Astra leads)
Median task time3m 31s4m 0s29s faster (Claude Sonnet 5 leads)
Approx. task cost$0.003 / task$0.057 / task$0.054 / task lower (Claude Sonnet 5 leads)

Claude Sonnet 5: 1.0% of Claude Max 20x (1.0% / 5h) per run. Its weekly limit holds about 7.2 of the week's 33.6 5h windows. GPT-6 Astra: 1.0% of ChatGPT Pro $100 (1.0% / 1w) per run. Each figure is a share of that agent's own plan, so there is no delta to draw.

vibe-coding@v1FvsC
DimensionClaude Sonnet 5GPT-6 AstraAdvantage
Capability34%61%+27% (GPT-6 Astra leads)
Median task time4m 50s2m 54s1m 56s faster (GPT-6 Astra leads)
Approx. task cost$0.003 / task$0.046 / task$0.043 / task lower (Claude Sonnet 5 leads)

Claude Sonnet 5: 0.2% of Claude Max 20x (0.2% / 5h) per good solve. Its weekly limit holds about 7.2 of the week's 33.6 5h windows. GPT-6 Astra: 0.2% of ChatGPT Pro $100 (0.2% / 1w) per good solve. Each figure is a share of that agent's own plan, so there is no delta to draw.

Grades and deltas are comparable only within a suite version. See methodology.

Frequently asked questions

Which is better for coding, Claude Sonnet 5 or GPT-6 Astra?

Claude Sonnet 5 clears higher: tier 4 of 5 versus tier 2 for GPT-6 Astra on real-world@v3, our private suite of real-world coding problems. Latest measurement 2026-08-31.

How much do Claude Sonnet 5 and GPT-6 Astra cost?

Claude Sonnet 5 runs on Claude Max 20x at $200/month (public price as of 2026-08-05). GPT-6 Astra runs on ChatGPT Pro $100 at $100/month (public price as of 2026-09-05).