Electricity Bench

Claude Haiku 4.5 vs GPT-6 Astra

Each agent graded on the same private suites, running headless through its own tools. Advantages are oriented so a win is a win, whichever way the metric runs.

Claude Haiku 4.5Clears tier 1 (partial tier 5) at 4.0% of Claude Max 20x per runDOVERALLGPT-6 AstraClears tier 2 (partial tier 5) at 3.0% of ChatGPT Pro $100 per runCOVERALL
real-world@v3CvsC
DimensionClaude Haiku 4.5GPT-6 AstraAdvantage
Capability62%57%+5% (Claude Haiku 4.5 leads)
Median task time3m 31s1m 56s1m 34s faster (GPT-6 Astra leads)
Approx. task cost$0.004 / task$0.046 / task$0.042 / task lower (Claude Haiku 4.5 leads)

Claude Haiku 4.5: 4.0% of Claude Max 20x (4.0% / 5h, 1.0% / 1w) per run. Its weekly limit holds about 7.2 of the week's 33.6 5h windows. GPT-6 Astra: 3.0% of ChatGPT Pro $100 (3.0% / 1w) per run. Each figure is a share of that agent's own plan, so there is no delta to draw.

spec-planning@v1FvsC
DimensionClaude Haiku 4.5GPT-6 AstraAdvantage
Capability25%74%+49% (GPT-6 Astra leads)
Median task time2m 9s4m 0s1m 51s faster (Claude Haiku 4.5 leads)
Approx. task costnot measured$0.057 / task-

Claude Haiku 4.5: 0.0% of Claude Max 20x per run. Its weekly limit holds about 7.2 of the week's 33.6 5h windows. GPT-6 Astra: 1.0% of ChatGPT Pro $100 (1.0% / 1w) per run. Each figure is a share of that agent's own plan, so there is no delta to draw.

vibe-coding@v1FvsC
DimensionClaude Haiku 4.5GPT-6 AstraAdvantage
Capability21%61%+40% (GPT-6 Astra leads)
Median task time4m 18s2m 54s1m 24s faster (GPT-6 Astra leads)
Approx. task cost$0.003 / task$0.046 / task$0.043 / task lower (Claude Haiku 4.5 leads)

Claude Haiku 4.5: 0.2% of Claude Max 20x (0.2% / 5h) per good solve. Its weekly limit holds about 7.2 of the week's 33.6 5h windows. GPT-6 Astra: 0.2% of ChatGPT Pro $100 (0.2% / 1w) per good solve. Each figure is a share of that agent's own plan, so there is no delta to draw.

Grades and deltas are comparable only within a suite version. See methodology.

Frequently asked questions

Which is better for coding, Claude Haiku 4.5 or GPT-6 Astra?

GPT-6 Astra clears higher: tier 2 of 5 versus tier 1 for Claude Haiku 4.5 on real-world@v3, our private suite of real-world coding problems. Latest measurement 2026-08-31.

How much do Claude Haiku 4.5 and GPT-6 Astra cost?

Claude Haiku 4.5 runs on Claude Max 20x at $200/month (public price as of 2026-08-05). GPT-6 Astra runs on ChatGPT Pro $100 at $100/month (public price as of 2026-09-05).