Electricity Bench

Claude Haiku 4.5 vs GPT-6 Astra

GPT-6 Astra leads overall, C to F. Claude Haiku 4.5 is about 4.4x cheaper per task. By suite, GPT-6 Astra takes real-world issues (D to D-) and spec planning (C+ to F). Take Claude Haiku 4.5 anyway when you want the side that is cheaper per task.Measured

Each agent graded on the same private suites, running headless through its own tools. Advantages are oriented so a win is a win, whichever way the metric runs.

Verdict: GPT-6 Astra vs Claude Haiku 4.5

GPT-6 Astra leads overall, C to F. By suite: GPT-6 Astra takes real-world issues, D to D- (43% vs 37% capability); GPT-6 Astra takes spec planning, C+ to F (74% vs 21% capability); GPT-6 Astra takes vibe coding, C+ to F (74% vs 22% capability). Claude Haiku 4.5 used 1% of Claude Max 5x's weekly limit per pass, $0.012 per task at the listed price. GPT-6 Astra used 22% of ChatGPT Plus's weekly limit per pass, $0.053 per task at the listed price; at the ~$100 tier the board defaults to that is an estimated ~4.4% of ChatGPT Pro 5x's weekly limit (est, about $0.053 per task). Per task, Claude Haiku 4.5 is about 4.4x cheaper ($0.012 vs $0.053). GPT-6 Astra is faster on real-world issues: a median task takes 2m 13s against 3m 8s. Both finished every task on it. Reasons to pick Claude Haiku 4.5 anyway: it is cheaper per task ($0.012 vs $0.053).

Changed since W39: Claude Haiku 4.5: real-world issues D+ to D-; GPT-6 Astra has one graded week under this version (W40).

Claude Haiku 4.5Clears tier 2 (partial tier 5) at 8.0% of Claude Max 5x per runFOVERALLGPT-6 AstraClears tier 2 (partial tier 5) at 17.0% of ChatGPT Plus per runCOVERALL
real-world@v3D-vsD
DimensionClaude Haiku 4.5GPT-6 AstraAdvantage
Capability37%43%+7% (GPT-6 Astra leads)
Median task time3m 8s2m 13s55s faster (GPT-6 Astra leads)
Approx. task cost$0.015 / task$0.052 / task$0.037 / task lower (Claude Haiku 4.5 leads)

Claude Haiku 4.5: 8.0% of Claude Max 5x (8.0% / 5h, 1.0% / 1w) per run. Its weekly limit holds about 13.8 of the week's 33.6 5h windows. GPT-6 Astra: 17.0% of ChatGPT Plus (112.0% / 5h, 17.0% / 1w) per run. Its weekly limit holds about 6 of the week's 33.6 5h windows. Each figure is a share of that agent's own plan, so there is no delta to draw.

spec-planning@v1FvsC+
DimensionClaude Haiku 4.5GPT-6 AstraAdvantage
Capability21%74%+53% (GPT-6 Astra leads)
Median task time2m 8s3m 5s57s faster (Claude Haiku 4.5 leads)
Approx. task cost$0.002 / task$0.057 / task$0.056 / task lower (Claude Haiku 4.5 leads)

Claude Haiku 4.5: 1.0% of Claude Max 5x (1.0% / 5h) per run. Its weekly limit holds about 13.8 of the week's 33.6 5h windows. GPT-6 Astra: 5.0% of ChatGPT Plus (27.0% / 5h, 5.0% / 1w) per run. Its weekly limit holds about 6 of the week's 33.6 5h windows. Each figure is a share of that agent's own plan, so there is no delta to draw.

vibe-coding@v1FvsC+
DimensionClaude Haiku 4.5GPT-6 AstraAdvantage
Capability22%74%+52% (GPT-6 Astra leads)
Median task time4m 4s2m 40s1m 24s faster (GPT-6 Astra leads)
Approx. task cost$0.009 / task$0.046 / task$0.037 / task lower (Claude Haiku 4.5 leads)

Claude Haiku 4.5: 1.3% of Claude Max 5x (1.3% / 5h) per good solve. Its weekly limit holds about 13.8 of the week's 33.6 5h windows. GPT-6 Astra: 1.0% of ChatGPT Plus (7.2% / 5h, 1.0% / 1w) per good solve. Its weekly limit holds about 6 of the week's 33.6 5h windows. Each figure is a share of that agent's own plan, so there is no delta to draw.

Grades and deltas are comparable only within a suite version. See methodology.

Frequently asked questions

Which is better for coding, Claude Haiku 4.5 or GPT-6 Astra?

Both clear tier 2 of 5, but GPT-6 Astra scores higher on capability: 43% versus 37% on real-world@v3, our private suite of real-world coding problems. Latest measurement 2026-09-28.

Which is cheaper per task, Claude Haiku 4.5 or GPT-6 Astra?

Claude Haiku 4.5 used 1% of Claude Max 5x's weekly limit per pass, $0.012 per task at the listed price. GPT-6 Astra used 22% of ChatGPT Plus's weekly limit per pass, $0.053 per task at the listed price; at the ~$100 tier the board defaults to that is an estimated ~4.4% of ChatGPT Pro 5x's weekly limit (est, about $0.053 per task). Per task, Claude Haiku 4.5 is about 4.4x cheaper ($0.012 vs $0.053).

What do Claude Haiku 4.5 and GPT-6 Astra cost a month?

Claude Haiku 4.5 runs on Claude Max 5x at $100/month (public price as of 2026-07-20). GPT-6 Astra runs on ChatGPT Plus at $20/month (public price as of 2026-07-20).