Electricity Bench

Claude Haiku 4.5 vs GPT-6 Sol

GPT-6 Sol leads overall, D+ to F. The two cost about the same per task. By suite, Claude Haiku 4.5 takes real-world issues (D+ to D-) and GPT-6 Sol takes spec planning (C to F). Take Claude Haiku 4.5 anyway when you want the side that is ahead on real-world issues.Measured

Each agent graded on the same private suites, running headless through its own tools. Advantages are oriented so a win is a win, whichever way the metric runs.

Verdict: GPT-6 Sol vs Claude Haiku 4.5

GPT-6 Sol leads overall, D+ to F. By suite: Claude Haiku 4.5 takes real-world issues, D+ to D- (50% vs 38% capability); GPT-6 Sol takes spec planning, C to F (64% vs 19% capability); GPT-6 Sol takes vibe coding, D+ to F (51% vs 23% capability). Claude Haiku 4.5 used 1% of Claude Max 5x's weekly limit per pass, $0.012 per task at the listed price. GPT-6 Sol used 5% of ChatGPT Plus's weekly limit per pass, $0.012 per task at the listed price; at the ~$100 tier the board defaults to that is an estimated ~1% of ChatGPT Pro 5x's weekly limit (est, about $0.012 per task). Per task the two cost about the same ($0.012 vs $0.012). GPT-6 Sol is faster on real-world issues: a median task takes 2m 44s against 3m 39s. Both finished every task on it. Reasons to pick Claude Haiku 4.5 anyway: it leads on real-world issues (D+ to D-).

Changed since W32: Claude Haiku 4.5: real-world issues F to D+.

Claude Haiku 4.5Clears tier 2 (partial tier 5) at 13.0% of Claude Max 5x per runFOVERALLGPT-6 SolClears tier 1 (partial tier 5) at 4.0% of ChatGPT Plus per runD+OVERALL
real-world@v3D+vsD-
DimensionClaude Haiku 4.5GPT-6 SolAdvantage
Capability50%38%+12% (Claude Haiku 4.5 leads)
Median task time3m 39s2m 44s55s faster (GPT-6 Sol leads)
Approx. task cost$0.015 / task$0.012 / task$0.003 / task lower (GPT-6 Sol leads)

Claude Haiku 4.5: 13.0% of Claude Max 5x (13.0% / 5h, 1.0% / 1w) per run. Its weekly limit holds about 14.6 of the week's 33.6 5h windows. GPT-6 Sol: 4.0% of ChatGPT Plus (37.0% / 5h, 4.0% / 1w) per run. Its weekly limit holds about 6 of the week's 33.6 5h windows. Each figure is a share of that agent's own plan, so there is no delta to draw.

spec-planning@v1FvsC
DimensionClaude Haiku 4.5GPT-6 SolAdvantage
Capability19%64%+44% (GPT-6 Sol leads)
Median task time1m 56s2m 23s27s faster (Claude Haiku 4.5 leads)
Approx. task cost$0.002 / task$0.011 / task$0.010 / task lower (Claude Haiku 4.5 leads)

Claude Haiku 4.5: 1.0% of Claude Max 5x (1.0% / 5h) per run. Its weekly limit holds about 14.6 of the week's 33.6 5h windows. GPT-6 Sol: 1.0% of ChatGPT Plus (8.0% / 5h, 1.0% / 1w) per run. Its weekly limit holds about 6 of the week's 33.6 5h windows. Each figure is a share of that agent's own plan, so there is no delta to draw.

vibe-coding@v1FvsD+
DimensionClaude Haiku 4.5GPT-6 SolAdvantage
Capability23%51%+28% (GPT-6 Sol leads)
Median task time3m 36s3m 4s32s faster (GPT-6 Sol leads)
Approx. task cost$0.057 / task$0.018 / task$0.039 / task lower (GPT-6 Sol leads)

Claude Haiku 4.5: 2.0% of Claude Max 5x (2.0% / 5h, 0.3% / 1w) per good solve. Its weekly limit holds about 14.6 of the week's 33.6 5h windows. GPT-6 Sol: 0.4% of ChatGPT Plus (2.4% / 5h, 0.4% / 1w) per good solve. Its weekly limit holds about 6 of the week's 33.6 5h windows. Each figure is a share of that agent's own plan, so there is no delta to draw.

Grades and deltas are comparable only within a suite version. See methodology.

Frequently asked questions

Which is better for coding, Claude Haiku 4.5 or GPT-6 Sol?

Claude Haiku 4.5 clears higher: tier 2 of 5 versus tier 1 for GPT-6 Sol on real-world@v3, our private suite of real-world coding problems. Latest measurement 2026-09-21.

Which is cheaper per task, Claude Haiku 4.5 or GPT-6 Sol?

Claude Haiku 4.5 used 1% of Claude Max 5x's weekly limit per pass, $0.012 per task at the listed price. GPT-6 Sol used 5% of ChatGPT Plus's weekly limit per pass, $0.012 per task at the listed price; at the ~$100 tier the board defaults to that is an estimated ~1% of ChatGPT Pro 5x's weekly limit (est, about $0.012 per task). Per task the two cost about the same ($0.012 vs $0.012).

What do Claude Haiku 4.5 and GPT-6 Sol cost a month?

Claude Haiku 4.5 runs on Claude Max 5x at $100/month (public price as of 2026-07-20). GPT-6 Sol runs on ChatGPT Plus at $20/month (public price as of 2026-07-20).