Electricity Bench

Claude Haiku 4.5 vs Grok 4.5

Grok 4.5 was superseded by Grok 4.7. The grades below are the last ones measured, so read them as history rather than as this week's board. See the current roster.

Grok 4.5 leads overall, C- to F. Claude Haiku 4.5 is about 2.6x cheaper per task. By suite, Grok 4.5 takes real-world issues (C- to D-) and vibe coding (C- to F). Take Claude Haiku 4.5 anyway when you want the side that is cheaper per task and faster on real-world issues.Measured

Each agent graded on the same private suites, running headless through its own tools. Advantages are oriented so a win is a win, whichever way the metric runs.

Verdict: Grok 4.5 vs Claude Haiku 4.5

Grok 4.5 leads overall, C- to F. By suite: Grok 4.5 takes real-world issues, C- to D- (60% vs 37% capability); Grok 4.5 takes vibe coding, C- to F (59% vs 22% capability). Only Claude Haiku 4.5 has run spec planning. Claude Haiku 4.5 used 1% of Claude Max 5x's weekly limit per pass, $0.012 per task at the listed price. Grok 4.5 used 6.9% of SuperGrok's weekly limit per pass, $0.032 per task at the listed price. Per task, Claude Haiku 4.5 is about 2.6x cheaper ($0.012 vs $0.032). Claude Haiku 4.5 is faster on real-world issues: a median task takes 3m 8s against 3m 9s. Both finished every task on it. Reasons to pick Claude Haiku 4.5 anyway: it is cheaper per task ($0.012 vs $0.032) and it is faster on real-world issues (3m 8s vs 3m 9s median).

Changed since the previous graded week: Claude Haiku 4.5: real-world issues D+ to D-; Grok 4.5: real-world issues usage 8.0% to 6.9% of the weekly limit.

Claude Haiku 4.5Clears tier 2 (partial tier 5) at 8.0% of Claude Max 5x per runFOVERALLGrok 4.5Clears tier 4 (partial tier 5) at 6.9% of SuperGrok per runC-OVERALL
real-world@v3D-vsC-
DimensionClaude Haiku 4.5Grok 4.5Advantage
Capability37%60%+23% (Grok 4.5 leads)
Median task time3m 8s3m 9s1s faster (Claude Haiku 4.5 leads)
Approx. task cost$0.015 / task$0.032 / task$0.016 / task lower (Claude Haiku 4.5 leads)

Claude Haiku 4.5: 8.0% of Claude Max 5x (8.0% / 5h, 1.0% / 1w) per run. Its weekly limit holds about 13.8 of the week's 33.6 5h windows. Grok 4.5: 6.9% of SuperGrok (6.9% / 1w) per run. Each figure is a share of that agent's own plan, so there is no delta to draw.

spec-planning@v1Fvs-

Only Claude Haiku 4.5 has run this suite, so there is no head-to-head yet.

vibe-coding@v1FvsC-
DimensionClaude Haiku 4.5Grok 4.5Advantage
Capability22%59%+37% (Grok 4.5 leads)
Median task time4m 4s3m 40s24s faster (Grok 4.5 leads)
Approx. task cost$0.009 / task$0.031 / task$0.022 / task lower (Claude Haiku 4.5 leads)

Claude Haiku 4.5: 1.3% of Claude Max 5x (1.3% / 5h) per good solve. Its weekly limit holds about 13.8 of the week's 33.6 5h windows. Grok 4.5: 0.4% of SuperGrok (0.4% / 1w) per good solve. Each figure is a share of that agent's own plan, so there is no delta to draw.

Grades and deltas are comparable only within a suite version. See methodology.

Frequently asked questions

Which is better for coding, Claude Haiku 4.5 or Grok 4.5?

Grok 4.5 clears higher: tier 4 of 5 versus tier 2 for Claude Haiku 4.5 on real-world@v3, our private suite of real-world coding problems. Latest measurement 2026-09-28.

Which is cheaper per task, Claude Haiku 4.5 or Grok 4.5?

Claude Haiku 4.5 used 1% of Claude Max 5x's weekly limit per pass, $0.012 per task at the listed price. Grok 4.5 used 6.9% of SuperGrok's weekly limit per pass, $0.032 per task at the listed price. Per task, Claude Haiku 4.5 is about 2.6x cheaper ($0.012 vs $0.032).

What do Claude Haiku 4.5 and Grok 4.5 cost a month?

Claude Haiku 4.5 runs on Claude Max 5x at $100/month (public price as of 2026-07-20). Grok 4.5 runs on SuperGrok at $30/month (public price as of 2026-07-20).