Electricity Bench

claude-haiku-4-5 vs grok-4.5

Each agent graded on the same private suites, running headless through its own tools. Advantages are oriented so a win is a win, whichever way the metric runs.

claude-haiku-4-5Clears tier 2 (partial tier 5) at 5.0% of Claude Max 20x per runDOVERALLgrok-4.5Clears tier 4 (partial tier 5) at 6.9% of SuperGrok per runCOVERALL
real-world@v3CvsC
Dimensionclaude-haiku-4-5grok-4.5Advantage
Capability63%60%+3% (claude-haiku-4-5 leads)
Median task time3m 58s3m 9s48s faster (grok-4.5 leads)
Approx. task cost$0.005 / task$0.032 / task$0.027 / task lower (claude-haiku-4-5 leads)

claude-haiku-4-5: 5.0% of Claude Max 20x (5.0% / 5h, 1.0% / 1w) per run. grok-4.5: 6.9% of SuperGrok (6.9% / 1w) per run. Each figure is a share of that agent's own plan, so there is no delta to draw.

spec-planning@v1Fvs-

Only claude-haiku-4-5 has run this suite, so there is no head-to-head yet.

vibe-coding@v1FvsC
Dimensionclaude-haiku-4-5grok-4.5Advantage
Capability23%59%+35% (grok-4.5 leads)
Median task time4m 18s3m 40s38s faster (grok-4.5 leads)
Approx. task costnot measured$0.031 / task-

claude-haiku-4-5: 0.0% of Claude Max 20x per good solve. grok-4.5: 0.4% of SuperGrok (0.4% / 1w) per good solve. Each figure is a share of that agent's own plan, so there is no delta to draw.

Grades and deltas are comparable only within a suite version. See methodology.

Frequently asked questions

Which is better for coding, claude-haiku-4-5 or grok-4.5?

grok-4.5 clears higher: tier 4 of 5 versus tier 2 for claude-haiku-4-5 on real-world@v3, our private suite of real-world coding problems. Latest measurement 2026-08-18.

How much do claude-haiku-4-5 and grok-4.5 cost?

claude-haiku-4-5 runs on Claude Max 20x at $200/month (public price as of 2026-08-05). grok-4.5 runs on SuperGrok at $30/month (public price as of 2026-07-20).