Electricity Bench

Claude Haiku 4.5 vs Grok 4.6

Grok 4.6 was superseded by Grok 4.7. The grades below are the last ones measured, so read them as history rather than as this week's board. See the current roster.

Grok 4.6 leads overall, C- to F. Claude Haiku 4.5 is about 13x cheaper per task. By suite, Grok 4.6 takes real-world issues (D to D-) and spec planning (C to F). Take Claude Haiku 4.5 anyway when you want the side that is cheaper per task and faster on real-world issues.Measured

Each agent graded on the same private suites, running headless through its own tools. Advantages are oriented so a win is a win, whichever way the metric runs.

Verdict: Grok 4.6 vs Claude Haiku 4.5

Grok 4.6 leads overall, C- to F. By suite: Grok 4.6 takes real-world issues, D to D- (47% vs 37% capability); Grok 4.6 takes spec planning, C to F (66% vs 21% capability); Grok 4.6 takes vibe coding, C- to F (61% vs 22% capability). Claude Haiku 4.5 used 1% of Claude Max 5x's weekly limit per pass, $0.012 per task at the listed price. Grok 4.6 used 13% of SuperGrok Plus's weekly limit per pass, $0.157 per task at the listed price. Per task, Claude Haiku 4.5 is about 13x cheaper ($0.012 vs $0.157). Claude Haiku 4.5 is faster on real-world issues: a median task takes 3m 8s against 7m 10s. Both finished every task on it. Reasons to pick Claude Haiku 4.5 anyway: it is cheaper per task ($0.012 vs $0.157) and it is faster on real-world issues (3m 8s vs 7m 10s median).

Changed since the previous graded week: Claude Haiku 4.5: real-world issues D+ to D-; Grok 4.6: real-world issues C- to D, real-world issues usage 4% to 3% of the weekly limit, vibe coding C+ to C-.

Claude Haiku 4.5Clears tier 2 (partial tier 5) at 8.0% of Claude Max 5x per runFOVERALLGrok 4.6Clears tier 4 (partial tier 5) at 3.0% of SuperGrok Plus per runC-OVERALL
real-world@v3D-vsD
DimensionClaude Haiku 4.5Grok 4.6Advantage
Capability37%47%+10% (Grok 4.6 leads)
Median task time3m 8s7m 10s4m 2s faster (Claude Haiku 4.5 leads)
Approx. task cost$0.015 / task$0.046 / task$0.031 / task lower (Claude Haiku 4.5 leads)

Claude Haiku 4.5: 8.0% of Claude Max 5x (8.0% / 5h, 1.0% / 1w) per run. Its weekly limit holds about 13.8 of the week's 33.6 5h windows. Grok 4.6: 3.0% of SuperGrok Plus (3.0% / 1w) per run. Each figure is a share of that agent's own plan, so there is no delta to draw.

spec-planning@v1FvsC
DimensionClaude Haiku 4.5Grok 4.6Advantage
Capability21%66%+45% (Grok 4.6 leads)
Median task time2m 8s45m 26s43m 18s faster (Claude Haiku 4.5 leads)
Approx. task cost$0.002 / task$0.575 / task$0.573 / task lower (Claude Haiku 4.5 leads)

Claude Haiku 4.5: 1.0% of Claude Max 5x (1.0% / 5h) per run. Its weekly limit holds about 13.8 of the week's 33.6 5h windows. Grok 4.6: 10.0% of SuperGrok Plus (10.0% / 1w) per run. Each figure is a share of that agent's own plan, so there is no delta to draw.

vibe-coding@v1FvsC-
DimensionClaude Haiku 4.5Grok 4.6Advantage
Capability22%61%+39% (Grok 4.6 leads)
Median task time4m 4s11m 14s7m 10s faster (Claude Haiku 4.5 leads)
Approx. task cost$0.009 / task<$0.230 / task$0.221 / task lower (Claude Haiku 4.5 leads)

Claude Haiku 4.5: 1.3% of Claude Max 5x (1.3% / 5h) per good solve. Its weekly limit holds about 13.8 of the week's 33.6 5h windows. Grok 4.6: under 1% of SuperGrok Plus per good solve. Each figure is a share of that agent's own plan, so there is no delta to draw.

Grades and deltas are comparable only within a suite version. See methodology.

Frequently asked questions

Which is better for coding, Claude Haiku 4.5 or Grok 4.6?

Grok 4.6 clears higher: tier 4 of 5 versus tier 2 for Claude Haiku 4.5 on real-world@v3, our private suite of real-world coding problems. Latest measurement 2026-09-28.

Which is cheaper per task, Claude Haiku 4.5 or Grok 4.6?

Claude Haiku 4.5 used 1% of Claude Max 5x's weekly limit per pass, $0.012 per task at the listed price. Grok 4.6 used 13% of SuperGrok Plus's weekly limit per pass, $0.157 per task at the listed price. Per task, Claude Haiku 4.5 is about 13x cheaper ($0.012 vs $0.157).

What do Claude Haiku 4.5 and Grok 4.6 cost a month?

Claude Haiku 4.5 runs on Claude Max 5x at $100/month (public price as of 2026-07-20). Grok 4.6 runs on SuperGrok Plus at $100/month (public price as of 2026-09-14).