Electricity Bench

Gemini 3.7 Flash vs Claude Haiku 4.5

Gemini 3.7 Flash was superseded by Gemini 3.8 Flash. The grades below are the last ones measured, so read them as history rather than as this week's board. See the current roster.

Gemini 3.7 Flash leads overall, D+ to F. Claude Haiku 4.5 is about 1.9x cheaper per task. By suite, Gemini 3.7 Flash takes real-world issues (C- to D-) and spec planning (D- to F). Take Claude Haiku 4.5 anyway when you want the side that is cheaper per task.Measured

Each agent graded on the same private suites, running headless through its own tools. Advantages are oriented so a win is a win, whichever way the metric runs.

Verdict: Claude Haiku 4.5 vs Gemini 3.7 Flash

Gemini 3.7 Flash leads overall, D+ to F. By suite: Gemini 3.7 Flash takes real-world issues, C- to D- (60% vs 37% capability); Gemini 3.7 Flash takes spec planning, D- to F (40% vs 21% capability); Gemini 3.7 Flash takes vibe coding, C- to F (61% vs 22% capability). Gemini 3.7 Flash used 9.4% of Google AI Pro's weekly limit per pass, $0.023 per task at the listed price. Claude Haiku 4.5 used 1% of Claude Max 5x's weekly limit per pass, $0.012 per task at the listed price. Per task, Claude Haiku 4.5 is about 1.9x cheaper ($0.012 vs $0.023). Gemini 3.7 Flash is faster on real-world issues: a median task takes 2m 38s against 3m 8s. Both finished every task on it. Reasons to pick Claude Haiku 4.5 anyway: it is cheaper per task ($0.012 vs $0.023).

Changed since the previous graded week: Gemini 3.7 Flash: real-world issues usage 8.5% to 8.2% of the weekly limit, spec planning D to D-, spec planning usage 1.3% to 1.2% of the weekly limit; Claude Haiku 4.5: real-world issues D+ to D-.

Gemini 3.7 FlashClears tier 4 (partial tier 5) at 8.2% of Google AI Pro per runD+OVERALLClaude Haiku 4.5Clears tier 2 (partial tier 5) at 8.0% of Claude Max 5x per runFOVERALL
real-world@v3C-vsD-
DimensionGemini 3.7 FlashClaude Haiku 4.5Advantage
Capability60%37%+23% (Gemini 3.7 Flash leads)
Median task time2m 38s3m 8s30s faster (Gemini 3.7 Flash leads)
Approx. task cost$0.025 / task$0.015 / task$0.010 / task lower (Claude Haiku 4.5 leads)

Gemini 3.7 Flash: 8.2% of Google AI Pro (49.1% / 5h, 8.2% / 1w) per run. Its weekly limit holds 6 of the week's 33.6 5h windows. Claude Haiku 4.5: 8.0% of Claude Max 5x (8.0% / 5h, 1.0% / 1w) per run. Its weekly limit holds about 13.8 of the week's 33.6 5h windows. Each figure is a share of that agent's own plan, so there is no delta to draw.

spec-planning@v1D-vsF
DimensionGemini 3.7 FlashClaude Haiku 4.5Advantage
Capability40%21%+19% (Gemini 3.7 Flash leads)
Median task time1m 38s2m 8s30s faster (Gemini 3.7 Flash leads)
Approx. task cost$0.014 / task$0.002 / task$0.012 / task lower (Claude Haiku 4.5 leads)

Gemini 3.7 Flash: 1.2% of Google AI Pro (7.1% / 5h, 1.2% / 1w) per run. Its weekly limit holds 6 of the week's 33.6 5h windows. Claude Haiku 4.5: 1.0% of Claude Max 5x (1.0% / 5h) per run. Its weekly limit holds about 13.8 of the week's 33.6 5h windows. Each figure is a share of that agent's own plan, so there is no delta to draw.

vibe-coding@v1C-vsF
DimensionGemini 3.7 FlashClaude Haiku 4.5Advantage
Capability61%22%+39% (Gemini 3.7 Flash leads)
Median task time3m 37s4m 4s26s faster (Gemini 3.7 Flash leads)
Approx. task cost$0.028 / task$0.009 / task$0.019 / task lower (Claude Haiku 4.5 leads)

Gemini 3.7 Flash: 0.6% of Google AI Pro (3.6% / 5h, 0.6% / 1w) per good solve. Its weekly limit holds 6 of the week's 33.6 5h windows. Claude Haiku 4.5: 1.3% of Claude Max 5x (1.3% / 5h) per good solve. Its weekly limit holds about 13.8 of the week's 33.6 5h windows. Each figure is a share of that agent's own plan, so there is no delta to draw.

Grades and deltas are comparable only within a suite version. See methodology.

Frequently asked questions

Which is better for coding, Gemini 3.7 Flash or Claude Haiku 4.5?

Gemini 3.7 Flash clears higher: tier 4 of 5 versus tier 2 for Claude Haiku 4.5 on real-world@v3, our private suite of real-world coding problems. Latest measurement 2026-08-30.

Which is cheaper per task, Gemini 3.7 Flash or Claude Haiku 4.5?

Gemini 3.7 Flash used 9.4% of Google AI Pro's weekly limit per pass, $0.023 per task at the listed price. Claude Haiku 4.5 used 1% of Claude Max 5x's weekly limit per pass, $0.012 per task at the listed price. Per task, Claude Haiku 4.5 is about 1.9x cheaper ($0.012 vs $0.023).