Electricity Bench

Gemini 3.1 Pro vs Claude Sonnet 5

Claude Sonnet 5 is no longer on the leaderboard. The grades below are the last ones measured, so read them as history rather than as this week's board. See the current roster.

Claude Sonnet 5 leads overall, D to F. Claude Sonnet 5 is about 1.6x cheaper per task. By suite, real-world issues is even at D+ and Claude Sonnet 5 takes spec planning (D to F). The data gives no reason to pick Gemini 3.1 Pro over Claude Sonnet 5 this week.Measured

Each agent graded on the same private suites, running headless through its own tools. Advantages are oriented so a win is a win, whichever way the metric runs.

Verdict: Claude Sonnet 5 vs Gemini 3.1 Pro

Claude Sonnet 5 leads overall, D to F. By suite: real-world issues is even at D+ (53% vs 53% capability); Claude Sonnet 5 takes spec planning, D to F (44% vs 21% capability); vibe coding is even at F (27% vs 31% capability). Gemini 3.1 Pro used 15.9% of Google AI Pro's weekly limit per pass, $0.038 per task at the listed price. Claude Sonnet 5 used 2% of Claude Max 5x's weekly limit per pass, $0.024 per task at the listed price. Per task, Claude Sonnet 5 is about 1.6x cheaper ($0.024 vs $0.038). Claude Sonnet 5 is faster on real-world issues: a median task takes 3m 35s against 4m 53s. Both finished every task on it. The data gives no reason to pick Gemini 3.1 Pro over Claude Sonnet 5 this week.

Changed since W39: Gemini 3.1 Pro: real-world issues usage 9.8% to 14.8% of the weekly limit, spec planning usage 0.9% to 1.1% of the weekly limit, vibe coding usage 1.0% to 0.7% of the weekly limit; Claude Sonnet 5: vibe coding D+ to F.

Gemini 3.1 ProClears tier 3 (partial tier 5) at 14.8% of Google AI Pro per runFOVERALLClaude Sonnet 5Clears tier 3 (partial tier 5) at 12.0% of Claude Max 5x per runDOVERALL
real-world@v3D+vsD+
DimensionGemini 3.1 ProClaude Sonnet 5Advantage
Capability53%53%Even
Median task time4m 53s3m 35s1m 18s faster (Claude Sonnet 5 leads)
Approx. task cost$0.045 / task$0.015 / task$0.030 / task lower (Claude Sonnet 5 leads)

Gemini 3.1 Pro: 14.8% of Google AI Pro (88.9% / 5h, 14.8% / 1w) per run. Its weekly limit holds 6 of the week's 33.6 5h windows. Claude Sonnet 5: 12.0% of Claude Max 5x (12.0% / 5h, 1.0% / 1w) per run. Its weekly limit holds about 13.8 of the week's 33.6 5h windows. Each figure is a share of that agent's own plan, so there is no delta to draw.

spec-planning@v1FvsD
DimensionGemini 3.1 ProClaude Sonnet 5Advantage
Capability21%44%+23% (Claude Sonnet 5 leads)
Median task time1m 46s5m 12s3m 26s faster (Gemini 3.1 Pro leads)
Approx. task cost$0.013 / task$0.057 / task$0.045 / task lower (Gemini 3.1 Pro leads)

Gemini 3.1 Pro: 1.1% of Google AI Pro (6.5% / 5h, 1.1% / 1w) per run. Its weekly limit holds 6 of the week's 33.6 5h windows. Claude Sonnet 5: 5.0% of Claude Max 5x (5.0% / 5h, 1.0% / 1w) per run. Its weekly limit holds about 13.8 of the week's 33.6 5h windows. Each figure is a share of that agent's own plan, so there is no delta to draw.

vibe-coding@v1FvsF
DimensionGemini 3.1 ProClaude Sonnet 5Advantage
Capability27%31%+4% (Claude Sonnet 5 leads)
Median task time4m 38s4m 31s7s faster (Claude Sonnet 5 leads)
Approx. task cost$0.034 / task$0.007 / task$0.027 / task lower (Claude Sonnet 5 leads)

Gemini 3.1 Pro: 0.7% of Google AI Pro (4.4% / 5h, 0.7% / 1w) per good solve. Its weekly limit holds 6 of the week's 33.6 5h windows. Claude Sonnet 5: 1.0% of Claude Max 5x (1.0% / 5h) per good solve. Its weekly limit holds about 13.8 of the week's 33.6 5h windows. Each figure is a share of that agent's own plan, so there is no delta to draw.

Grades and deltas are comparable only within a suite version. See methodology.

Frequently asked questions

Which is better for coding, Gemini 3.1 Pro or Claude Sonnet 5?

They are even on our ladder: both clear tier 3 of 5 at 53% capability on real-world@v3, our private suite of real-world coding problems. Latest measurement 2026-09-28.

Which is cheaper per task, Gemini 3.1 Pro or Claude Sonnet 5?

Gemini 3.1 Pro used 15.9% of Google AI Pro's weekly limit per pass, $0.038 per task at the listed price. Claude Sonnet 5 used 2% of Claude Max 5x's weekly limit per pass, $0.024 per task at the listed price. Per task, Claude Sonnet 5 is about 1.6x cheaper ($0.024 vs $0.038).