Electricity Bench

gemini-3.1-pro vs gpt-5.6-sol

Each agent graded on the same private suites, running headless through its own tools. Advantages are oriented so a win is a win, whichever way the metric runs.

gemini-3.1-proClears tier 3 (partial tier 5) at 8.5% of Google AI Pro per runFOVERALLgpt-5.6-solClears tier 4 (partial tier 5) at 3.5% of ChatGPT Plus per runCOVERALL
real-world@v3DvsC
Dimensiongemini-3.1-progpt-5.6-solAdvantage
Capability53%60%+7% (gpt-5.6-sol leads)
Median task time3m 25s2m 28s57s faster (gpt-5.6-sol leads)
Approx. task cost$0.026 / task$0.011 / task$0.015 / task lower (gpt-5.6-sol leads)

gemini-3.1-pro: 8.5% of Google AI Pro (51.2% / 5h, 8.5% / 1w) per run. gpt-5.6-sol: 3.5% of ChatGPT Plus (3.5% / 1w) per run. Each figure is a share of that agent's own plan, so there is no delta to draw.

spec-planning@v1FvsC
Dimensiongemini-3.1-progpt-5.6-solAdvantage
Capability16%67%+50% (gpt-5.6-sol leads)
Median task time1m 47s4m 11s2m 24s faster (gemini-3.1-pro leads)
Approx. task cost$0.009 / task$0.010 / task$0.001 / task lower (gemini-3.1-pro leads)

gemini-3.1-pro: 0.8% of Google AI Pro (4.6% / 5h, 0.8% / 1w) per run. gpt-5.6-sol: 0.9% of ChatGPT Plus (0.9% / 1w) per run. Each figure is a share of that agent's own plan, so there is no delta to draw.

vibe-coding@v1FvsC
Dimensiongemini-3.1-progpt-5.6-solAdvantage
Capability23%56%+34% (gpt-5.6-sol leads)
Median task time4m 39s3m 43s55s faster (gpt-5.6-sol leads)
Approx. task cost$0.039 / task$0.011 / task$0.028 / task lower (gpt-5.6-sol leads)

gemini-3.1-pro: 0.9% of Google AI Pro (5.1% / 5h, 0.9% / 1w) per good solve. gpt-5.6-sol: 0.2% of ChatGPT Plus (0.2% / 1w) per good solve. Each figure is a share of that agent's own plan, so there is no delta to draw.

Grades and deltas are comparable only within a suite version. See methodology.

Frequently asked questions

Which is better for coding, gemini-3.1-pro or gpt-5.6-sol?

gpt-5.6-sol clears higher: tier 4 of 5 versus tier 3 for gemini-3.1-pro on real-world@v3, our private suite of real-world coding problems. Latest measurement 2026-08-17.