Electricity Bench

gemini-3.7-flash vs gpt-5.6-sol

Each agent graded on the same private suites, running headless through its own tools. Advantages are oriented so a win is a win, whichever way the metric runs.

gemini-3.7-flashClears tier 3 (partial tier 5) at 11.3% of Google AI Pro per runCOVERALLgpt-5.6-solClears tier 4 (partial tier 5) at 3.5% of ChatGPT Plus per runCOVERALL
real-world@v3DvsC
Dimensiongemini-3.7-flashgpt-5.6-solAdvantage
Capability53%60%+7% (gpt-5.6-sol leads)
Median task time2m 50s2m 28s22s faster (gpt-5.6-sol leads)
Approx. task cost$0.035 / task$0.011 / task$0.024 / task lower (gpt-5.6-sol leads)

gemini-3.7-flash: 11.3% of Google AI Pro (67.8% / 5h, 11.3% / 1w) per run. gpt-5.6-sol: 3.5% of ChatGPT Plus (3.5% / 1w) per run. Each figure is a share of that agent's own plan, so there is no delta to draw.

spec-planning@v1DvsC
Dimensiongemini-3.7-flashgpt-5.6-solAdvantage
Capability40%67%+27% (gpt-5.6-sol leads)
Median task time1m 59s4m 11s2m 12s faster (gemini-3.7-flash leads)
Approx. task cost$0.014 / task$0.010 / task$0.004 / task lower (gpt-5.6-sol leads)

gemini-3.7-flash: 1.2% of Google AI Pro (7.3% / 5h, 1.2% / 1w) per run. gpt-5.6-sol: 0.9% of ChatGPT Plus (0.9% / 1w) per run. Each figure is a share of that agent's own plan, so there is no delta to draw.

vibe-coding@v1BvsC
Dimensiongemini-3.7-flashgpt-5.6-solAdvantage
Capability79%56%+23% (gemini-3.7-flash leads)
Median task time4m 7s3m 43s23s faster (gpt-5.6-sol leads)
Approx. task cost$0.029 / task$0.011 / task$0.017 / task lower (gpt-5.6-sol leads)

gemini-3.7-flash: 0.6% of Google AI Pro (3.7% / 5h, 0.6% / 1w) per good solve. gpt-5.6-sol: 0.2% of ChatGPT Plus (0.2% / 1w) per good solve. Each figure is a share of that agent's own plan, so there is no delta to draw.

Grades and deltas are comparable only within a suite version. See methodology.

Frequently asked questions

Which is better for coding, gemini-3.7-flash or gpt-5.6-sol?

gpt-5.6-sol clears higher: tier 4 of 5 versus tier 3 for gemini-3.7-flash on real-world@v3, our private suite of real-world coding problems. Latest measurement 2026-08-16.