Electricity Bench

gpt-5.6-sol vs composer-2.5

Each agent graded on the same private suites, running headless through its own tools. Advantages are oriented so a win is a win, whichever way the metric runs.

gpt-5.6-solClears tier 4 (partial tier 5) at 3.5% of ChatGPT Plus per runCOVERALLcomposer-2.5Clears tier 2 (partial tier 5) at 1.8% of Cursor Pro per runDOVERALL
real-world@v3CvsC
Dimensiongpt-5.6-solcomposer-2.5Advantage
Capability60%57%+3% (gpt-5.6-sol leads)
Median task time2m 28s1m 30s58s faster (composer-2.5 leads)
Approx. task cost$0.011 / task$0.023 / task$0.013 / task lower (gpt-5.6-sol leads)

gpt-5.6-sol: 3.5% of ChatGPT Plus (3.5% / 1w) per run. composer-2.5: 1.8% of Cursor Pro (1.8% / 1m) per run. Each figure is a share of that agent's own plan, so there is no delta to draw.

spec-planning@v1CvsD
Dimensiongpt-5.6-solcomposer-2.5Advantage
Capability67%51%+16% (gpt-5.6-sol leads)
Median task time4m 11s4m 30s19s faster (gpt-5.6-sol leads)
Approx. task cost$0.010 / task$0.029 / task$0.019 / task lower (gpt-5.6-sol leads)

gpt-5.6-sol: 0.9% of ChatGPT Plus (0.9% / 1w) per run. composer-2.5: 0.6% of Cursor Pro (0.6% / 1m) per run. Each figure is a share of that agent's own plan, so there is no delta to draw.

vibe-coding@v1CvsD
Dimensiongpt-5.6-solcomposer-2.5Advantage
Capability56%37%+19% (gpt-5.6-sol leads)
Median task time3m 43s1m 51s1m 52s faster (composer-2.5 leads)
Approx. task cost$0.011 / task$0.024 / task$0.013 / task lower (gpt-5.6-sol leads)

gpt-5.6-sol: 0.2% of ChatGPT Plus (0.2% / 1w) per good solve. composer-2.5: 0.1% of Cursor Pro (0.1% / 1m) per good solve. Each figure is a share of that agent's own plan, so there is no delta to draw.

Grades and deltas are comparable only within a suite version. See methodology.

Frequently asked questions

Which is better for coding, gpt-5.6-sol or composer-2.5?

gpt-5.6-sol clears higher: tier 4 of 5 versus tier 2 for composer-2.5 on real-world@v3, our private suite of real-world coding problems. Latest measurement 2026-08-17.

How much do gpt-5.6-sol and composer-2.5 cost?

gpt-5.6-sol runs on ChatGPT Plus at $20/month (public price as of 2026-07-20). composer-2.5 runs on Cursor Pro at $20/month (public price as of 2026-07-20).