Electricity Bench

gpt-5.6-sol vs grok-4.6

Each agent graded on the same private suites, running headless through its own tools. Advantages are oriented so a win is a win, whichever way the metric runs.

gpt-5.6-solClears tier 4 (partial tier 5) at 3.5% of ChatGPT Plus per runCOVERALLgrok-4.6Clears tier 4 (partial tier 5) at 2.8% of SuperGrok per runCOVERALL
real-world@v3CvsC
Dimensiongpt-5.6-solgrok-4.6Advantage
Capability60%60%Even
Median task time2m 28s6m 19s3m 50s faster (gpt-5.6-sol leads)
Approx. task cost$0.011 / task$0.013 / task$0.002 / task lower (gpt-5.6-sol leads)

gpt-5.6-sol: 3.5% of ChatGPT Plus (3.5% / 1w) per run. grok-4.6: 2.8% of SuperGrok (2.8% / 1w) per run. Each figure is a share of that agent's own plan, so there is no delta to draw.

spec-planning@v1CvsC
Dimensiongpt-5.6-solgrok-4.6Advantage
Capability67%60%+7% (gpt-5.6-sol leads)
Median task time4m 11s32m 10s27m 59s faster (gpt-5.6-sol leads)
Approx. task cost$0.010 / task$0.093 / task$0.083 / task lower (gpt-5.6-sol leads)

gpt-5.6-sol: 0.9% of ChatGPT Plus (0.9% / 1w) per run. grok-4.6: 5.4% of SuperGrok (5.4% / 1w) per run. Each figure is a share of that agent's own plan, so there is no delta to draw.

vibe-coding@v1CvsD
Dimensiongpt-5.6-solgrok-4.6Advantage
Capability56%46%+10% (gpt-5.6-sol leads)
Median task time3m 43s8m 23s4m 39s faster (gpt-5.6-sol leads)
Approx. task cost$0.011 / task$0.012 / task$0.000 / task lower (gpt-5.6-sol leads)

gpt-5.6-sol: 0.2% of ChatGPT Plus (0.2% / 1w) per good solve. grok-4.6: 0.2% of SuperGrok (0.2% / 1w) per good solve. Each figure is a share of that agent's own plan, so there is no delta to draw.

Grades and deltas are comparable only within a suite version. See methodology.

Frequently asked questions

Which is better for coding, gpt-5.6-sol or grok-4.6?

They are even on our ladder: both clear tier 4 of 5 at 60% capability on real-world@v3, our private suite of real-world coding problems. Latest measurement 2026-08-17.

How much do gpt-5.6-sol and grok-4.6 cost?

gpt-5.6-sol runs on ChatGPT Plus at $20/month (public price as of 2026-07-20). grok-4.6 runs on SuperGrok at $30/month (public price as of 2026-07-20).