Electricity Bench

gpt-5.6-sol vs grok-4.6

Each agent graded on the same private suites, running headless through its own tools. Advantages are oriented so a win is a win, whichever way the metric runs.

gpt-5.6-solClears tier 4 (partial tier 5) at 2.8% of ChatGPT Plus per runCOVERALLgrok-4.6Clears tier 1 (partial tier 5) at 15.6% of SuperGrok per runCOVERALL
real-world@v3CvsC
Dimensiongpt-5.6-solgrok-4.6Advantage
Capability60%58%+2% (gpt-5.6-sol leads)
Median task time2m 57s6m 45s3m 48s faster (gpt-5.6-sol leads)
Approx. task cost$0.009 / task$0.072 / task$0.063 / task lower (gpt-5.6-sol leads)

gpt-5.6-sol: 2.8% of ChatGPT Plus (2.8% / 1w) per run. grok-4.6: 15.6% of SuperGrok (15.6% / 1w) per run. Each figure is a share of that agent's own plan, so there is no delta to draw.

vibe-coding@v1DvsB
Dimensiongpt-5.6-solgrok-4.6Advantage
Capability55%85%+30% (grok-4.6 leads)
Median task time3m 32s7m 33s4m 1s faster (gpt-5.6-sol leads)
Approx. task cost$0.012 / task$0.094 / task$0.081 / task lower (gpt-5.6-sol leads)

gpt-5.6-sol: 0.3% of ChatGPT Plus (0.3% / 1w) per good solve. grok-4.6: 1.4% of SuperGrok (1.4% / 1w) per good solve. Each figure is a share of that agent's own plan, so there is no delta to draw.

Grades and deltas are comparable only within a suite version. See methodology.

Frequently asked questions

Which is better for coding, gpt-5.6-sol or grok-4.6?

gpt-5.6-sol clears higher: tier 4 of 5 versus tier 1 for grok-4.6 on real-world@v3, our private suite of real-world coding problems. Latest measurement 2026-08-10.

How much do gpt-5.6-sol and grok-4.6 cost?

gpt-5.6-sol runs on ChatGPT Plus at $20/month (public price as of 2026-07-20). grok-4.6 runs on SuperGrok at $30/month (public price as of 2026-07-20).