Electricity Bench

GPT-5.6 Sol vs Grok 4.7

GPT-5.6 Sol is no longer on the leaderboard. The grades below are the last ones measured, so read them as history rather than as this week's board. See the current roster.

Both grade C- overall. GPT-5.6 Sol is about 4.0x cheaper per task. By suite, GPT-5.6 Sol takes real-world issues (C- to D) and spec planning (C+ to C). Both agents run the same private suite cut headless through their own tools, each on its own subscription.Measured

Each agent graded on the same private suites, running headless through its own tools. Advantages are oriented so a win is a win, whichever way the metric runs.

Verdict: Grok 4.7 vs GPT-5.6 Sol

Both grade C- overall. By suite: GPT-5.6 Sol takes real-world issues, C- to D (60% vs 47% capability); GPT-5.6 Sol takes spec planning, C+ to C (68% vs 68% capability); Grok 4.7 takes vibe coding, C to D+ (64% vs 51% capability). GPT-5.6 Sol used 3% of ChatGPT Pro 5x's weekly limit per pass, $0.036 per task at the listed price. Grok 4.7 used 12% of SuperGrok Plus's weekly limit per pass, $0.145 per task at the listed price. Per task, GPT-5.6 Sol is about 4.0x cheaper ($0.036 vs $0.145). GPT-5.6 Sol is faster on real-world issues: a median task takes 3m 13s against 6m 57s. Both finished every task on it.

Changed since W38: GPT-5.6 Sol: vibe coding C- to D+; Grok 4.7 has one graded week under this version (W39).

GPT-5.6 SolClears tier 4 (partial tier 5) at 2.0% of ChatGPT Pro 5x per runC-OVERALLGrok 4.7Clears tier 4 (partial tier 5) at 5.0% of SuperGrok Plus per runC-OVERALL
real-world@v3C-vsD
DimensionGPT-5.6 SolGrok 4.7Advantage
Capability60%47%+13% (GPT-5.6 Sol leads)
Median task time3m 13s6m 57s3m 44s faster (GPT-5.6 Sol leads)
Approx. task cost$0.031 / task$0.077 / task$0.046 / task lower (GPT-5.6 Sol leads)

GPT-5.6 Sol: 2.0% of ChatGPT Pro 5x (2.0% / 1w) per run. Grok 4.7: 5.0% of SuperGrok Plus (5.0% / 1w) per run. Each figure is a share of that agent's own plan, so there is no delta to draw.

spec-planning@v1C+vsC
DimensionGPT-5.6 SolGrok 4.7Advantage
Capability68%68%+0% (GPT-5.6 Sol leads)
Median task time6m 0s37m 24s31m 25s faster (GPT-5.6 Sol leads)
Approx. task cost$0.057 / task$0.402 / task$0.345 / task lower (GPT-5.6 Sol leads)

GPT-5.6 Sol: 1.0% of ChatGPT Pro 5x (1.0% / 1w) per run. Grok 4.7: 7.0% of SuperGrok Plus (7.0% / 1w) per run. Each figure is a share of that agent's own plan, so there is no delta to draw.

vibe-coding@v1D+vsC
DimensionGPT-5.6 SolGrok 4.7Advantage
Capability51%64%+13% (Grok 4.7 leads)
Median task time3m 56s11m 10s7m 14s faster (GPT-5.6 Sol leads)
Approx. task cost$0.092 / task$0.092 / taskEven

GPT-5.6 Sol: 0.4% of ChatGPT Pro 5x (0.4% / 1w) per good solve. Grok 4.7: 0.4% of SuperGrok Plus (0.4% / 1w) per good solve. Each figure is a share of that agent's own plan, so there is no delta to draw.

Grades and deltas are comparable only within a suite version. See methodology.

Frequently asked questions

Which is better for coding, GPT-5.6 Sol or Grok 4.7?

Both clear tier 4 of 5, but GPT-5.6 Sol scores higher on capability: 60% versus 47% on real-world@v3, our private suite of real-world coding problems. Latest measurement 2026-09-21.

Which is cheaper per task, GPT-5.6 Sol or Grok 4.7?

GPT-5.6 Sol used 3% of ChatGPT Pro 5x's weekly limit per pass, $0.036 per task at the listed price. Grok 4.7 used 12% of SuperGrok Plus's weekly limit per pass, $0.145 per task at the listed price. Per task, GPT-5.6 Sol is about 4.0x cheaper ($0.036 vs $0.145).

What do GPT-5.6 Sol and Grok 4.7 cost a month?

GPT-5.6 Sol runs on ChatGPT Pro 5x at $100/month (public price as of 2026-09-05). Grok 4.7 runs on SuperGrok Plus at $100/month (public price as of 2026-09-14).