Grok 4.5
grok-cli harness · SuperGrok ($30/mo)
Coding agent review, updated weekly (latest W40 2026).
Grok 4.5 scores C- overall on Electricity Bench and clears tier 4 of 5 on real-world issues. Its best suite is vibe coding at C-. One pass of our task set uses 6.9% of SuperGrok's weekly limit. Every grade comes from private tasks the agent has not seen, run headless on the subscription you would actually buy.Measured
No longer on the leaderboard. These grades stay published as the record of what this agent scored while it ran.
Clears tier 4 of 5 (partial at tier 5) on Real-world issues
Capability mean across 2 graded suite families.
What the tiers mean
"Clears" marks the highest rung where every task at it and below was solved. Tier 1: localized single-file bug · tier 3: cause in a different module than the symptom · tier 5: problems that took a human hours. A cleared rung solved every task on it; a partial rung solved some. The headline stops at the last unbroken rung, so a solved tier above a half-solved one counts only as partial.
What the levels mean
Level 1: a full brief naming the surface and the acceptance · level 3: the report as filed · level 5: a vague vibe report in a non-technical user's words. Context falls as the level rises, so vaguer is harder. A cleared level fixed every bug at it and below; a partial level fixed some. The headline stops at the last unbroken level, so a fix above a half-cleared level counts only as partial.
8 of this suite's tasks were credited rather than run: on a suite that asks the same problem at several levels of detail, solving it from the vaguest description credits the more detailed ones instead of asking again.
Per-suite results
12 of 15 tasks solved - grouped by tier, easiest first; hover a square for its time and turns.
Run on grok-cli grok 0.2.101 (5bc4b5dfad), model grok-4.5 (reasoning-effort high), week 2026-W33.
One run of this suite consumes 6.9% of SuperGrok.
How the plan cost was measured
Measured per suite run (estimated-from-telemetry); an absolute cost on this plan, not comparable with another agent's plan. Measured on a shared personal subscription during a quiet window, not a dedicated bench login.
19 of 25 tasks solved (8 credited without running) - each row is one bug, vaguest report first and context growing to the right; hover a square for its time and turns.
Run on grok-cli grok 0.2.101 (5bc4b5dfad), model grok-4.5 (reasoning-effort high), week 2026-W33.
One good solve on this suite consumes 0.4% of SuperGrok on average.
How the plan cost was measured
Counted over each issue's first solve (5 solves); the walk's failed harder cells and confirmation runs are the benchmark's own search cost and are excluded (full walk: 7.7% over 17 cells). Measured per cell run (estimated-from-telemetry); an absolute cost on this plan, not comparable with another agent's plan. Measured on a shared personal subscription during a quiet window, not a dedicated bench login.
Task outputs from these runs are withheld: publishing them would reveal the private suite. Per-task scores, times and turns are in the chips above.
Trajectory
One point per grading week - a re-run within a week shows only its latest execution. Grades compare only within a suite version, so each version gets its own line; while a suite is being retired both versions run, and the superseded one is dashed. The filled point is the run the scorecard shows today. Click a point or week for plan usage. All agents over time →
Weekly heads
Newest week first. Click a row for usage.
| Week | Grade | Capability | Usage /1w |
|---|---|---|---|
| 2026-W33 · v3now | C- | 60% | 6.9% |
| 2026-W32 · v3 | C- | 60% | 8.0% |
Frequently asked questions
Is Grok 4.5 worth it on SuperGrok?
On our private real-world suite (real-world@v3), Grok 4.5 earned grade C- with 60% capability, clearing every problem up to tier 4 of 5 - a cross-cutting problem needing broad codebase orientation and landing some tier 5 problems. It runs on SuperGrok at $30/month (public price as of 2026-07-20). One full suite run consumed 6.9% of the plan's week window. Measured 2026-08-10.
Is Grok 4.5 good for coding?
Grok 4.5 clears tier 4 of our five-tier real-world ladder - every task at that tier and below - where tier 1 is a localized single-file bug and tier 5 is a problem that took a human engineer hours. It solves some but not all tasks up at tier 5. Its capability score on real-world@v3 is 60% (grade C-). Last benchmarked 2026-08-10.
How much of SuperGrok does one Grok 4.5 task use?
One full suite run consumed 6.9% of SuperGrok's weekly limit, read off the provider's own meter before and after the run. A benchmark task is a whole multi-turn agent session, not a message, and the share belongs to this plan alone: it is not comparable with another agent's plan. Measured 2026-08-10.
Compare
- Grok 4.5 vs Gemini 3.1 Pro
- Grok 4.5 vs Gemini 3.6 Flash
- Grok 4.5 vs Gemini 3.7 Flash
- Grok 4.5 vs Gemini 3.8 Flash
- Grok 4.5 vs Claude Fable 5.1
- Grok 4.5 vs Claude Fable 5
- Grok 4.5 vs Claude Haiku 4.5
- Grok 4.5 vs Claude Opus 5.5
- Grok 4.5 vs Claude Opus 5
- Grok 4.5 vs Claude Sonnet 5.5
- Grok 4.5 vs Claude Sonnet 5
- Grok 4.5 vs GPT-5.6 Luna
- Grok 4.5 vs GPT-5.6 Sol
- Grok 4.5 vs GPT-5.6 Terra
- Grok 4.5 vs GPT-6.1 Sol
- Grok 4.5 vs GPT-6 Astra
- Grok 4.5 vs GPT-6 Luna
- Grok 4.5 vs GPT-6 Sol
- Grok 4.5 vs Composer 2.5
- Grok 4.5 vs Grok 4.6
- Grok 4.5 vs Grok 4.7
- Grok 4.5 vs Kimi K3 256K