Electricity Bench

Grades over time

Overall leads: each agent's score across every suite it has been graded on, one point per grading week. Switch to a single suite for its own line. Filter by provider or agent, click a point for the breakdown.

Overall is the capability mean across an agent's graded suites - the same rule the leaderboard's overall grade uses - with each suite contributing its latest reading, so a week that re-ran one suite moves the line by that suite's share of the mean rather than replacing it. The week a new suite joined the average is ruled off on the chart. Grades compare only within a suite version. Plan usage is each run's share of that agent's own subscription, as the provider reports it - the usage tab plots those shares side by side, but a percent of one plan is not a percent of another, so read it per agent, not as a ranking.

View

Real-world issues · Spec planning · Vibe coding · 12 agents · every suite counted, each contributing its latest grade

20%30%40%50%60%70%80%2026-W322026-W332026-W342026-W35+ vibe-coding+ spec-planningThe average counted a different set of suites either side of this segmentThe average counted a different set of suites either side of this segmentgemini-3.1-pro · 2026-W32 · Aug 5, 2026 · 47% · Dgemini-3.1-pro · 2026-W33 · Aug 11, 2026 · 34% · Fgemini-3.1-pro · 2026-W34 · Aug 17, 2026 · 34% · Fgemini-3.1-pro · 2026-W35 · Aug 24, 2026 · 38% · DThe average counted a different set of suites either side of this segmentThe average counted a different set of suites either side of this segmentgemini-3.7-flash · 2026-W32 · Aug 5, 2026 · 60% · Cgemini-3.7-flash · 2026-W33 · Aug 14, 2026 · 72% · Cgemini-3.7-flash · 2026-W34 · Aug 18, 2026 · 57% · Cgemini-3.7-flash · 2026-W35 · Aug 24, 2026 · 55% · CThe average counted a different set of suites either side of this segmentThe average counted a different set of suites either side of this segmentclaude-fable-5 · 2026-W32 · Aug 5, 2026 · 60% · Cclaude-fable-5 · 2026-W33 · Aug 11, 2026 · 72% · Cclaude-fable-5 · 2026-W34 · Aug 18, 2026 · 64% · Cclaude-fable-5 · 2026-W35 · Aug 24, 2026 · 68% · CThe average counted a different set of suites either side of this segmentThe average counted a different set of suites either side of this segmentclaude-haiku-4-5 · 2026-W32 · Aug 4, 2026 · 30% · Fclaude-haiku-4-5 · 2026-W33 · Aug 11, 2026 · 26% · Fclaude-haiku-4-5 · 2026-W34 · Aug 18, 2026 · 37% · Dclaude-haiku-4-5 · 2026-W35 · Aug 24, 2026 · 26% · FThe average counted a different set of suites either side of this segmentThe average counted a different set of suites either side of this segmentclaude-opus-5 · 2026-W32 · Aug 5, 2026 · 60% · Cclaude-opus-5 · 2026-W33 · Aug 11, 2026 · 50% · Dclaude-opus-5 · 2026-W34 · Aug 18, 2026 · 64% · Cclaude-opus-5 · 2026-W35 · Aug 24, 2026 · 60% · CThe average counted a different set of suites either side of this segmentThe average counted a different set of suites either side of this segmentclaude-sonnet-5 · 2026-W32 · Aug 4, 2026 · 33% · Fclaude-sonnet-5 · 2026-W33 · Aug 11, 2026 · 44% · Dclaude-sonnet-5 · 2026-W34 · Aug 18, 2026 · 41% · Dclaude-sonnet-5 · 2026-W35 · Aug 24, 2026 · 43% · DThe average counted a different set of suites either side of this segmentThe average counted a different set of suites either side of this segmentgpt-5.6-luna · 2026-W32 · Aug 4, 2026 · 47% · Dgpt-5.6-luna · 2026-W33 · Aug 11, 2026 · 51% · Dgpt-5.6-luna · 2026-W34 · Aug 17, 2026 · 49% · Dgpt-5.6-luna · 2026-W35 · Aug 24, 2026 · 53% · DThe average counted a different set of suites either side of this segmentThe average counted a different set of suites either side of this segmentgpt-5.6-sol · 2026-W32 · Aug 4, 2026 · 47% · Dgpt-5.6-sol · 2026-W33 · Aug 11, 2026 · 52% · Dgpt-5.6-sol · 2026-W34 · Aug 17, 2026 · 61% · Cgpt-5.6-sol · 2026-W35 · Aug 24, 2026 · 51% · DThe average counted a different set of suites either side of this segmentThe average counted a different set of suites either side of this segmentgpt-5.6-terra · 2026-W32 · Aug 4, 2026 · 28% · Fgpt-5.6-terra · 2026-W33 · Aug 11, 2026 · 48% · Dgpt-5.6-terra · 2026-W34 · Aug 17, 2026 · 57% · Cgpt-5.6-terra · 2026-W35 · Aug 24, 2026 · 44% · DThe average counted a different set of suites either side of this segmentThe average counted a different set of suites either side of this segmentcomposer-2.5 · 2026-W32 · Aug 4, 2026 · 57% · Ccomposer-2.5 · 2026-W33 · Aug 11, 2026 · 51% · Dcomposer-2.5 · 2026-W34 · Aug 17, 2026 · 48% · Dcomposer-2.5 · 2026-W35 · Aug 24, 2026 · 43% · DThe average counted a different set of suites either side of this segmentThe average counted a different set of suites either side of this segmentgrok-4.6 · 2026-W32 · Aug 4, 2026 · 60% · Cgrok-4.6 · 2026-W33 · Aug 13, 2026 · 66% · Cgrok-4.6 · 2026-W34 · Aug 18, 2026 · 55% · Cgrok-4.6 · 2026-W35 · Aug 23, 2026 · 61% · Ckimi-k3-256k · 2026-W34 · Aug 17, 2026 · 49% · Dkimi-k3-256k · 2026-W35 · Aug 24, 2026 · 43% · D

Dotted = the average counted a new suite from that week on. The step is the basis widening, not the agent moving; the ruled week names the suite that joined.

gemini-3.1-progemini-3.7-flashclaude-fable-5claude-haiku-4-5claude-opus-5claude-sonnet-5gpt-5.6-lunagpt-5.6-solgpt-5.6-terracomposer-2.5grok-4.6kimi-k3-256k

Weekly overall

One row per agent per grading week: the score across every suite it has been graded on, with the plan cost of a full pass. Click a row for the per-suite breakdown.

WeekAgentGradeOverallSuitesTask timeUsage
2026-W35claude-fable-5Cnow68%3 of 35m 22s46.4% of Claude Max 20x
2026-W35grok-4.6Cnow61%3 of 317m 10s9.1% of SuperGrok
2026-W35claude-opus-5Cnow60%3 of 35m 19s15.6% of Claude Max 20x
2026-W35gemini-3.7-flashCnow55%3 of 33m 15s10.4% of Google AI Pro
2026-W35gpt-5.6-lunaDnow53%3 of 32m 23s4.1% of ChatGPT Plus
2026-W35gpt-5.6-solDnow51%3 of 34m 2s4.7% of ChatGPT Plus
2026-W35gpt-5.6-terraDnow44%3 of 32m 22s3.2% of ChatGPT Plus
2026-W35composer-2.5Dnow43%3 of 32m 28s2.4% of Cursor Pro
2026-W35kimi-k3-256kDnow43%3 of 36m 13s214.4% of Kimi Allegretto
2026-W35claude-sonnet-5Dnow43%3 of 34m 35s7.8% of Claude Max 20x
2026-W35gemini-3.1-proDnow38%3 of 33m 29s11.1% of Google AI Pro
2026-W35claude-haiku-4-5Fnow26%3 of 33m 26s4.5% of Claude Max 20x
2026-W34claude-fable-5C64%3 of 34m 51s48.8% of Claude Max 20x
2026-W34claude-opus-5C64%3 of 34m 47s15.8% of Claude Max 20x
2026-W34gpt-5.6-solC61%3 of 33m 28s4.6% of ChatGPT Plus
2026-W34gemini-3.7-flashC57%3 of 33m 1s13.1% of Google AI Pro
2026-W34gpt-5.6-terraC57%3 of 32m 17s3.0% of ChatGPT Plus
2026-W34grok-4.6C55%3 of 315m 37s8.4% of SuperGrok
2026-W34gpt-5.6-lunaD49%3 of 32m 18s3.4% of ChatGPT Plus
2026-W34kimi-k3-256kD49%3 of 34m 59s160.2% of Kimi Allegretto
2026-W34composer-2.5D48%3 of 32m 36s2.5% of Cursor Pro
2026-W34claude-sonnet-5D41%3 of 34m 45s9.6% of Claude Max 20x
2026-W34claude-haiku-4-5D37%3 of 33m 46s6.0% of Claude Max 20x
2026-W34gemini-3.1-proF34%3 of 33m 15s10.1% of Google AI Pro
2026-W33gemini-3.7-flashC72%2 of 33m 1s9.7% of Google AI Pro
2026-W33claude-fable-5C72%2 of 34m 8s36.8% of Claude Max 20x
2026-W33grok-4.6C66%2 of 37m 9s17.0% of SuperGrok
2026-W33gpt-5.6-solD52%2 of 33m 15s3.1% of ChatGPT Plus
2026-W33gpt-5.6-lunaD51%2 of 32m 37s3.3% of ChatGPT Plus
2026-W33composer-2.5D51%2 of 34m 24s2.0% of Cursor Pro
2026-W33claude-opus-5D50%2 of 35m 27s12.2% of Claude Max 20x
2026-W33gpt-5.6-terraD48%2 of 32m 35s2.3% of ChatGPT Plus
2026-W33claude-sonnet-5D44%2 of 35m 14s10.1% of Claude Max 20x
2026-W33gemini-3.1-proF34%2 of 34m 29s8.7% of Google AI Pro
2026-W33claude-haiku-4-5F26%2 of 33m 41s3.5% of Claude Max 20x
2026-W32gemini-3.7-flashC60%1 of 32m 32s19.6% of Google AI Pro
2026-W32claude-fable-5C60%1 of 32m 49s30.5% of Claude Max 20x
2026-W32claude-opus-5C60%1 of 33m 43s16.0% of Claude Max 20x
2026-W32grok-4.6C60%1 of 34m 7s8.0% of SuperGrok
2026-W32composer-2.5C57%1 of 31m 57s1.7% of Cursor Pro
2026-W32gpt-5.6-lunaD47%1 of 31m 35s2.8% of ChatGPT Plus
2026-W32gemini-3.1-proD47%1 of 32m 31s16.8% of Google AI Pro
2026-W32gpt-5.6-solD47%1 of 33m 31s3.6% of ChatGPT Plus
2026-W32claude-sonnet-5F33%1 of 33m 48s8.8% of Claude Max 20x
2026-W32claude-haiku-4-5F30%1 of 33m 9s4.3% of Claude Max 20x
2026-W32gpt-5.6-terraF28%1 of 31m 26s1.4% of ChatGPT Plus