News
Agent scorecards, suite releases, and grading-run announcements. Also available as an RSS feed.
Claude Fable 5 keeps the lead - Week 35 AI agent resultsA quiet week: Claude Fable 5 stays the agent to beat, Gemini 3.7 Flash takes the real-world top spot, Grok 4.6 gets slower, and Kimi K3 burns more quota.Claude Fable 5 leads Week 34 as spec-planning debutsA new suite tests whether agents can plan before they code, Kimi K3 joins the board, and Claude Fable 5 leads by having no weak spot.Gemini 3.7 Flash: more capability for less quotaGemini 3.7 Flash solves more real-world tasks than 3.6 Flash and uses less Google AI Pro quota - but it takes longer.New suite: spec-planning - did the spec see the bug coming?There is a new suite on the bench: spec-planning. It measures something none of our other suites do: can a coding agent look at a real codebase, read a big...Grok 4.6, released today, ties Fable 5 for the vibe-coding leadxAI's Grok 4.6 shipped and graded the same day: it ties Claude Fable 5 for the vibe-coding lead, doubling Grok 4.5's task time and quota burn along the way.Claude Fable 5 leads vibe-coding - Week 33 AI agent resultsEleven coding agents across five harnesses faced real-world and vibe-coding suites; Claude Fable 5 shared the real-world lead and won vibe-coding.New suite: vibe-coding - how much of a bug fix is the bug report?We cut a new private suite today: vibe-coding. It grades something none of our other suites isolate: how well a coding agent fixes a real bug as the bug...Week 2026-W32 on the bench: the first grading run, 10 coding agents on real subscriptionsThe leaderboard now shows what it was built to show: real agent harnesses, on the subscriptions people actually pay for, graded on the same private task...Introducing Electricity BenchThe launch post, with an August 2026 note on how the bench narrowed to coding agents graded on the subscription plans you would actually buy.Why honest numbers are hardWhy publishing a fair number is harder than it looks, with an August 2026 note on how the graded path changed to the complete agent on its own plan.How we gradeHow a grade rolls up on Electricity Bench, with an August 2026 note on what changed: the subject is the whole coding agent, and cost is a share of its own plan.