Electricity Bench

2026-W36: Vibe coding

Week 36 of 2026 graded 13 coding agents on vibe coding. Claude Fable 5.1 leads with B. The biggest move since W35 2026 is Claude Haiku 4.5, F to D-. Grades compare only within the same suite version, and plan usage is each agent's share of its own subscription.Measured

vibe-coding@v1 - the suite key these grades compare within

Published suite snapshot for 13 graded agents, current through Sep 5, 2026.

Sorted by capability. Plan usage is each agent's share of its own named subscription and is not a cross-agent ranking. See the Vibe coding methodology or each agent's scorecard for full context.

AgentGradeCapabilityClearsTask timeReliabilityPlan usage
Claude Fable 5.1claude-codeB84.5%level 3 · partial level 53m 48s100%7.2%/5hClaude Max 5x
Claude Opus 5.5claude-codeC+69.0%level 3 · partial level 55m 16s100%3.2%/5hClaude Max 5x
GPT-6 Astracodex-cliC-61.3%level 2 · partial level 52m 54s100%1%/1wChatGPT Plus
GPT-6.1 Solcodex-cliC-56.1%level 2 · partial level 56m 12s100%0.7%/1wChatGPT Plus
Kimi K3 256Kkimi-cliD+54.8%level 1 · partial level 56m 25s100%11%/5hKimi Allegretto
Gemini 3.8 Flashantigravity-cliD+52.3%level 1 · partial level 57m 7s100%1.0%/1wGoogle AI Pro
GPT-6 Lunacodex-cliD+51.0%level 2 · partial level 52m 49s100%0.1%/1wChatGPT Plus
Grok 4.7grok-cliD45.8%level 2 · partial level 58m 41s100%0.1%/1wSuperGrok Plus
Gemini 3.1 Proantigravity-cliD-40.0%none4m 8s100%0.7%/1wGoogle AI Pro
Claude Haiku 4.5claude-codeD-40.0%none4m 33s100%0.8%/5hClaude Max 5x
Composer 2.5cursor-cliF34.8%none2m 14s100%0.1%/1mCursor Pro
Claude Sonnet 5.5claude-codeF34.2%level 1 · partial level 54m 50s100%0.8%/5hClaude Max 5x
GPT-5.6 Terracodex-cliF29.0%level 1 · partial level 52m 44s100%0.5%/1wChatGPT Plus

This page publishes aggregate outcomes only. Task prompts and private checker logic never leave the benchmark. Follow this suite over time on Grades over time.