2026-W36: Spec planning
Week 36 of 2026 graded 13 coding agents on spec planning. Claude Fable 5.1 leads with C+. The biggest move since W35 2026 is Claude Sonnet 5.5, D- to D+. Grades compare only within the same suite version, and plan usage is each agent's share of its own subscription.Measured
spec-planning@v1 - the suite key these grades compare within
Published suite snapshot for 13 graded agents, current through Sep 5, 2026.
Sorted by capability. Plan usage is each agent's share of its own named subscription and is not a cross-agent ranking. See the Spec planning methodology or each agent's scorecard for full context.
| Agent | Grade | Capability | Task time | Reliability | Plan usage |
|---|---|---|---|---|---|
| Claude Fable 5.1claude-code | C+ | 74.4% | 6m 51s | 100% | 60%/5hClaude Max 5x |
| GPT-6.1 Solcodex-cli | C+ | 73.7% | 4m 46s | 100% | 2.9%/1wChatGPT Plus |
| GPT-6 Astracodex-cli | C+ | 73.6% | 4m 0s | 100% | 5%/1wChatGPT Plus |
| Claude Opus 5.5claude-code | C+ | 70.4% | 5m 15s | 100% | 16%/5hClaude Max 5x |
| Grok 4.7grok-cli | C | 68.2% | 40m 6s | 100% | 2.0%/1wSuperGrok Plus |
| GPT-5.6 Terracodex-cli | C- | 61.1% | 2m 34s | 100% | 2.0%/1wChatGPT Plus |
| GPT-6 Lunacodex-cli | C- | 57.5% | 2m 19s | 100% | 0%/1wChatGPT Plus |
| Claude Sonnet 5.5claude-code | D+ | 52.6% | 3m 31s | 100% | 4%/5hClaude Max 5x |
| Composer 2.5cursor-cli | D+ | 49.1% | 1m 49s | 100% | 0.5%/1mCursor Pro |
| Kimi K3 256Kkimi-cli | D- | 41.1% | 6m 34s | 100% | 46%/5hKimi Allegretto |
| Gemini 3.8 Flashantigravity-cli | D- | 38.7% | 2m 39s | 100% | 1.9%/1wGoogle AI Pro |
| Claude Haiku 4.5claude-code | F | 24.7% | 2m 9s | 100% | 0%/5hClaude Max 5x |
| Gemini 3.1 Proantigravity-cli | F | 17.8% | 2m 21s | 100% | 1.2%/1wGoogle AI Pro |
This page publishes aggregate outcomes only. Task prompts and private checker logic never leave the benchmark. Follow this suite over time on Grades over time.