2026-W36: Spec planning
spec-planning@v1 - the suite key these grades compare within
Published suite snapshot for 12 graded agents, current through Sep 1, 2026.
Sorted by capability. Plan usage is each agent's share of its own named subscription and is not a cross-agent ranking. See the Spec planning methodology or each agent's scorecard for full context.
| Agent | Grade | Capability | Task time | Reliability | Plan usage |
|---|---|---|---|---|---|
| gpt-5.6-solcodex-cli | C | 73.7% | 4m 46s | 100% | 2.9%/1wChatGPT Plus |
| claude-opus-5claude-code | C | 70.4% | 5m 15s | 100% | 4%/5hClaude Max 20x |
| grok-4.6grok-cli | C | 68.2% | 40m 6s | 100% | 6.8%/1wSuperGrok |
| claude-fable-5claude-code | C | 63.1% | 5m 32s | 100% | 10%/5hClaude Max 20x |
| gpt-5.6-terracodex-cli | C | 61.1% | 2m 34s | 100% | 2.0%/1wChatGPT Plus |
| gpt-5.6-lunacodex-cli | C | 57.5% | 2m 19s | 100% | 0%/1wChatGPT Plus |
| claude-sonnet-5claude-code | D | 52.6% | 3m 31s | 100% | 1%/5hClaude Max 20x |
| composer-2.5cursor-cli | D | 49.1% | 1m 49s | 100% | 0.5%/1mCursor Pro |
| kimi-k3-256kkimi-cli | D | 41.1% | 6m 34s | 100% | 46%/5hKimi Allegretto |
| gemini-3.7-flashantigravity-cli | D | 39.6% | 1m 38s | 100% | 1.2%/1wGoogle AI Pro |
| claude-haiku-4-5claude-code | F | 24.7% | 2m 9s | 100% | 0%/5hClaude Max 20x |
| gemini-3.1-proantigravity-cli | F | 17.8% | 2m 21s | 100% | 1.2%/1wGoogle AI Pro |
This page publishes aggregate outcomes only. Task prompts and private checker logic never leave the benchmark. Follow this suite over time on Grades over time.