2026-W33: Vibe coding
vibe-coding@v1 - the suite key these grades compare within
Published suite snapshot for 11 graded agents, current through Aug 11, 2026.
Sorted by capability. Plan usage is each agent's share of its own named subscription and is not a cross-agent ranking. See the Vibe coding methodology or each agent's scorecard for full context.
| Agent | Grade | Capability | Clears | Task time | Reliability | Plan usage |
|---|---|---|---|---|---|---|
| claude-fable-5claude-code | B | 84.5% | level 3 · partial level 5 | 5m 11s | 100% | 2.8%/5hClaude Max 20x |
| gemini-3.6-flashantigravity-cli | C | 71.6% | level 2 · partial level 5 | 1m 54s | 100% | 0.8%/1wGoogle AI Pro |
| grok-4.5grok-cli | C | 58.7% | level 2 · partial level 5 | 3m 40s | 100% | 0.4%/1wSuperGrok |
| gpt-5.6-lunacodex-cli | C | 56.1% | level 1 · partial level 5 | 2m 59s | 100% | 0.3%/1wChatGPT Plus |
| gpt-5.6-solcodex-cli | D | 54.8% | level 1 · partial level 5 | 3m 32s | 100% | 0.3%/1wChatGPT Plus |
| claude-opus-5claude-code | D | 53.5% | level 3 · partial level 5 | 6m 57s | 100% | 1.2%/5hClaude Max 20x |
| gpt-5.6-terracodex-cli | D | 52.3% | level 1 · partial level 5 | 3m 12s | 100% | 0.2%/1wChatGPT Plus |
| composer-2.5cursor-cli | D | 51.6% | none | 4m 56s | 100% | 0.1%/1mCursor Pro |
| claude-sonnet-5claude-code | D | 36.8% | level 1 · partial level 5 | 5m 21s | 100% | 0.4%/5hClaude Max 20x |
| gemini-3.1-proantigravity-cli | F | 25.2% | none | 4m 34s | 100% | 0.7%/1wGoogle AI Pro |
| claude-haiku-4-5claude-code | F | 23.2% | none | 3m 50s | 100% | 0.5%/5hClaude Max 20x |
This page publishes aggregate outcomes only. Task prompts and private checker logic never leave the benchmark. Follow this suite over time on Grades over time.