2026-W37: Vibe coding
Week 37 of 2026 graded 13 coding agents on vibe coding. GPT-6 Astra leads with C+. The biggest move since W36 2026 is Claude Haiku 4.5, D- to F. Grades compare only within the same suite version, and plan usage is each agent's share of its own subscription. Every agent ran the same suite cut headless through its own tools.Measured
vibe-coding@v1 - the suite key these grades compare within
Published suite snapshot for 13 graded agents, current through Sep 7, 2026.
Sorted by capability. Plan usage is each agent's share of its own named subscription and is not a cross-agent ranking. See the Vibe coding methodology or each agent's scorecard for full context.
| Agent | Grade | Capability | Clears | Task time | Reliability | Plan usage |
|---|---|---|---|---|---|---|
| GPT-6 Astracodex-cli | C+ | 74.2% | level 3 · partial level 5 | 3m 0s | 100% | 0%/1wChatGPT Plus |
| Claude Fable 5.1claude-code | C+ | 69.0% | level 3 · partial level 5 | 3m 25s | 100% | 11.2%/5hClaude Max 5x |
| Claude Opus 5.5claude-code | C+ | 69.0% | level 3 · partial level 5 | 5m 48s | 100% | 3.2%/5hClaude Max 5x |
| Gemini 3.8 Flashantigravity-cli | C- | 56.1% | level 2 · partial level 5 | 6m 2s | 100% | 0.9%/1wGoogle AI Pro |
| Grok 4.7grok-cli | D+ | 53.5% | level 3 · partial level 5 | 11m 26s | 100% | 0.1%/1wSuperGrok Plus |
| GPT-6.1 Solcodex-cli | D+ | 48.4% | level 3 · partial level 5 | 3m 45s | 100% | 0%/1wChatGPT Plus |
| GPT-5.6 Terracodex-cli | D | 45.8% | level 2 · partial level 5 | 3m 1s | 100% | 1%/1wChatGPT Plus |
| Kimi K3 256Kkimi-cli | D- | 38.1% | level 2 · partial level 5 | 7m 42s | 100% | 10.6%/5hKimi Allegretto |
| Composer 2.5cursor-cli | D- | 36.8% | level 1 · partial level 5 | 2m 6s | 100% | 0.1%/1mCursor Pro |
| GPT-6 Lunacodex-cli | F | 34.2% | level 1 · partial level 5 | 3m 26s | 100% | 0%/1wChatGPT Plus |
| Claude Sonnet 5.5claude-code | F | 31.6% | level 1 · partial level 5 | 4m 31s | 100% | 2.4%/5hClaude Max 5x |
| Gemini 3.1 Proantigravity-cli | F | 23.2% | none | 5m 16s | 100% | 1.1%/1wGoogle AI Pro |
| Claude Haiku 4.5claude-code | F | 21.3% | none | 5m 0s | 100% | 1.6%/5hClaude Max 5x |
This page publishes aggregate outcomes only. Task prompts and private checker logic never leave the benchmark. Follow this suite over time on Grades over time.