2026-W33: Real-world issues
Week 33 of 2026 graded 11 coding agents on real-world issues. Gemini 3.8 Flash leads with C+. The biggest move since W32 2026 is GPT-5.6 Terra, F to D+. Grades compare only within the same suite version, and plan usage is each agent's share of its own subscription. Every agent ran the same suite cut headless through its own tools.Measured
real-world@v3 - the suite key these grades compare within
Published suite snapshot for 11 graded agents, current through Aug 13, 2026.
Sorted by capability. Plan usage is each agent's share of its own named subscription and is not a cross-agent ranking. See the Real-world issues methodology or each agent's scorecard for full context.
| Agent | Grade | Capability | Clears | Task time | Reliability | Plan usage |
|---|---|---|---|---|---|---|
| Gemini 3.8 Flashantigravity-cli | C+ | 73.3% | tier 4 · partial tier 5 | 2m 25s | 100% | 9.0%/1wGoogle AI Pro |
| Claude Fable 5.1claude-code | C- | 60.0% | tier 4 · partial tier 5 | 3m 5s | 100% | 136%/5hClaude Max 5x |
| GPT-6 Solcodex-cli | C- | 60.0% | tier 4 · partial tier 5 | 2m 57s | 100% | 9.0%/1wChatGPT Plus |
| Composer 2.5cursor-cli | C- | 60.0% | tier 4 · partial tier 5 | 3m 52s | 100% | 1.9%/1mCursor Pro |
| Grok 4.6grok-cli | C- | 58.3% | tier 1 · partial tier 5 | 6m 45s | 100% | 4.7%/1wSuperGrok Plus |
| Claude Opus 5.5claude-code | C- | 56.7% | tier 2 · partial tier 5 | 3m 57s | 100% | 44%/5hClaude Max 5x |
| Claude Sonnet 5claude-code | D+ | 53.3% | tier 3 · partial tier 5 | 5m 6s | 100% | 38.9%/5hClaude Max 5x |
| GPT-5.6 Terracodex-cli | D+ | 53.3% | tier 3 · partial tier 5 | 1m 57s | 100% | 1.3%/1wChatGPT Pro 5x |
| GPT-6 Lunacodex-cli | D+ | 50.8% | none | 2m 15s | 100% | 0.8%/1wChatGPT Plus |
| Gemini 3.1 Proantigravity-cli | D | 46.7% | tier 3 · partial tier 5 | 4m 24s | 100% | 8.0%/1wGoogle AI Pro |
| Claude Haiku 4.5claude-code | F | 28.3% | tier 1 · partial tier 5 | 3m 31s | 100% | 12%/5hClaude Max 5x |
This page publishes aggregate outcomes only. Task prompts and private checker logic never leave the benchmark. Follow this suite over time on Grades over time.