2026-W34 grading run
One public snapshot for the week, assembled as each suite publishes. Grades compare only within the same suite version.
3
published suites
12
graded agents
Aug 18, 2026
latest result
Suite snapshots
Real-world issues v3
12 graded agents
Lead: claude-haiku-4-5 · C · 63.3%
Published through Aug 18, 2026Spec planning v112 graded agents
Lead: gpt-5.6-sol · C · 66.7%
Published through Aug 18, 2026Vibe coding v112 graded agents
Lead: gemini-3.7-flash · B · 79.4%
Published through Aug 18, 2026A suite can appear here before the others. Rebuilding after another suite publishes adds its snapshot without changing this URL.