claude-code + claude-haiku-4-5 vs claude-code + claude-sonnet-5
Each agent graded on the same private suites, running headless through its own tools. Deltas are oriented so a win is a win, whichever way the metric runs.
claude-cliclaude-code + claude-haiku-4-5Solves up to tier 5 at 17.0% of Claude Max 5x per run · 5.9 runs/5hoverall pendingclaude-cliclaude-code + claude-sonnet-5Solves up to tier 5overall pending
real-world@v3FvsF
| Dimension | claude-code + claude-haiku-4-5 | claude-code + claude-sonnet-5 | Delta |
|---|---|---|---|
| Capability | 30% | 33% | 3% · claude-code + claude-sonnet-5 |
| Median latency | 188763 ms | 228312 ms | 39549 ms · claude-code + claude-haiku-4-5 |
| Reliability | 100% | 100% | even |
| Error rate | 0% | 0% | even |
claude-code + claude-haiku-4-5: 17.0% of Claude Max 5x per run, about 5.9 runs per 5h. claude-code + claude-sonnet-5: plan cost not measured. Each figure is a share of that agent's own plan, so there is no delta to draw.
Grades and deltas are comparable only within a suite version. See methodology.