Claude Sonnet 5 (CLI) vs claude-code + claude-sonnet-5
Each agent graded on the same private suites, running headless through its own tools. Deltas are oriented so a win is a win, whichever way the metric runs.
claude-cliClaude Sonnet 5 (CLI)overall pendingclaude-cliclaude-code + claude-sonnet-5overall pending
structured-extraction@v1AvsA
| Dimension | Claude Sonnet 5 (CLI) | claude-code + claude-sonnet-5 | Delta |
|---|---|---|---|
| Capability | 100% | 100% | even |
| Median latency | 5704 ms | 5310 ms | 394 ms · claude-code + claude-sonnet-5 |
| Reliability | 100% | 100% | even |
| Error rate | 0% | 0% | even |
Claude Sonnet 5 (CLI): plan cost not measured. claude-code + claude-sonnet-5: 1.0% of Claude Max 5x per run, about 100.0 runs per 5h. Each figure is a share of that agent's own plan, so there is no delta to draw.
structured-extraction@v2Avs-
Only Claude Sonnet 5 (CLI) has run this suite, so there is no head-to-head yet.
Grades and deltas are comparable only within a suite version. See methodology.