codex-cli + gpt-5.6-sol vs codex-cli + gpt-5.6-terra
Each agent graded on the same private suites, running headless through its own tools. Deltas are oriented so a win is a win, whichever way the metric runs.
structured-extraction@v1AvsA
| Dimension | codex-cli + gpt-5.6-sol | codex-cli + gpt-5.6-terra | Delta |
|---|---|---|---|
| Capability | 100% | 100% | even |
| Median latency | 8165 ms | 5616 ms | 2549 ms · codex-cli + gpt-5.6-terra |
| Reliability | 100% | 100% | even |
| Error rate | 0% | 0% | even |
codex-cli + gpt-5.6-sol: 0.1% of ChatGPT Plus per run, about 1526.5 runs per week. codex-cli + gpt-5.6-terra: 0.1% of ChatGPT Plus per run, about 1527.2 runs per week. Each figure is a share of that agent's own plan, so there is no delta to draw.
Grades and deltas are comparable only within a suite version. See methodology.