Electricity Bench

claude-code + claude-opus-4-8 vs codex-cli + gpt-5.6-terra

Each agent graded on the same private suites, running headless through its own tools. Deltas are oriented so a win is a win, whichever way the metric runs.

claude-cliclaude-code + claude-opus-4-8overall pendingcodex-clicodex-cli + gpt-5.6-terraoverall pending
structured-extraction@v1AvsA
Dimensionclaude-code + claude-opus-4-8codex-cli + gpt-5.6-terraDelta
Capability100%100%even
Median latency4752 ms5616 ms864 ms · claude-code + claude-opus-4-8
Reliability100%100%even
Error rate0%0%even

claude-code + claude-opus-4-8: 2.0% of Claude Max 5x per run, about 50.0 runs per 5h. codex-cli + gpt-5.6-terra: 0.1% of ChatGPT Plus per run, about 1527.2 runs per week. Each figure is a share of that agent's own plan, so there is no delta to draw.

Grades and deltas are comparable only within a suite version. See methodology.