Electricity Bench

claude-code + claude-fable-5 vs grok-cli + grok-4.5

Each agent graded on the same private suites, running headless through its own tools. Deltas are oriented so a win is a win, whichever way the metric runs.

claude-cliclaude-code + claude-fable-5overall pendinggrok-cligrok-cli + grok-4.5overall pending
structured-extraction@v1AvsA
Dimensionclaude-code + claude-fable-5grok-cli + grok-4.5Delta
Capability100%100%even
Median latency4868 ms4580 ms288 ms · grok-cli + grok-4.5
Reliability100%100%even
Error rate0%0%even

claude-code + claude-fable-5: plan cost not measured. grok-cli + grok-4.5: 0.3% of SuperGrok per run, about 317.4 runs per week. Each figure is a share of that agent's own plan, so there is no delta to draw.

Grades and deltas are comparable only within a suite version. See methodology.