Electricity Bench

claude-code + claude-haiku-4-5 vs cursor-cli + composer-2.5 (Cursor Pro)

Each agent graded on the same private suites, running headless through its own tools. Deltas are oriented so a win is a win, whichever way the metric runs.

claude-cliclaude-code + claude-haiku-4-5Solves up to tier 5 at 17.0% of Claude Max 5x per run · 5.9 runs/5hoverall pendingcursor-clicursor-cli + composer-2.5 (Cursor Pro)Solves up to tier 5 at 1.7% of Cursor Pro per run · 60.2 runs/monthoverall pending
real-world@v3FvsC
Dimensionclaude-code + claude-haiku-4-5cursor-cli + composer-2.5 (Cursor Pro)Delta
Capability30%57%27% · cursor-cli + composer-2.5 (Cursor Pro)
Median latency188763 ms117231 ms71532 ms · cursor-cli + composer-2.5 (Cursor Pro)
Reliability100%100%even
Error rate0%0%even

claude-code + claude-haiku-4-5: 17.0% of Claude Max 5x per run, about 5.9 runs per 5h. cursor-cli + composer-2.5 (Cursor Pro): 1.7% of Cursor Pro per run, about 60.2 runs per month. Each figure is a share of that agent's own plan, so there is no delta to draw.

Grades and deltas are comparable only within a suite version. See methodology.