Electricity Bench

claude-haiku-4-5 vs composer-2.5

Each agent graded on the same private suites, running headless through its own tools. Advantages are oriented so a win is a win, whichever way the metric runs.

claude-haiku-4-5Clears tier 2 (partial tier 5) at 5.0% of Claude Max 20x per runDOVERALLcomposer-2.5Clears tier 2 (partial tier 5) at 1.8% of Cursor Pro per runDOVERALL
real-world@v3CvsC
Dimensionclaude-haiku-4-5composer-2.5Advantage
Capability63%57%+7% (claude-haiku-4-5 leads)
Median task time3m 58s1m 30s2m 27s faster (composer-2.5 leads)
Approx. task cost$0.005 / task$0.023 / task$0.019 / task lower (claude-haiku-4-5 leads)

claude-haiku-4-5: 5.0% of Claude Max 20x (5.0% / 5h, 1.0% / 1w) per run. composer-2.5: 1.8% of Cursor Pro (1.8% / 1m) per run. Each figure is a share of that agent's own plan, so there is no delta to draw.

Work per window: claude-haiku-4-5 2922 vs composer-2.5 57 suite runs per month (claude-haiku-4-5 leads); per plan-dollar: 14.61 vs 2.84 (claude-haiku-4-5 leads). Work figures compare outputs, so unlike quota shares they are comparable across plans.

spec-planning@v1FvsD
Dimensionclaude-haiku-4-5composer-2.5Advantage
Capability24%51%+27% (composer-2.5 leads)
Median task time3m 4s4m 30s1m 26s faster (claude-haiku-4-5 leads)
Approx. task cost$0.003 / task$0.029 / task$0.025 / task lower (claude-haiku-4-5 leads)

claude-haiku-4-5: 1.0% of Claude Max 20x (1.0% / 5h) per run. composer-2.5: 0.6% of Cursor Pro (0.6% / 1m) per run. Each figure is a share of that agent's own plan, so there is no delta to draw.

Work per window: claude-haiku-4-5 14610 vs composer-2.5 173 suite runs per month (claude-haiku-4-5 leads); per plan-dollar: 73.05 vs 8.66 (claude-haiku-4-5 leads). Work figures compare outputs, so unlike quota shares they are comparable across plans.

vibe-coding@v1FvsD
Dimensionclaude-haiku-4-5composer-2.5Advantage
Capability23%37%+14% (composer-2.5 leads)
Median task time4m 18s1m 51s2m 26s faster (composer-2.5 leads)
Approx. task costnot measured$0.024 / task-

claude-haiku-4-5: 0.0% of Claude Max 20x per good solve. composer-2.5: 0.1% of Cursor Pro (0.1% / 1m) per good solve. Each figure is a share of that agent's own plan, so there is no delta to draw.

Grades and deltas are comparable only within a suite version. See methodology.

Frequently asked questions

Which is better for coding, claude-haiku-4-5 or composer-2.5?

Both clear tier 2 of 5, but claude-haiku-4-5 scores higher on capability: 63% versus 57% on real-world@v3, our private suite of real-world coding problems. Latest measurement 2026-08-18.

Which gives more work per dollar, claude-haiku-4-5 or composer-2.5?

claude-haiku-4-5 delivers more benchmark work per subscription dollar: 14.61 suite runs per plan-dollar versus 2.84 for composer-2.5 (at $200/month priced 2026-08-05, and $20/month priced 2026-07-20). Work figures compare outputs, so unlike raw quota shares they are comparable across plans.

How much do claude-haiku-4-5 and composer-2.5 cost?

claude-haiku-4-5 runs on Claude Max 20x at $200/month (public price as of 2026-08-05). composer-2.5 runs on Cursor Pro at $20/month (public price as of 2026-07-20).