Electricity Bench

claude-haiku-4-5 vs composer-2.5

Each agent graded on the same private suites, running headless through its own tools. Advantages are oriented so a win is a win, whichever way the metric runs.

claude-haiku-4-5Clears tier 1 (partial tier 5) at 3.0% of Claude Max 20x per runFOVERALLcomposer-2.5Clears tier 4 (partial tier 5) at 1.9% of Cursor Pro per runCOVERALL
real-world@v3FvsC
Dimensionclaude-haiku-4-5composer-2.5Advantage
Capability28%60%+32% (composer-2.5 leads)
Median task time3m 31s3m 52s21s faster (claude-haiku-4-5 leads)
Approx. task cost$0.003 / task$0.025 / task$0.022 / task lower (claude-haiku-4-5 leads)

claude-haiku-4-5: 3.0% of Claude Max 20x (3.0% / 5h, 1.0% / 1w) per run. composer-2.5: 1.9% of Cursor Pro (1.9% / 1m) per run. Each figure is a share of that agent's own plan, so there is no delta to draw.

vibe-coding@v1FvsD
Dimensionclaude-haiku-4-5composer-2.5Advantage
Capability23%52%+28% (composer-2.5 leads)
Median task time3m 50s4m 56s1m 6s faster (claude-haiku-4-5 leads)
Approx. task cost$0.007 / task$0.025 / task$0.018 / task lower (claude-haiku-4-5 leads)

claude-haiku-4-5: 0.5% of Claude Max 20x (0.5% / 5h) per good solve. composer-2.5: 0.1% of Cursor Pro (0.1% / 1m) per good solve. Each figure is a share of that agent's own plan, so there is no delta to draw.

Grades and deltas are comparable only within a suite version. See methodology.

Frequently asked questions

Which is better for coding, claude-haiku-4-5 or composer-2.5?

composer-2.5 clears higher: tier 4 of 5 versus tier 1 for claude-haiku-4-5 on real-world@v3, our private suite of real-world coding problems. Latest measurement 2026-08-10.

How much do claude-haiku-4-5 and composer-2.5 cost?

claude-haiku-4-5 runs on Claude Max 20x at $200/month (public price as of 2026-08-05). composer-2.5 runs on Cursor Pro at $20/month (public price as of 2026-07-20).