claude-haiku-4-5 vs kimi-k3-256k
Each agent graded on the same private suites, running headless through its own tools. Advantages are oriented so a win is a win, whichever way the metric runs.
| Dimension | claude-haiku-4-5 | kimi-k3-256k | Advantage |
|---|---|---|---|
| Capability | 63% | 57% | +7% (claude-haiku-4-5 leads) |
| Median task time | 3m 58s | 3m 3s | 55s faster (kimi-k3-256k leads) |
| Approx. task cost | $0.005 / task | $0.018 / task | $0.013 / task lower (claude-haiku-4-5 leads) |
claude-haiku-4-5: 5.0% of Claude Max 20x (5.0% / 5h, 1.0% / 1w) per run. kimi-k3-256k: 99.0% of Kimi Allegretto (99.0% / 5h, 20.0% / 1w) per run. Each figure is a share of that agent's own plan, so there is no delta to draw.
Work per window: claude-haiku-4-5 2922 vs kimi-k3-256k 148 suite runs per month (claude-haiku-4-5 leads); per plan-dollar: 14.61 vs 3.78 (claude-haiku-4-5 leads). Work figures compare outputs, so unlike quota shares they are comparable across plans.
| Dimension | claude-haiku-4-5 | kimi-k3-256k | Advantage |
|---|---|---|---|
| Capability | 24% | 51% | +27% (kimi-k3-256k leads) |
| Median task time | 3m 4s | 5m 16s | 2m 12s faster (claude-haiku-4-5 leads) |
| Approx. task cost | $0.003 / task | $0.034 / task | $0.031 / task lower (claude-haiku-4-5 leads) |
claude-haiku-4-5: 1.0% of Claude Max 20x (1.0% / 5h) per run. kimi-k3-256k: 51.0% of Kimi Allegretto (51.0% / 5h, 10.0% / 1w) per run. Each figure is a share of that agent's own plan, so there is no delta to draw.
Work per window: claude-haiku-4-5 14610 vs kimi-k3-256k 286 suite runs per month (claude-haiku-4-5 leads); per plan-dollar: 73.05 vs 7.35 (claude-haiku-4-5 leads). Work figures compare outputs, so unlike quota shares they are comparable across plans.
| Dimension | claude-haiku-4-5 | kimi-k3-256k | Advantage |
|---|---|---|---|
| Capability | 23% | 38% | +15% (kimi-k3-256k leads) |
| Median task time | 4m 18s | 6m 37s | 2m 20s faster (claude-haiku-4-5 leads) |
| Approx. task cost | not measured | $0.027 / task | - |
claude-haiku-4-5: 0.0% of Claude Max 20x per good solve. kimi-k3-256k: 10.2% of Kimi Allegretto (10.2% / 5h, 2.0% / 1w) per good solve. Each figure is a share of that agent's own plan, so there is no delta to draw.
Grades and deltas are comparable only within a suite version. See methodology.
Frequently asked questions
Which is better for coding, claude-haiku-4-5 or kimi-k3-256k?
Both clear tier 2 of 5, but claude-haiku-4-5 scores higher on capability: 63% versus 57% on real-world@v3, our private suite of real-world coding problems. Latest measurement 2026-08-18.
Which gives more work per dollar, claude-haiku-4-5 or kimi-k3-256k?
claude-haiku-4-5 delivers more benchmark work per subscription dollar: 14.61 suite runs per plan-dollar versus 3.78 for kimi-k3-256k (at $200/month priced 2026-08-05, and $39/month priced 2026-07-20). Work figures compare outputs, so unlike raw quota shares they are comparable across plans.
How much do claude-haiku-4-5 and kimi-k3-256k cost?
claude-haiku-4-5 runs on Claude Max 20x at $200/month (public price as of 2026-08-05). kimi-k3-256k runs on Kimi Allegretto at $39/month (public price as of 2026-07-20).