Electricity Bench

← All comparisons

Claude Sonnet 5 (CLI) vs kimi-cli + kimi-k3

Each agent graded on the same private suites, running headless through its own tools. Deltas are oriented so a win is a win, whichever way the metric runs.

claude-cliClaude Sonnet 5 (CLI)overall pendingkimi-clikimi-cli + kimi-k3overall pending
structured-extraction@v1AvsA
DimensionClaude Sonnet 5 (CLI)kimi-cli + kimi-k3Delta
Capability100%100%even
Median latency5704 ms21321 ms15617 ms · Claude Sonnet 5 (CLI)
Reliability100%100%even
Error rate0%0%even

Claude Sonnet 5 (CLI): plan cost not measured. kimi-cli + kimi-k3: 3.0% of Kimi Allegretto per run, about 33.3 runs per 5h. Each figure is a share of that agent's own plan, so there is no delta to draw.

structured-extraction@v2Avs-

Only Claude Sonnet 5 (CLI) has run this suite, so there is no head-to-head yet.

Grades and deltas are comparable only within a suite version. See methodology.