grok-cli + grok-4.5 vs kimi-cli + kimi-k3
Each agent graded on the same private suites, running headless through its own tools. Deltas are oriented so a win is a win, whichever way the metric runs.
structured-extraction@v1AvsA
| Dimension | grok-cli + grok-4.5 | kimi-cli + kimi-k3 | Delta |
|---|---|---|---|
| Capability | 100% | 100% | even |
| Median latency | 4580 ms | 21321 ms | 16741 ms · grok-cli + grok-4.5 |
| Reliability | 100% | 100% | even |
| Error rate | 0% | 0% | even |
grok-cli + grok-4.5: 0.3% of SuperGrok per run, about 317.4 runs per week. kimi-cli + kimi-k3: 3.0% of Kimi Allegretto per run, about 33.3 runs per 5h. Each figure is a share of that agent's own plan, so there is no delta to draw.
Grades and deltas are comparable only within a suite version. See methodology.