gemini-3.1-pro vs claude-haiku-4-5
Each agent graded on the same private suites, running headless through its own tools. Advantages are oriented so a win is a win, whichever way the metric runs.
| Dimension | gemini-3.1-pro | claude-haiku-4-5 | Advantage |
|---|---|---|---|
| Capability | 47% | 28% | +18% (gemini-3.1-pro leads) |
| Median task time | 4m 24s | 3m 31s | 53s faster (claude-haiku-4-5 leads) |
| Approx. task cost | $0.025 / task | $0.003 / task | $0.022 / task lower (claude-haiku-4-5 leads) |
gemini-3.1-pro: 8.0% of Google AI Pro (48.1% / 5h, 8.0% / 1w) per run. claude-haiku-4-5: 3.0% of Claude Max 20x (3.0% / 5h, 1.0% / 1w) per run. Each figure is a share of that agent's own plan, so there is no delta to draw.
| Dimension | gemini-3.1-pro | claude-haiku-4-5 | Advantage |
|---|---|---|---|
| Capability | 25% | 23% | +2% (gemini-3.1-pro leads) |
| Median task time | 4m 34s | 3m 50s | 44s faster (claude-haiku-4-5 leads) |
| Approx. task cost | $0.032 / task | $0.007 / task | $0.025 / task lower (claude-haiku-4-5 leads) |
gemini-3.1-pro: 0.7% of Google AI Pro (4.2% / 5h, 0.7% / 1w) per good solve. claude-haiku-4-5: 0.5% of Claude Max 20x (0.5% / 5h) per good solve. Each figure is a share of that agent's own plan, so there is no delta to draw.
Grades and deltas are comparable only within a suite version. See methodology.
Frequently asked questions
Which is better for coding, gemini-3.1-pro or claude-haiku-4-5?
gemini-3.1-pro clears higher: tier 3 of 5 versus tier 1 for claude-haiku-4-5 on real-world@v3, our private suite of real-world coding problems. Latest measurement 2026-08-10.