Gemma 4 31B (Reasoning) vs Claude Haiku 5.5 (xhigh)
Results updated 11 November 2026 · In Terminus-2 and Claude Code, so part of any gap can come from the harness · How we benchmark
Verdict
Claude Haiku 5.5 (xhigh) clearly beats Gemma 4 31B (Reasoning) by 21 points; Gemma 4 31B (Reasoning) is cheaper and faster.
- Cost per task
- $0.015 vs $0.017
- Time per task
- 2.1 min vs 2.5 min
- Tokens per attempt
- 93k vs 458k
- Image input
- Yes vs Yes
Claude Haiku 5.5 (xhigh), Claude Code scores higher than Gemma 4 31B (Reasoning), Terminus-2 on all 3 evaluations scored for both. Gemma 4 31B (Reasoning), Terminus-2 is cheaper and faster: $0.015 against $0.017 per task, and 2.1 min against 2.5 min.
Where they differ most
By kind of work, share of tasks passed, 0 to 100 · Higher is better
| Kind of work | Gemma 4 31B (Reasoning) | Claude Haiku 5.5 (xhigh) |
|---|---|---|
| GIS analysis | 56 | 82 |
| Climate and time series | 47 | 68 |
| Remote sensing and raster analysis | 59 | 78 |
| Making maps | 70 | 86 |
Where the tasks are set: each kind of work links to its tasks and scoresCharts for each: Gemma 4 31B (Reasoning), Terminus-2 · Claude Haiku 5.5 (xhigh), Claude Code.
Side by side
| Metric | Gemma 4 31B (Reasoning), Terminus-2 | Claude Haiku 5.5 (xhigh), Claude Code |
|---|---|---|
| Geospatial Agent Index: Text only | 55 | 76 |
| Geospatial Agent Index: Text + vision | No data | 77 |
| Earth-Bench V2 score | 44 | 68 |
| GeoBenchX score | 61 | 77 |
| GS-QA2 score | 61 | 81 |
| Vision agents score | No data | 80 |
| GeoAgentBench score (Guided workflows; not in the Agent Index) | 83 | 100 |
| GeoAnalystBench score (Guided workflows; not in the Agent Index) | 63 | 95 |
| OGD4All score (standalone; in no index) | 85 | 97 |
| GeoNatureAgent score (standalone; in no index) | 100 | 100 |
| MultiGlobeQA score (standalone; in no index) | 30 | 76 |
| GeoAgentEval score (standalone; in no index) | 88 | 92 |
| ImpactMesh score (standalone; in no index) | No data | No data |
| Remote sensing and raster analysis score | 59 | 78 |
| Change detection score | 52 | 64 |
| GIS analysis score | 56 | 82 |
| Climate and time series score | 47 | 68 |
| Making maps score | 70 | 86 |
| Cost per task | $0.015 | $0.017 |
| Time per task (at 100 output tokens/s) | 2.1 min | 2.5 min |
| Tokens per attempt | 93k | 458k |
| Turns per attempt | 9.0 | 9.6 |
| Input price per 1M tokens | $0.17 | $0.10 |
| Output price per 1M tokens | $0.40 | $0.50 |
| Context window | 262,144 | 1,000,000 |
| Image input | Yes | Yes |
| Developer | Anthropic |
Frequently asked questions
Which scores higher on the Geospatial Agent Index, Gemma 4 31B (Reasoning), Terminus-2 or Claude Haiku 5.5 (xhigh), Claude Code?
Claude Haiku 5.5 (xhigh), Claude Code, 76 to 55.
Which is cheaper per task, Gemma 4 31B (Reasoning), Terminus-2 or Claude Haiku 5.5 (xhigh), Claude Code?
Gemma 4 31B (Reasoning), Terminus-2, $0.015 to $0.017.
Which writes fewer output tokens per task, Gemma 4 31B (Reasoning), Terminus-2 or Claude Haiku 5.5 (xhigh), Claude Code?
Gemma 4 31B (Reasoning), Terminus-2, 8k to 12k.
Which has the larger context window, Gemma 4 31B (Reasoning), Terminus-2 or Claude Haiku 5.5 (xhigh), Claude Code?
Claude Haiku 5.5 (xhigh), Claude Code, 1,000,000 tokens to 262,144 tokens.