Claude Code – Claude Sonnet 5.5 (medium) vs. Claude Code – Claude Haiku 5.5 (medium): geospatial agent comparison
Comparison between Claude Code – Claude Sonnet 5.5 (medium) and Claude Code – Claude Haiku 5.5 (medium) on the Geospatial Agent Index, each benchmark, cost, time and token use, from the same tasks, agent and limits. Methodology.
Side by side
| Metric | Claude Code – Claude Sonnet 5.5 (medium) | Claude Code – Claude Haiku 5.5 (medium) |
|---|---|---|
| Geospatial Agent Index | 77* (partial: 2 of 3 attempts) | 77* (partial: 1.8 of 3 attempts) |
| GeoAgentBench score | 98 | 98 |
| GeoBenchX score | 66 | 61 |
| Earth-Bench score | 45 | 53 |
| GeoAnalystBench score | 97 | 95 |
| Raster and remote sensing score | 70 | 70 |
| Vector and overlay score | 81 | 81 |
| Networks and routing score | 100 | 100 |
| Climate and time series score | 65 | 77 |
| Spatial statistics and interpolation score | 79 | 65 |
| Mapping and cartography score | 78 | 74 |
| Recognising infeasible requests score | 59 | 55 |
| Cost per task | $0.052 | $0.0075 |
| Time per task | 0.6 min | 0.8 min |
| Tokens per attempt | 72k | 235k |
| Turns per attempt | 3.7 | 6.4 |
| Attempts decided | 500 | 462 |
| Input price per 1M tokens | $2.00 | $0.10 |
| Output price per 1M tokens | $10.00 | $0.50 |
| Context window | No data | No data |
| Image input | No data | No data |
| Developer | Anthropic | Anthropic |
Charts
Geospatial Agent Index
Equal-weight average of the evaluation scores, 0 to 100 · Higher is better
First eight selected entries in metric order. Full results in table view.
Data table: Geospatial Agent Index
| Model | Creator | Geospatial Agent Index | Range while attempts are pending | Benchmarks covered | Coverage (attempts) |
|---|---|---|---|---|---|
| Claude Code – Claude Haiku 5.5 (medium) | Anthropic | 77* (partial: 1.8 of 3 attempts) | 66 to 78 | 4 of 4 | 462 of 870 planned attempts |
| Claude Code – Claude Sonnet 5.5 (medium) | Anthropic | 77* (partial: 2 of 3 attempts) | 67 to 77 | 4 of 4 | 500 of 870 planned attempts (229 excluded) |
Claude Code – Claude Haiku 5.5 (medium)Cost per task
Average cost per task (USD) · Lower is better
First eight selected entries in metric order. Full results in table view.
Data table: Cost per task
| Model | Creator | Cost per task | Coverage (attempts) |
|---|---|---|---|
| Claude Code – Claude Sonnet 5.5 (medium) | Anthropic | $0.052 | 568 of 870 planned attempts (229 excluded) |
| Claude Code – Claude Haiku 5.5 (medium) | Anthropic | $0.0075 | 524 of 870 planned attempts |
Time per task
Average agent wall time per task · Lower is better
First eight selected entries in metric order. Full results in table view.
Data table: Time per task
| Model | Creator | Time per task | Coverage (attempts) |
|---|---|---|---|
| Claude Code – Claude Sonnet 5.5 (medium) | Anthropic | 0.6 min | 568 of 870 planned attempts (229 excluded) |
| Claude Code – Claude Haiku 5.5 (medium) | Anthropic | 0.8 min | 524 of 870 planned attempts |
Frequently asked questions
- Which scores higher on the Geospatial Agent Index, Claude Code – Claude Sonnet 5.5 (medium) or Claude Code – Claude Haiku 5.5 (medium)?
- Claude Code – Claude Haiku 5.5 (medium), at 77 against 77 for Claude Code – Claude Sonnet 5.5 (medium). Claude Code – Claude Sonnet 5.5 (medium): 500 of 870 planned attempts (229 excluded). Claude Code – Claude Haiku 5.5 (medium): 462 of 870 planned attempts. Coverage is partial; scores can change as more attempts are decided.
- Which is cheaper per task, Claude Code – Claude Sonnet 5.5 (medium) or Claude Code – Claude Haiku 5.5 (medium)?
- Claude Code – Claude Haiku 5.5 (medium), at $0.0075 against $0.052 for Claude Code – Claude Sonnet 5.5 (medium).
- Which is faster per task, Claude Code – Claude Sonnet 5.5 (medium) or Claude Code – Claude Haiku 5.5 (medium)?
- Claude Code – Claude Sonnet 5.5 (medium), at 0.6 min against 0.8 min for Claude Code – Claude Haiku 5.5 (medium).
- Which has the larger context window, Claude Code – Claude Sonnet 5.5 (medium) or Claude Code – Claude Haiku 5.5 (medium)?
- Not known yet: Claude Code – Claude Sonnet 5.5 (medium) has no context window data and Claude Code – Claude Haiku 5.5 (medium) has no context window data.
More: Claude Code – Claude Sonnet 5.5 (medium) · Claude Code – Claude Haiku 5.5 (medium) · all comparisons