Claude Code – Claude Haiku 5.5 (xhigh) vs. Codex – GPT-6.1 Sol (medium): geospatial agent comparison
Comparison between Claude Code – Claude Haiku 5.5 (xhigh) and Codex – GPT-6.1 Sol (medium) on the Geospatial Agent Index, each benchmark, cost, time and token use, from the same tasks, agent and limits. Methodology.
Side by side
| Metric | Claude Code – Claude Haiku 5.5 (xhigh) | Codex – GPT-6.1 Sol (medium) |
|---|---|---|
| Geospatial Agent Index | 78 (partial: 1 of 3 attempts) | 79* (partial: 2.6 of 3 attempts) |
| GeoAgentBench score | 100 | 100 |
| GeoBenchX score | 65 | 67 |
| Earth-Bench score | 52 | 51 |
| GeoAnalystBench score | 95 | 100 |
| Raster and remote sensing score | 73 | 71 |
| Vector and overlay score | 78 | 82 |
| Networks and routing score | 100 | 100 |
| Climate and time series score | 71 | 75 |
| Spatial statistics and interpolation score | 62 | 62 |
| Mapping and cartography score | 74 | 75 |
| Recognising infeasible requests score | 65 | 69 |
| Cost per task | $0.023 | $0.060 |
| Time per task | 1.9 min | 1.4 min |
| Tokens per attempt | 635k | 111k |
| Turns per attempt | 12.0 | 6.6 |
| Attempts decided | 290 | 749 |
| Input price per 1M tokens | $0.10 | $2.00 |
| Output price per 1M tokens | $0.50 | $10.00 |
| Context window | No data | No data |
| Image input | No data | No data |
| Developer | Anthropic | OpenAI |
Charts
Geospatial Agent Index
Equal-weight average of the evaluation scores, 0 to 100 · Higher is better
First eight selected entries in metric order. Full results in table view.
Data table: Geospatial Agent Index
| Model | Creator | Geospatial Agent Index | Range while attempts are pending | Benchmarks covered | Coverage (attempts) |
|---|---|---|---|---|---|
| Codex – GPT-6.1 Sol (medium) | OpenAI | 79* (partial: 2.6 of 3 attempts) | No pending judgements; coverage incomplete | 4 of 4 | 749 of 870 planned attempts (6 excluded) |
| Claude Code – Claude Haiku 5.5 (xhigh) | Anthropic | 78 (partial: 1 of 3 attempts) | No pending judgements | 4 of 4 | 290 of 290 planned attempts |
Codex – GPT-6.1 Sol (medium)
Claude Code – Claude Haiku 5.5 (xhigh)Cost per task
Average cost per task (USD) · Lower is better
First eight selected entries in metric order. Full results in table view.
Data table: Cost per task
| Model | Creator | Cost per task | Coverage (attempts) |
|---|---|---|---|
| Claude Code – Claude Haiku 5.5 (xhigh) | Anthropic | $0.023 | 290 of 290 planned attempts |
| Codex – GPT-6.1 Sol (medium) | OpenAI | $0.060 | 749 of 870 planned attempts (6 excluded) |
Time per task
Average agent wall time per task · Lower is better
First eight selected entries in metric order. Full results in table view.
Data table: Time per task
| Model | Creator | Time per task | Coverage (attempts) |
|---|---|---|---|
| Claude Code – Claude Haiku 5.5 (xhigh) | Anthropic | 1.9 min | 290 of 290 planned attempts |
| Codex – GPT-6.1 Sol (medium) | OpenAI | 1.4 min | 749 of 870 planned attempts (6 excluded) |
Frequently asked questions
- Which scores higher on the Geospatial Agent Index, Claude Code – Claude Haiku 5.5 (xhigh) or Codex – GPT-6.1 Sol (medium)?
- Codex – GPT-6.1 Sol (medium), at 79 against 78 for Claude Code – Claude Haiku 5.5 (xhigh). Claude Code – Claude Haiku 5.5 (xhigh): 290 of 290 planned attempts. Codex – GPT-6.1 Sol (medium): 749 of 870 planned attempts (6 excluded). Coverage is partial; scores can change as more attempts are decided.
- Which is cheaper per task, Claude Code – Claude Haiku 5.5 (xhigh) or Codex – GPT-6.1 Sol (medium)?
- Claude Code – Claude Haiku 5.5 (xhigh), at $0.023 against $0.060 for Codex – GPT-6.1 Sol (medium).
- Which is faster per task, Claude Code – Claude Haiku 5.5 (xhigh) or Codex – GPT-6.1 Sol (medium)?
- Codex – GPT-6.1 Sol (medium), at 1.4 min against 1.9 min for Claude Code – Claude Haiku 5.5 (xhigh).
- Which has the larger context window, Claude Code – Claude Haiku 5.5 (xhigh) or Codex – GPT-6.1 Sol (medium)?
- Not known yet: Claude Code – Claude Haiku 5.5 (xhigh) has no context window data and Codex – GPT-6.1 Sol (medium) has no context window data.
More: Claude Code – Claude Haiku 5.5 (xhigh) · Codex – GPT-6.1 Sol (medium) · all comparisons