Codex – gpt-oss-20b (high) vs. Claude Code – Claude Sonnet 5.5 (xhigh): geospatial agent comparison
Comparison between Codex – gpt-oss-20b (high) and Claude Code – Claude Sonnet 5.5 (xhigh) on the Geospatial Agent Index, each benchmark, cost, time and token use, from the same tasks, agent and limits. Methodology.
Side by side
| Metric | Codex – gpt-oss-20b (high) | Claude Code – Claude Sonnet 5.5 (xhigh) |
|---|---|---|
| Geospatial Agent Index | 4* (partial: attempt 1 on 173 of 565 tasks) | 69* |
| Earth-Bench V2 score | 0 | 57 |
| GeoBenchX score | 8 | 71 |
| GS-QA2 score | No data | 80 |
| GeoAgentBench score (guided GIS workflow; outside the index) | No data | 98 |
| GeoAnalystBench score (guided GIS workflow; outside the index) | No data | 95 |
| Raster and remote sensing score | 0 | 71 |
| Vector and overlay score | 25 | 78 |
| Networks and routing score | No data | No data |
| Climate and time series score | 0 | 60 |
| Spatial statistics and interpolation score | 0 | 43 |
| Mapping and cartography score | 4 | 85 |
| Recognising infeasible requests score | 12 | 63 |
| Cost per task | $0.140 | $0.123 |
| Time per task | 8.0 min | 1.1 min |
| Tokens per attempt | 683k | 174k |
| Turns per attempt | 29.5 | 7.0 |
| Attempts decided | 170 | 565 |
| Input price per 1M tokens | $0.20 | $2.00 |
| Output price per 1M tokens | $0.30 | $10.00 |
| Context window | 128,000 | No data |
| Image input | No | No data |
| Developer | OpenAI | Anthropic |
Charts
Partial coverage. Codex – gpt-oss-20b (high): 32 of 147 Earth-Bench V2 tasks; 141 of 173 GeoBenchX tasks; GS-QA2 incomplete. Grey placeholders identify these entries in the index, cost and output token charts; their height does not represent a value. Comparable bars appear when first-attempt coverage is complete. Their available results remain in the side-by-side table.
Geospatial Agent Index
Equal-weight average of the evaluation scores, 0 to 100 · Higher is better
First eight selected entries in metric order. Full results in table view.
Data table: Geospatial Agent Index
| Model | Creator | Geospatial Agent Index | Range while attempts are pending | Benchmarks covered | Coverage (attempts) |
|---|---|---|---|---|---|
| Claude Code – Claude Sonnet 5.5 (xhigh) | Anthropic | 69* | No pending judgements; coverage incomplete; 196 results awaiting review | 3 of 3 | 565 of 859 planned attempts |
Cost per task
Average cost per task (USD) · Lower is better
First eight selected entries in metric order. Full results in table view.
How to read this chart
Not shown: partial coverage. Codex – gpt-oss-20b (high).
Data table: Cost per task
| Model | Creator | Cost per task | Coverage (attempts) |
|---|---|---|---|
| Claude Code – Claude Sonnet 5.5 (xhigh) | Anthropic | $0.123 | 565 of 859 planned attempts |
Output tokens per task
Average output tokens per attempt, reasoning included · Lower is better
First eight selected entries in metric order. Full results in table view.
How to read this chart
Not shown: partial coverage. Codex – gpt-oss-20b (high).
Data table: Output tokens per task
| Model | Creator | Output tokens per task | Coverage (attempts) |
|---|---|---|---|
| Claude Code – Claude Sonnet 5.5 (xhigh) | Anthropic | 5k | 565 of 859 planned attempts |
Frequently asked questions
Which scores higher on the Geospatial Agent Index, Codex – gpt-oss-20b (high) or Claude Code – Claude Sonnet 5.5 (xhigh)?
Which is cheaper per task, Codex – gpt-oss-20b (high) or Claude Code – Claude Sonnet 5.5 (xhigh)?
Which writes fewer output tokens per task, Codex – gpt-oss-20b (high) or Claude Code – Claude Sonnet 5.5 (xhigh)?
Which has the larger context window, Codex – gpt-oss-20b (high) or Claude Code – Claude Sonnet 5.5 (xhigh)?
More: Codex – gpt-oss-20b (high) · Claude Code – Claude Sonnet 5.5 (xhigh) · all comparisons
