Axis Spatial

Claude Sonnet 5.5 (low), Claude Code vs. GPT-6 Sol (medium), Codex

Claude Sonnet 5.5 (low), Claude Code against GPT-6 Sol (medium), Codex: Geospatial Agent Index, each evaluation, cost, time and tokens, on the same tasks and limits. The harnesses differ, so part of any gap can come from the harness. Methodology.

Side by side

Claude Sonnet 5.5 (low), Claude Code vs. GPT-6 Sol (medium), Codex
MetricClaude Sonnet 5.5 (low), Claude CodeGPT-6 Sol (medium), Codex
Geospatial Agent Index: Text only6980
Geospatial Agent Index: Text + vision71No data
Earth-Bench V2 score5677
GeoBenchX score7775
GS-QA2 score7687
Vision agents score7891
GeoAgentBench score (Guided workflows; not in the Agent Index)94100
GeoAnalystBench score (Guided workflows; not in the Agent Index)95No data
OGD4All score (standalone; in no index)96No data
GeoNatureAgent score (standalone; in no index)100No data
MultiGlobeQA score (standalone; in no index)77No data
GeoAgentEval score (standalone; in no index)100No data
Remote sensing and raster analysis score6988
GIS analysis score7583
Climate and time series score5976
Spatial statistics score3850
Making maps score84100
Recognising infeasible requests score8075
Cost per task$0.043$0.047
Time per task (at 100 output tokens/s)0.4 min0.3 min
Tokens per attempt70k86k
Turns per attempt3.96.4
Input price per 1M tokens$2.00$2.00
Output price per 1M tokens$10.00$10.00
Context window1,000,0001,050,000
Image inputYesYes
DeveloperAnthropicOpenAI

Charts

Not yet ranked. GPT-6 Sol (medium), Codex. Grey placeholders mark these entries in the index, cost and output token charts; their height is not a value. Bars appear once it has a score on every index evaluation. Results so far are in the side-by-side table.

Geospatial Agent Index

Equal average of Earth-Bench V2, GeoBenchX and GS-QA2, 0 to 100 · Higher is better

Geospatial Agent IndexScores 0 to 100: Claude Sonnet 5.5 (low), Claude Code: 69; GPT-6 Sol (medium), Codex: Not yet ranked025507510069Claude Sonnet 5.5 (low)Not yetrankedGPT-6 Sol (medium)
Data table: Geospatial Agent Index
Geospatial Agent Index
ModelDeveloperGeospatial Agent Index
Claude Sonnet 5.5 (low), Claude CodeAnthropic69

Cost per task

Average cost per task (USD) · Lower is better

Cost per taskCost per task in US dollars: Claude Sonnet 5.5 (low), Claude Code: $0.043; GPT-6 Sol (medium), Codex: Not yet ranked$0$0.015$0.03$0.045$0.06$0.043Claude Sonnet 5.5 (low)Not yetrankedGPT-6 Sol (medium)
How to read this chart

Not shown: not yet ranked. 1 entry with too few tasks run so far. Every entry is on the models page.

Data table: Cost per task
Cost per task
ModelDeveloperCost per task
Claude Sonnet 5.5 (low), Claude CodeAnthropic$0.043

Output tokens per task

Average output tokens per attempt, reasoning included · Lower is better

Output tokens per taskOutput tokens per task: Claude Sonnet 5.5 (low), Claude Code: 1k; GPT-6 Sol (medium), Codex: Not yet ranked05001k2k2k1kClaude Sonnet 5.5 (low)Not yetrankedGPT-6 Sol (medium)
How to read this chart

Not shown: not yet ranked. 1 entry with too few tasks run so far. Every entry is on the models page.

Data table: Output tokens per task
Output tokens per task
ModelDeveloperOutput tokens per task
Claude Sonnet 5.5 (low), Claude CodeAnthropic1k

Frequently asked questions

Which scores higher on the Geospatial Agent Index, Claude Sonnet 5.5 (low), Claude Code or GPT-6 Sol (medium), Codex?
Not comparable yet: GPT-6 Sol (medium), Codex is not yet ranked.
Which is cheaper per task, Claude Sonnet 5.5 (low), Claude Code or GPT-6 Sol (medium), Codex?
Claude Sonnet 5.5 (low), Claude Code, $0.043 to $0.047.
Which writes fewer output tokens per task, Claude Sonnet 5.5 (low), Claude Code or GPT-6 Sol (medium), Codex?
Claude Sonnet 5.5 (low), Claude Code, 1k to 1k.
Which has the larger context window, Claude Sonnet 5.5 (low), Claude Code or GPT-6 Sol (medium), Codex?
GPT-6 Sol (medium), Codex, 1,050,000 tokens to 1,000,000 tokens.

More: Claude Sonnet 5.5 (low), Claude Code · GPT-6 Sol (medium), Codex · All comparisons