Axis Spatial

Claude Sonnet 5.5 (low), Claude Code vs. Claude Sonnet 5 (high), Claude Code

Claude Sonnet 5.5 (low), Claude Code against Claude Sonnet 5 (high), Claude Code: Geospatial Agent Index, each evaluation, cost, time and tokens, on the same tasks and limits. Methodology.

Side by side

Claude Sonnet 5.5 (low), Claude Code vs. Claude Sonnet 5 (high), Claude Code
MetricClaude Sonnet 5.5 (low), Claude CodeClaude Sonnet 5 (high), Claude Code
Geospatial Agent Index: Text only6974
Geospatial Agent Index: Text + vision7176
Earth-Bench V2 score5668
GeoBenchX score7777
GS-QA2 score7677
Vision agents score7881
GeoAgentBench score (Guided workflows; not in the Agent Index)9498
GeoAnalystBench score (Guided workflows; not in the Agent Index)9595
OGD4All score (standalone; in no index)9695
GeoNatureAgent score (standalone; in no index)100100
MultiGlobeQA score (standalone; in no index)7773
GeoAgentEval score (standalone; in no index)10092
Remote sensing and raster analysis score6976
GIS analysis score7575
Climate and time series score5969
Spatial statistics score3854
Making maps score8489
Recognising infeasible requests score8073
Cost per task$0.043$0.20
Time per task (at 100 output tokens/s)0.4 min1.5 min
Tokens per attempt70k364k
Turns per attempt3.99.5
Input price per 1M tokens$2.00$2.00
Output price per 1M tokens$10.00$10.00
Context window1,000,0001,000,000
Image inputYesYes
DeveloperAnthropicAnthropic

Charts

Geospatial Agent Index

Equal average of Earth-Bench V2, GeoBenchX and GS-QA2, 0 to 100 · Higher is better

Geospatial Agent IndexScores 0 to 100: Claude Sonnet 5 (high), Claude Code: 74; Claude Sonnet 5.5 (low), Claude Code: 69025507510074Claude Sonnet 5 (high)69Claude Sonnet 5.5 (low)
Data table: Geospatial Agent Index
Geospatial Agent Index
ModelDeveloperGeospatial Agent Index
Claude Sonnet 5 (high), Claude CodeAnthropic74
Claude Sonnet 5.5 (low), Claude CodeAnthropic69

Cost per task

Average cost per task (USD) · Lower is better

Cost per taskCost per task in US dollars: Claude Sonnet 5.5 (low), Claude Code: $0.043; Claude Sonnet 5 (high), Claude Code: $0.20$0$0.05$0.10$0.15$0.20$0.043Claude Sonnet 5.5 (low)$0.20Claude Sonnet 5 (high)
Data table: Cost per task
Cost per task
ModelDeveloperCost per task
Claude Sonnet 5.5 (low), Claude CodeAnthropic$0.043
Claude Sonnet 5 (high), Claude CodeAnthropic$0.20

Output tokens per task

Average output tokens per attempt, reasoning included · Lower is better

Output tokens per taskOutput tokens per task: Claude Sonnet 5.5 (low), Claude Code: 1k; Claude Sonnet 5 (high), Claude Code: 6k02k4k6k8k1kClaude Sonnet 5.5 (low)6kClaude Sonnet 5 (high)
Data table: Output tokens per task
Output tokens per task
ModelDeveloperOutput tokens per task
Claude Sonnet 5.5 (low), Claude CodeAnthropic1k
Claude Sonnet 5 (high), Claude CodeAnthropic6k

Frequently asked questions

Which scores higher on the Geospatial Agent Index, Claude Sonnet 5.5 (low), Claude Code or Claude Sonnet 5 (high), Claude Code?
Claude Sonnet 5 (high), Claude Code, 74 to 69.
Which is cheaper per task, Claude Sonnet 5.5 (low), Claude Code or Claude Sonnet 5 (high), Claude Code?
Claude Sonnet 5.5 (low), Claude Code, $0.043 to $0.20.
Which writes fewer output tokens per task, Claude Sonnet 5.5 (low), Claude Code or Claude Sonnet 5 (high), Claude Code?
Claude Sonnet 5.5 (low), Claude Code, 1k to 6k.
Which has the larger context window, Claude Sonnet 5.5 (low), Claude Code or Claude Sonnet 5 (high), Claude Code?
They are level, at 1,000,000 tokens.

More: Claude Sonnet 5.5 (low), Claude Code · Claude Sonnet 5 (high), Claude Code · All comparisons