Axis Spatial

Claude Haiku 5.5 (low), Claude Code vs. Claude Sonnet 5 (high), Claude Code

Claude Haiku 5.5 (low), Claude Code against Claude Sonnet 5 (high), Claude Code: Geospatial Agent Index, each evaluation, cost, time and tokens, on the same tasks and limits. Methodology.

Side by side

Claude Haiku 5.5 (low), Claude Code vs. Claude Sonnet 5 (high), Claude Code
MetricClaude Haiku 5.5 (low), Claude CodeClaude Sonnet 5 (high), Claude Code
Geospatial Agent Index: Text only7074
Geospatial Agent Index: Text + vision7276
Earth-Bench V2 score6268
GeoBenchX score7377
GS-QA2 score7577
Vision agents score7781
GeoAgentBench score (Guided workflows; not in the Agent Index)9298
GeoAnalystBench score (Guided workflows; not in the Agent Index)10095
OGD4All score (standalone; in no index)9595
GeoNatureAgent score (standalone; in no index)100100
MultiGlobeQA score (standalone; in no index)7273
GeoAgentEval score (standalone; in no index)9292
Remote sensing and raster analysis score7276
GIS analysis score7375
Climate and time series score6469
Spatial statistics score3854
Making maps score7989
Recognising infeasible requests score7373
Cost per task$0.0053$0.20
Time per task (at 100 output tokens/s)0.9 min1.5 min
Tokens per attempt181k364k
Turns per attempt5.59.5
Input price per 1M tokens$0.10$2.00
Output price per 1M tokens$0.50$10.00
Context window1,000,0001,000,000
Image inputYesYes
DeveloperAnthropicAnthropic

Charts

Geospatial Agent Index

Equal average of Earth-Bench V2, GeoBenchX and GS-QA2, 0 to 100 · Higher is better

Geospatial Agent IndexScores 0 to 100: Claude Sonnet 5 (high), Claude Code: 74; Claude Haiku 5.5 (low), Claude Code: 70025507510074Claude Sonnet 5 (high)70Claude Haiku 5.5 (low)
Data table: Geospatial Agent Index
Geospatial Agent Index
ModelDeveloperGeospatial Agent Index
Claude Sonnet 5 (high), Claude CodeAnthropic74
Claude Haiku 5.5 (low), Claude CodeAnthropic70

Cost per task

Average cost per task (USD) · Lower is better

Cost per taskCost per task in US dollars: Claude Haiku 5.5 (low), Claude Code: $0.0053; Claude Sonnet 5 (high), Claude Code: $0.20$0$0.05$0.10$0.15$0.20$0.0053Claude Haiku 5.5 (low)$0.20Claude Sonnet 5 (high)
Data table: Cost per task
Cost per task
ModelDeveloperCost per task
Claude Haiku 5.5 (low), Claude CodeAnthropic$0.0053
Claude Sonnet 5 (high), Claude CodeAnthropic$0.20

Output tokens per task

Average output tokens per attempt, reasoning included · Lower is better

Output tokens per taskOutput tokens per task: Claude Haiku 5.5 (low), Claude Code: 3k; Claude Sonnet 5 (high), Claude Code: 6k02k4k6k8k3kClaude Haiku 5.5 (low)6kClaude Sonnet 5 (high)
Data table: Output tokens per task
Output tokens per task
ModelDeveloperOutput tokens per task
Claude Haiku 5.5 (low), Claude CodeAnthropic3k
Claude Sonnet 5 (high), Claude CodeAnthropic6k

Frequently asked questions

Which scores higher on the Geospatial Agent Index, Claude Haiku 5.5 (low), Claude Code or Claude Sonnet 5 (high), Claude Code?
Claude Sonnet 5 (high), Claude Code, 74 to 70.
Which is cheaper per task, Claude Haiku 5.5 (low), Claude Code or Claude Sonnet 5 (high), Claude Code?
Claude Haiku 5.5 (low), Claude Code, $0.0053 to $0.20.
Which writes fewer output tokens per task, Claude Haiku 5.5 (low), Claude Code or Claude Sonnet 5 (high), Claude Code?
Claude Haiku 5.5 (low), Claude Code, 3k to 6k.
Which has the larger context window, Claude Haiku 5.5 (low), Claude Code or Claude Sonnet 5 (high), Claude Code?
They are level, at 1,000,000 tokens.

More: Claude Haiku 5.5 (low), Claude Code · Claude Sonnet 5 (high), Claude Code · All comparisons