Axis Spatial

Terminus-2 – Claude Sonnet 4.6 (adaptive, effort high) vs. Terminus-2 – Qwen 3.8 27B (xhigh): geospatial agent comparison

Comparison between Terminus-2 – Claude Sonnet 4.6 (adaptive, effort high) and Terminus-2 – Qwen 3.8 27B (xhigh) on the Geospatial Agent Index, each benchmark, cost, time and token use, from the same tasks, agent and limits. Methodology.

Side by side

Terminus-2 – Claude Sonnet 4.6 (adaptive, effort high) vs. Terminus-2 – Qwen 3.8 27B (xhigh)
MetricTerminus-2 – Claude Sonnet 4.6 (adaptive, effort high)Terminus-2 – Qwen 3.8 27B (xhigh)
Geospatial Agent Index74* (partial: 1.1 of 3 attempts)62* (partial: 0.3 of 3 attempts)
GeoAgentBench score9760
GeoBenchX score51No data
Earth-Bench score5427
GeoAnalystBench score95100
Raster and remote sensing score7236
Vector and overlay score7078
Networks and routing score10067
Climate and time series score8343
Spatial statistics and interpolation score7162
Mapping and cartography score75100
Recognising infeasible requests score30No data
Cost per task$0.278$0.066
Time per task3.7 min19.8 min
Tokens per attempt71k90k
Turns per attempt6.38.2
Attempts decided306101
Input price per 1M tokens$3.00$0.45
Output price per 1M tokens$15.00$3.20
Context window1,000,000262,144
Image inputYesYes
DeveloperAnthropicAlibaba (Qwen)

Charts

Geospatial Agent Index

Equal-weight average of the evaluation scores, 0 to 100 · Higher is better

  • Partial coverage
Geospatial Agent IndexTerminus-2 – Claude Sonnet 4.6 (adaptive, effort high): 74* (partial coverage); Terminus-2 – Qwen 3.8 27B (xhigh): 62* (partial coverage)025507510074*Claude Sonnet 4.6 (adaptive, effort high)62*Qwen 3.8 27B (xhigh)
Data table: Geospatial Agent Index
Geospatial Agent Index
ModelCreatorGeospatial Agent IndexRange while attempts are pendingBenchmarks coveredCoverage (attempts)
Terminus-2 – Claude Sonnet 4.6 (adaptive, effort high)Anthropic74* (partial: 1.1 of 3 attempts)73 to 754 of 4306 of 870 planned attempts (133 excluded)
Terminus-2 – Qwen 3.8 27B (xhigh)Alibaba (Qwen)62* (partial: 0.3 of 3 attempts)No pending judgements; coverage incomplete3 of 4101 of 870 planned attempts

Cost per task

Average cost per task (USD) · Lower is better

  • Partial coverage
Cost per taskTerminus-2 – Qwen 3.8 27B (xhigh): $0.066 (partial coverage); Terminus-2 – Claude Sonnet 4.6 (adaptive, effort high): $0.278 (partial coverage)$0$0.075$0.150$0.225$0.300$0.066Qwen 3.8 27B (xhigh)$0.278Claude Sonnet 4.6 (adaptive, effort high)
Data table: Cost per task
Cost per task
ModelCreatorCost per taskCoverage (attempts)
Terminus-2 – Claude Sonnet 4.6 (adaptive, effort high)Anthropic$0.278321 of 870 planned attempts (133 excluded)
Terminus-2 – Qwen 3.8 27B (xhigh)Alibaba (Qwen)$0.066101 of 870 planned attempts

Time per task

Average agent wall time per task · Lower is better

  • Partial coverage
Time per taskTerminus-2 – Claude Sonnet 4.6 (adaptive, effort high): 3.7 min (partial coverage); Terminus-2 – Qwen 3.8 27B (xhigh): 19.8 min (partial coverage)0m5m10m15m20m3.7 minClaude Sonnet 4.6 (adaptive, effort high)19.8 minQwen 3.8 27B (xhigh)
Data table: Time per task
Time per task
ModelCreatorTime per taskCoverage (attempts)
Terminus-2 – Claude Sonnet 4.6 (adaptive, effort high)Anthropic3.7 min321 of 870 planned attempts (133 excluded)
Terminus-2 – Qwen 3.8 27B (xhigh)Alibaba (Qwen)19.8 min101 of 870 planned attempts

Frequently asked questions

Which scores higher on the Geospatial Agent Index, Terminus-2 – Claude Sonnet 4.6 (adaptive, effort high) or Terminus-2 – Qwen 3.8 27B (xhigh)?
Not comparable yet: Terminus-2 – Qwen 3.8 27B (xhigh) has scores on 3 of 4 benchmarks, so it is not yet ranked. Terminus-2 – Claude Sonnet 4.6 (adaptive, effort high): 306 of 870 planned attempts (133 excluded). Terminus-2 – Qwen 3.8 27B (xhigh): 101 of 870 planned attempts. Coverage is partial; scores can change as more attempts are decided.
Which is cheaper per task, Terminus-2 – Claude Sonnet 4.6 (adaptive, effort high) or Terminus-2 – Qwen 3.8 27B (xhigh)?
Terminus-2 – Qwen 3.8 27B (xhigh), at $0.066 against $0.278 for Terminus-2 – Claude Sonnet 4.6 (adaptive, effort high).
Which is faster per task, Terminus-2 – Claude Sonnet 4.6 (adaptive, effort high) or Terminus-2 – Qwen 3.8 27B (xhigh)?
Terminus-2 – Claude Sonnet 4.6 (adaptive, effort high), at 3.7 min against 19.8 min for Terminus-2 – Qwen 3.8 27B (xhigh).
Which has the larger context window, Terminus-2 – Claude Sonnet 4.6 (adaptive, effort high) or Terminus-2 – Qwen 3.8 27B (xhigh)?
Terminus-2 – Claude Sonnet 4.6 (adaptive, effort high), at 1,000,000 tokens against 262,144 tokens for Terminus-2 – Qwen 3.8 27B (xhigh).

More: Terminus-2 – Claude Sonnet 4.6 (adaptive, effort high) · Terminus-2 – Qwen 3.8 27B (xhigh) · all comparisons