Axis Spatial

Terminus-2 – Claude Sonnet 4.6 (adaptive, effort high) vs. Terminus-2 – Mistral Small 3.1 24B (Non-reasoning): geospatial agent comparison

Comparison between Terminus-2 – Claude Sonnet 4.6 (adaptive, effort high) and Terminus-2 – Mistral Small 3.1 24B (Non-reasoning) on the Geospatial Agent Index, each benchmark, cost, time and token use, from the same tasks, agent and limits. Methodology.

Side by side

Terminus-2 – Claude Sonnet 4.6 (adaptive, effort high) vs. Terminus-2 – Mistral Small 3.1 24B (Non-reasoning)
MetricTerminus-2 – Claude Sonnet 4.6 (adaptive, effort high)Terminus-2 – Mistral Small 3.1 24B (Non-reasoning)
Geospatial Agent Index75* (attempts per task: 1.2)0* (attempts per task: 1 on 9 of 290 tasks so far)
GeoAgentBench score97No data
GeoBenchX score52No data
Earth-Bench score560
GeoAnalystBench score95No data
Raster and remote sensing score730
Vector and overlay score70No data
Networks and routing score100No data
Climate and time series score830
Spatial statistics and interpolation score71No data
Mapping and cartography score76No data
Recognising infeasible requests score30No data
Cost per task$0.272$0.247
Time per task3.6 min15.6 min
Tokens per attempt70k693k
Turns per attempt6.325.7
Attempts decided3359
Input price per 1M tokens$3.00$0.35
Output price per 1M tokens$15.00$0.56
Context window1,000,000128,000
Image inputYesYes
DeveloperAnthropicMistral AI

Charts

Geospatial Agent Index

Equal-weight average of the evaluation scores, 0 to 100 · Higher is better

  • Partial coverage
Geospatial Agent IndexTerminus-2 – Claude Sonnet 4.6 (adaptive, effort high): 75* (partial coverage); Terminus-2 – Mistral Small 3.1 24B (Non-reasoning): 0* (partial coverage)025507510075*Claude Sonnet 4.6 (adaptive, effort high)0*Mistral Small 3.1 24B (Non-reasoning)
Data table: Geospatial Agent Index
Geospatial Agent Index
ModelCreatorGeospatial Agent IndexRange while attempts are pendingBenchmarks coveredCoverage (attempts)
Terminus-2 – Claude Sonnet 4.6 (adaptive, effort high)Anthropic75* (attempts per task: 1.2)74 to 754 of 4335 of 870 planned attempts (138 excluded)
Terminus-2 – Mistral Small 3.1 24B (Non-reasoning)Mistral AI0* (attempts per task: 1 on 9 of 290 tasks so far)No pending judgements; coverage incomplete1 of 49 of 351 planned attempts

Cost per task

Average cost per task (USD) · Lower is better

  • Partial coverage
Cost per taskTerminus-2 – Mistral Small 3.1 24B (Non-reasoning): $0.247 (partial coverage); Terminus-2 – Claude Sonnet 4.6 (adaptive, effort high): $0.272 (partial coverage)$0$0.075$0.150$0.225$0.300$0.247Mistral Small 3.1 24B (Non-reasoning)$0.272Claude Sonnet 4.6 (adaptive, effort high)
Data table: Cost per task
Cost per task
ModelCreatorCost per taskCoverage (attempts)
Terminus-2 – Claude Sonnet 4.6 (adaptive, effort high)Anthropic$0.272343 of 870 planned attempts (138 excluded)
Terminus-2 – Mistral Small 3.1 24B (Non-reasoning)Mistral AI$0.2479 of 351 planned attempts

Time per task

Average agent wall time per task · Lower is better

  • Partial coverage
Time per taskTerminus-2 – Claude Sonnet 4.6 (adaptive, effort high): 3.6 min (partial coverage); Terminus-2 – Mistral Small 3.1 24B (Non-reasoning): 15.6 min (partial coverage)0m4m8m12m17m3.6 minClaude Sonnet 4.6 (adaptive, effort high)15.6 minMistral Small 3.1 24B (Non-reasoning)
Data table: Time per task
Time per task
ModelCreatorTime per taskCoverage (attempts)
Terminus-2 – Claude Sonnet 4.6 (adaptive, effort high)Anthropic3.6 min343 of 870 planned attempts (138 excluded)
Terminus-2 – Mistral Small 3.1 24B (Non-reasoning)Mistral AI15.6 min9 of 351 planned attempts

Frequently asked questions

Which scores higher on the Geospatial Agent Index, Terminus-2 – Claude Sonnet 4.6 (adaptive, effort high) or Terminus-2 – Mistral Small 3.1 24B (Non-reasoning)?
Not comparable yet: Terminus-2 – Mistral Small 3.1 24B (Non-reasoning) has scores on 1 of 4 benchmarks, so it is not yet ranked. Terminus-2 – Claude Sonnet 4.6 (adaptive, effort high): 335 of 870 planned attempts (138 excluded). Terminus-2 – Mistral Small 3.1 24B (Non-reasoning): 9 of 351 planned attempts. Coverage is partial; scores can change as more attempts are decided.
Which is cheaper per task, Terminus-2 – Claude Sonnet 4.6 (adaptive, effort high) or Terminus-2 – Mistral Small 3.1 24B (Non-reasoning)?
Terminus-2 – Mistral Small 3.1 24B (Non-reasoning), at $0.247 against $0.272 for Terminus-2 – Claude Sonnet 4.6 (adaptive, effort high).
Which is faster per task, Terminus-2 – Claude Sonnet 4.6 (adaptive, effort high) or Terminus-2 – Mistral Small 3.1 24B (Non-reasoning)?
Terminus-2 – Claude Sonnet 4.6 (adaptive, effort high), at 3.6 min against 15.6 min for Terminus-2 – Mistral Small 3.1 24B (Non-reasoning).
Which has the larger context window, Terminus-2 – Claude Sonnet 4.6 (adaptive, effort high) or Terminus-2 – Mistral Small 3.1 24B (Non-reasoning)?
Terminus-2 – Claude Sonnet 4.6 (adaptive, effort high), at 1,000,000 tokens against 128,000 tokens for Terminus-2 – Mistral Small 3.1 24B (Non-reasoning).

More: Terminus-2 – Claude Sonnet 4.6 (adaptive, effort high) · Terminus-2 – Mistral Small 3.1 24B (Non-reasoning) · all comparisons