Axis Spatial

Mistral Large 3 (Non-reasoning), Terminus-2 vs. Step 5 Preview (Reasoning), Terminus-2

Mistral Large 3 (Non-reasoning), Terminus-2 against Step 5 Preview (Reasoning), Terminus-2: Geospatial Agent Index, each evaluation, cost, time and tokens, on the same tasks and limits. Methodology.

Side by side

Mistral Large 3 (Non-reasoning), Terminus-2 vs. Step 5 Preview (Reasoning), Terminus-2
MetricMistral Large 3 (Non-reasoning), Terminus-2Step 5 Preview (Reasoning), Terminus-2
Geospatial Agent Index: Text only3334
Geospatial Agent Index: Text + visionNo dataNo data
Earth-Bench V2 score3132
GeoBenchX score2917
GS-QA2 score3952
Vision agents scoreNo dataNo data
GeoAgentBench score (Guided workflows; not in the Agent Index)4650
GeoAnalystBench score (Guided workflows; not in the Agent Index)4753
OGD4All score (standalone; in no index)No dataNo data
GeoNatureAgent score (standalone; in no index)No dataNo data
MultiGlobeQA score (standalone; in no index)No dataNo data
GeoAgentEval score (standalone; in no index)No dataNo data
Remote sensing and raster analysis score2935
GIS analysis score4267
Climate and time series score3434
Spatial statistics score80
Making maps score3319
Recognising infeasible requests score3324
Cost per task$0.026$0.071
Time per task (at 100 output tokens/s)1.1 min7.9 min (estimated)
Tokens per attempt42k90k
Turns per attempt5.211.1
Input price per 1M tokens$0.50$1.00
Output price per 1M tokens$1.50$2.70
Context window256,0001,024,000
Image inputYesYes
DeveloperMistral AIStepFun

Charts

Geospatial Agent Index

Equal average of Earth-Bench V2, GeoBenchX and GS-QA2, 0 to 100 · Higher is better

Geospatial Agent IndexScores 0 to 100: Step 5 Preview (Reasoning), Terminus-2: 34; Mistral Large 3 (Non-reasoning), Terminus-2: 33025507510034Step 5 Preview (Reasoning)33Mistral Large 3 (Non-reasoning)
Data table: Geospatial Agent Index
Geospatial Agent Index
ModelDeveloperGeospatial Agent Index
Step 5 Preview (Reasoning), Terminus-2StepFun34
Mistral Large 3 (Non-reasoning), Terminus-2Mistral AI33

Cost per task

Average cost per task (USD) · Lower is better

Cost per taskCost per task in US dollars: Mistral Large 3 (Non-reasoning), Terminus-2: $0.026; Step 5 Preview (Reasoning), Terminus-2: $0.071$0$0.02$0.04$0.06$0.08$0.026Mistral Large 3 (Non-reasoning)$0.071Step 5 Preview (Reasoning)
Data table: Cost per task
Cost per task
ModelDeveloperCost per task
Mistral Large 3 (Non-reasoning), Terminus-2Mistral AI$0.026
Step 5 Preview (Reasoning), Terminus-2StepFun$0.071

Output tokens per task

Average output tokens per attempt, reasoning included · Lower is better

Output tokens per taskOutput tokens per task: Mistral Large 3 (Non-reasoning), Terminus-2: 4k; Step 5 Preview (Reasoning), Terminus-2: 10k05k10k15k20k4kMistral Large 3 (Non-reasoning)10kStep 5 Preview (Reasoning)
Data table: Output tokens per task
Output tokens per task
ModelDeveloperOutput tokens per task
Mistral Large 3 (Non-reasoning), Terminus-2Mistral AI4k
Step 5 Preview (Reasoning), Terminus-2StepFun10k

Frequently asked questions

Which scores higher on the Geospatial Agent Index, Mistral Large 3 (Non-reasoning), Terminus-2 or Step 5 Preview (Reasoning), Terminus-2?
Step 5 Preview (Reasoning), Terminus-2, 34 to 33.
Which is cheaper per task, Mistral Large 3 (Non-reasoning), Terminus-2 or Step 5 Preview (Reasoning), Terminus-2?
Mistral Large 3 (Non-reasoning), Terminus-2, $0.026 to $0.071.
Which writes fewer output tokens per task, Mistral Large 3 (Non-reasoning), Terminus-2 or Step 5 Preview (Reasoning), Terminus-2?
Mistral Large 3 (Non-reasoning), Terminus-2, 4k to 10k.
Which has the larger context window, Mistral Large 3 (Non-reasoning), Terminus-2 or Step 5 Preview (Reasoning), Terminus-2?
Step 5 Preview (Reasoning), Terminus-2, 1,024,000 tokens to 256,000 tokens.

More: Mistral Large 3 (Non-reasoning), Terminus-2 · Step 5 Preview (Reasoning), Terminus-2 · All comparisons