Axis Spatial

Mistral Large 3 (Non-reasoning), Terminus-2 vs. Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2

Mistral Large 3 (Non-reasoning), Terminus-2 against Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2: Geospatial Agent Index, each evaluation, cost, time and tokens, on the same tasks and limits. Methodology.

Side by side

Mistral Large 3 (Non-reasoning), Terminus-2 vs. Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2
MetricMistral Large 3 (Non-reasoning), Terminus-2Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2
Geospatial Agent Index: Text only3311
Geospatial Agent Index: Text + visionNo dataNo data
Earth-Bench V2 score3116
GeoBenchX score2912
GS-QA2 score394
Vision agents scoreNo dataNo data
GeoAgentBench score (Guided workflows; not in the Agent Index)4610
GeoAnalystBench score (Guided workflows; not in the Agent Index)4732
OGD4All score (standalone; in no index)No dataNo data
GeoNatureAgent score (standalone; in no index)No dataNo data
MultiGlobeQA score (standalone; in no index)No dataNo data
GeoAgentEval score (standalone; in no index)No dataNo data
Remote sensing and raster analysis score2911
GIS analysis score427
Climate and time series score3415
Spatial statistics score80
Making maps score337
Recognising infeasible requests score3312
Cost per task$0.026$0.012
Time per task (at 100 output tokens/s)1.1 min4.9 min
Tokens per attempt42k249k
Turns per attempt5.217.3
Input price per 1M tokens$0.50$0.070
Output price per 1M tokens$1.50$0.20
Context window256,000262,144
Image inputYesNo
DeveloperMistral AINVIDIA

Charts

Geospatial Agent Index

Equal average of Earth-Bench V2, GeoBenchX and GS-QA2, 0 to 100 · Higher is better

Geospatial Agent IndexScores 0 to 100: Mistral Large 3 (Non-reasoning), Terminus-2: 33; Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2: 11025507510033Mistral Large 3 (Non-reasoning)11Nemotron 3.5 Lightning 30B (Reasoning)
Data table: Geospatial Agent Index
Geospatial Agent Index
ModelDeveloperGeospatial Agent Index
Mistral Large 3 (Non-reasoning), Terminus-2Mistral AI33
Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2NVIDIA11

Cost per task

Average cost per task (USD) · Lower is better

Cost per taskCost per task in US dollars: Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2: $0.012; Mistral Large 3 (Non-reasoning), Terminus-2: $0.026$0$0.01$0.02$0.03$0.04$0.012Nemotron 3.5 Lightning 30B (Reasoning)$0.026Mistral Large 3 (Non-reasoning)
Data table: Cost per task
Cost per task
ModelDeveloperCost per task
Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2NVIDIA$0.012
Mistral Large 3 (Non-reasoning), Terminus-2Mistral AI$0.026

Output tokens per task

Average output tokens per attempt, reasoning included · Lower is better

Output tokens per taskOutput tokens per task: Mistral Large 3 (Non-reasoning), Terminus-2: 4k; Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2: 6k02k4k6k8k4kMistral Large 3 (Non-reasoning)6kNemotron 3.5 Lightning 30B (Reasoning)
Data table: Output tokens per task
Output tokens per task
ModelDeveloperOutput tokens per task
Mistral Large 3 (Non-reasoning), Terminus-2Mistral AI4k
Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2NVIDIA6k

Frequently asked questions

Which scores higher on the Geospatial Agent Index, Mistral Large 3 (Non-reasoning), Terminus-2 or Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2?
Mistral Large 3 (Non-reasoning), Terminus-2, 33 to 11.
Which is cheaper per task, Mistral Large 3 (Non-reasoning), Terminus-2 or Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2?
Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2, $0.012 to $0.026.
Which writes fewer output tokens per task, Mistral Large 3 (Non-reasoning), Terminus-2 or Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2?
Mistral Large 3 (Non-reasoning), Terminus-2, 4k to 6k.
Which has the larger context window, Mistral Large 3 (Non-reasoning), Terminus-2 or Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2?
Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2, 262,144 tokens to 256,000 tokens.

More: Mistral Large 3 (Non-reasoning), Terminus-2 · Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2 · All comparisons