Axis Spatial

Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2 vs. Step 5 Preview (Reasoning), Terminus-2

Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2 against Step 5 Preview (Reasoning), Terminus-2: Geospatial Agent Index, each evaluation, cost, time and tokens, on the same tasks and limits. Methodology.

Side by side

Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2 vs. Step 5 Preview (Reasoning), Terminus-2
MetricNemotron 3.5 Lightning 30B (Reasoning), Terminus-2Step 5 Preview (Reasoning), Terminus-2
Geospatial Agent Index: Text only1134
Geospatial Agent Index: Text + visionNo dataNo data
Earth-Bench V2 score1632
GeoBenchX score1217
GS-QA2 score452
Vision agents scoreNo dataNo data
GeoAgentBench score (Guided workflows; not in the Agent Index)1050
GeoAnalystBench score (Guided workflows; not in the Agent Index)3253
OGD4All score (standalone; in no index)No dataNo data
GeoNatureAgent score (standalone; in no index)No dataNo data
MultiGlobeQA score (standalone; in no index)No dataNo data
GeoAgentEval score (standalone; in no index)No dataNo data
Remote sensing and raster analysis score1135
GIS analysis score767
Climate and time series score1534
Spatial statistics score00
Making maps score719
Recognising infeasible requests score1224
Cost per task$0.012$0.071
Time per task (at 100 output tokens/s)4.9 min7.9 min (estimated)
Tokens per attempt249k90k
Turns per attempt17.311.1
Input price per 1M tokens$0.070$1.00
Output price per 1M tokens$0.20$2.70
Context window262,1441,024,000
Image inputNoYes
DeveloperNVIDIAStepFun

Charts

Geospatial Agent Index

Equal average of Earth-Bench V2, GeoBenchX and GS-QA2, 0 to 100 · Higher is better

Geospatial Agent IndexScores 0 to 100: Step 5 Preview (Reasoning), Terminus-2: 34; Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2: 11025507510034Step 5 Preview (Reasoning)11Nemotron 3.5 Lightning 30B (Reasoning)
Data table: Geospatial Agent Index
Geospatial Agent Index
ModelDeveloperGeospatial Agent Index
Step 5 Preview (Reasoning), Terminus-2StepFun34
Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2NVIDIA11

Cost per task

Average cost per task (USD) · Lower is better

Cost per taskCost per task in US dollars: Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2: $0.012; Step 5 Preview (Reasoning), Terminus-2: $0.071$0$0.02$0.04$0.06$0.08$0.012Nemotron 3.5 Lightning 30B (Reasoning)$0.071Step 5 Preview (Reasoning)
Data table: Cost per task
Cost per task
ModelDeveloperCost per task
Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2NVIDIA$0.012
Step 5 Preview (Reasoning), Terminus-2StepFun$0.071

Output tokens per task

Average output tokens per attempt, reasoning included · Lower is better

Output tokens per taskOutput tokens per task: Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2: 6k; Step 5 Preview (Reasoning), Terminus-2: 10k05k10k15k20k6kNemotron 3.5 Lightning 30B (Reasoning)10kStep 5 Preview (Reasoning)
Data table: Output tokens per task
Output tokens per task
ModelDeveloperOutput tokens per task
Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2NVIDIA6k
Step 5 Preview (Reasoning), Terminus-2StepFun10k

Frequently asked questions

Which scores higher on the Geospatial Agent Index, Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2 or Step 5 Preview (Reasoning), Terminus-2?
Step 5 Preview (Reasoning), Terminus-2, 34 to 11.
Which is cheaper per task, Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2 or Step 5 Preview (Reasoning), Terminus-2?
Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2, $0.012 to $0.071.
Which writes fewer output tokens per task, Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2 or Step 5 Preview (Reasoning), Terminus-2?
Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2, 6k to 10k.
Which has the larger context window, Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2 or Step 5 Preview (Reasoning), Terminus-2?
Step 5 Preview (Reasoning), Terminus-2, 1,024,000 tokens to 262,144 tokens.

More: Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2 · Step 5 Preview (Reasoning), Terminus-2 · All comparisons