Axis Spatial

Llama 3.3 70B (Non-reasoning), Terminus-2 vs. Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2

Llama 3.3 70B (Non-reasoning), Terminus-2 against Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2: Geospatial Agent Index, each evaluation, cost, time and tokens, on the same tasks and limits. Methodology.

Side by side

Llama 3.3 70B (Non-reasoning), Terminus-2 vs. Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2
MetricLlama 3.3 70B (Non-reasoning), Terminus-2Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2
Geospatial Agent Index: Text only820
Geospatial Agent Index: Text + visionNo image inputNo data
Earth-Bench V2 score929
GeoBenchX score621
GS-QA2 score109
Vision agents scoreNo image inputNo data
GeoAgentBench score (Guided workflows; not in the Agent Index)826
GeoAnalystBench score (Guided workflows; not in the Agent Index)016
OGD4All score (standalone; in no index)No dataNo data
GeoNatureAgent score (standalone; in no index)No dataNo data
MultiGlobeQA score (standalone; in no index)No dataNo data
GeoAgentEval score (standalone; in no index)No dataNo data
Remote sensing and raster analysis score717
GIS analysis score126
Climate and time series score1027
Spatial statistics score00
Making maps score216
Recognising infeasible requests score1333
Cost per task$0.023$0.13
Time per task (at 100 output tokens/s)2.1 min4.9 min
Tokens per attempt62k589k
Turns per attempt14.430.7
Input price per 1M tokens$0.29$0.20
Output price per 1M tokens$2.25$0.80
Context window24,000256,000
Image inputNoYes
DeveloperMetaNVIDIA

Charts

Geospatial Agent Index

Equal average of Earth-Bench V2, GeoBenchX and GS-QA2, 0 to 100 · Higher is better

Geospatial Agent IndexScores 0 to 100: Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2: 20; Llama 3.3 70B (Non-reasoning), Terminus-2: 8025507510020Nemotron 3 Nano Omni 30B (Reasoning)8Llama 3.3 70B (Non-reasoning)
Data table: Geospatial Agent Index
Geospatial Agent Index
ModelDeveloperGeospatial Agent Index
Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2NVIDIA20
Llama 3.3 70B (Non-reasoning), Terminus-2Meta8

Cost per task

Average cost per task (USD) · Lower is better

Cost per taskCost per task in US dollars: Llama 3.3 70B (Non-reasoning), Terminus-2: $0.023; Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2: $0.13$0$0.05$0.10$0.15$0.20$0.023Llama 3.3 70B (Non-reasoning)$0.13Nemotron 3 Nano Omni 30B (Reasoning)
Data table: Cost per task
Cost per task
ModelDeveloperCost per task
Llama 3.3 70B (Non-reasoning), Terminus-2Meta$0.023
Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2NVIDIA$0.13

Output tokens per task

Average output tokens per attempt, reasoning included · Lower is better

Output tokens per taskOutput tokens per task: Llama 3.3 70B (Non-reasoning), Terminus-2: 2k; Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2: 22k010k20k30k40k2kLlama 3.3 70B (Non-reasoning)22kNemotron 3 Nano Omni 30B (Reasoning)
Data table: Output tokens per task
Output tokens per task
ModelDeveloperOutput tokens per task
Llama 3.3 70B (Non-reasoning), Terminus-2Meta2k
Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2NVIDIA22k

Frequently asked questions

Which scores higher on the Geospatial Agent Index, Llama 3.3 70B (Non-reasoning), Terminus-2 or Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2?
Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2, 20 to 8.
Which is cheaper per task, Llama 3.3 70B (Non-reasoning), Terminus-2 or Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2?
Llama 3.3 70B (Non-reasoning), Terminus-2, $0.023 to $0.13.
Which writes fewer output tokens per task, Llama 3.3 70B (Non-reasoning), Terminus-2 or Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2?
Llama 3.3 70B (Non-reasoning), Terminus-2, 2k to 22k.
Which has the larger context window, Llama 3.3 70B (Non-reasoning), Terminus-2 or Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2?
Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2, 256,000 tokens to 24,000 tokens.

More: Llama 3.3 70B (Non-reasoning), Terminus-2 · Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2 · All comparisons