Axis Spatial

Llama 3.3 70B (Non-reasoning), Terminus-2 vs. Nemotron 3 Ultra (high), Terminus-2

Llama 3.3 70B (Non-reasoning), Terminus-2 against Nemotron 3 Ultra (high), Terminus-2: Geospatial Agent Index, each evaluation, cost, time and tokens, on the same tasks and limits. Methodology.

Side by side

Llama 3.3 70B (Non-reasoning), Terminus-2 vs. Nemotron 3 Ultra (high), Terminus-2
MetricLlama 3.3 70B (Non-reasoning), Terminus-2Nemotron 3 Ultra (high), Terminus-2
Geospatial Agent Index: Text only868
Geospatial Agent Index: Text + visionNo image inputNo data
Earth-Bench V2 score968
GeoBenchX score665
GS-QA2 score1070
Vision agents scoreNo image inputNo data
GeoAgentBench score (Guided workflows; not in the Agent Index)896
GeoAnalystBench score (Guided workflows; not in the Agent Index)063
OGD4All score (standalone; in no index)No dataNo data
GeoNatureAgent score (standalone; in no index)No dataNo data
MultiGlobeQA score (standalone; in no index)No dataNo data
GeoAgentEval score (standalone; in no index)No dataNo data
Remote sensing and raster analysis score770
GIS analysis score1270
Climate and time series score1068
Spatial statistics score031
Making maps score270
Recognising infeasible requests score1368
Cost per task$0.023$0.069
Time per task (at 100 output tokens/s)2.1 min2.4 min
Tokens per attempt62k148k
Turns per attempt14.412.1
Input price per 1M tokens$0.29$0.50
Output price per 1M tokens$2.25$2.20
Context window24,000262,144
Image inputNoNo
DeveloperMetaNVIDIA

Charts

Geospatial Agent Index

Equal average of Earth-Bench V2, GeoBenchX and GS-QA2, 0 to 100 · Higher is better

Geospatial Agent IndexScores 0 to 100: Nemotron 3 Ultra (high), Terminus-2: 68; Llama 3.3 70B (Non-reasoning), Terminus-2: 8025507510068Nemotron 3 Ultra (high)8Llama 3.3 70B (Non-reasoning)
Data table: Geospatial Agent Index
Geospatial Agent Index
ModelDeveloperGeospatial Agent Index
Nemotron 3 Ultra (high), Terminus-2NVIDIA68
Llama 3.3 70B (Non-reasoning), Terminus-2Meta8

Cost per task

Average cost per task (USD) · Lower is better

Cost per taskCost per task in US dollars: Llama 3.3 70B (Non-reasoning), Terminus-2: $0.023; Nemotron 3 Ultra (high), Terminus-2: $0.069$0$0.02$0.04$0.06$0.08$0.023Llama 3.3 70B (Non-reasoning)$0.069Nemotron 3 Ultra (high)
Data table: Cost per task
Cost per task
ModelDeveloperCost per task
Llama 3.3 70B (Non-reasoning), Terminus-2Meta$0.023
Nemotron 3 Ultra (high), Terminus-2NVIDIA$0.069

Output tokens per task

Average output tokens per attempt, reasoning included · Lower is better

Output tokens per taskOutput tokens per task: Llama 3.3 70B (Non-reasoning), Terminus-2: 2k; Nemotron 3 Ultra (high), Terminus-2: 10k02k5k8k10k2kLlama 3.3 70B (Non-reasoning)10kNemotron 3 Ultra (high)
Data table: Output tokens per task
Output tokens per task
ModelDeveloperOutput tokens per task
Llama 3.3 70B (Non-reasoning), Terminus-2Meta2k
Nemotron 3 Ultra (high), Terminus-2NVIDIA10k

Frequently asked questions

Which scores higher on the Geospatial Agent Index, Llama 3.3 70B (Non-reasoning), Terminus-2 or Nemotron 3 Ultra (high), Terminus-2?
Nemotron 3 Ultra (high), Terminus-2, 68 to 8.
Which is cheaper per task, Llama 3.3 70B (Non-reasoning), Terminus-2 or Nemotron 3 Ultra (high), Terminus-2?
Llama 3.3 70B (Non-reasoning), Terminus-2, $0.023 to $0.069.
Which writes fewer output tokens per task, Llama 3.3 70B (Non-reasoning), Terminus-2 or Nemotron 3 Ultra (high), Terminus-2?
Llama 3.3 70B (Non-reasoning), Terminus-2, 2k to 10k.
Which has the larger context window, Llama 3.3 70B (Non-reasoning), Terminus-2 or Nemotron 3 Ultra (high), Terminus-2?
Nemotron 3 Ultra (high), Terminus-2, 262,144 tokens to 24,000 tokens.

More: Llama 3.3 70B (Non-reasoning), Terminus-2 · Nemotron 3 Ultra (high), Terminus-2 · All comparisons