Axis Spatial

Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2 vs. GPT-6.1 Sol (medium), Codex

Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2 against GPT-6.1 Sol (medium), Codex: Geospatial Agent Index, each evaluation, cost, time and tokens, on the same tasks and limits. The harnesses differ, so part of any gap can come from the harness. Methodology.

Side by side

Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2 vs. GPT-6.1 Sol (medium), Codex
MetricNemotron 3.5 Super VL 120B (Reasoning), Terminus-2GPT-6.1 Sol (medium), Codex
Geospatial Agent Index: Text only5282
Geospatial Agent Index: Text + visionNo dataNo data
Earth-Bench V2 score4672
GeoBenchX score5379
GS-QA2 score5993
Vision agents scoreNo dataNo data
GeoAgentBench score (Guided workflows; not in the Agent Index)68100
GeoAnalystBench score (Guided workflows; not in the Agent Index)37100
OGD4All score (standalone; in no index)No dataNo data
GeoNatureAgent score (standalone; in no index)No dataNo data
MultiGlobeQA score (standalone; in no index)No dataNo data
GeoAgentEval score (standalone; in no index)No dataNo data
Remote sensing and raster analysis score6183
GIS analysis score5194
Climate and time series score4675
Spatial statistics score3131
Making maps score6781
Recognising infeasible requests score4390
Cost per task$0.0096$0.046
Time per task (at 100 output tokens/s)3.8 min0.4 min
Tokens per attempt98k89k
Turns per attempt10.15.8
Input price per 1M tokens$0.15$2.00
Output price per 1M tokens$0.50$10.00
Context window262,1441,050,000
Image inputYesYes
DeveloperNVIDIAOpenAI

Charts

Geospatial Agent Index

Equal average of Earth-Bench V2, GeoBenchX and GS-QA2, 0 to 100 · Higher is better

Geospatial Agent IndexScores 0 to 100: GPT-6.1 Sol (medium), Codex: 82; Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2: 52025507510082GPT-6.1 Sol (medium)52Nemotron 3.5 Super VL 120B (Reasoning)
Data table: Geospatial Agent Index
Geospatial Agent Index
ModelDeveloperGeospatial Agent Index
GPT-6.1 Sol (medium), CodexOpenAI82
Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2NVIDIA52

Cost per task

Average cost per task (USD) · Lower is better

Cost per taskCost per task in US dollars: Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2: $0.0096; GPT-6.1 Sol (medium), Codex: $0.046$0$0.015$0.03$0.045$0.06$0.0096Nemotron 3.5 Super VL 120B (Reasoning)$0.046GPT-6.1 Sol (medium)
Data table: Cost per task
Cost per task
ModelDeveloperCost per task
Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2NVIDIA$0.0096
GPT-6.1 Sol (medium), CodexOpenAI$0.046

Output tokens per task

Average output tokens per attempt, reasoning included · Lower is better

Output tokens per taskOutput tokens per task: GPT-6.1 Sol (medium), Codex: 1k; Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2: 7k02k4k6k8k1kGPT-6.1 Sol (medium)7kNemotron 3.5 Super VL 120B (Reasoning)
Data table: Output tokens per task
Output tokens per task
ModelDeveloperOutput tokens per task
GPT-6.1 Sol (medium), CodexOpenAI1k
Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2NVIDIA7k

Frequently asked questions

Which scores higher on the Geospatial Agent Index, Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2 or GPT-6.1 Sol (medium), Codex?
GPT-6.1 Sol (medium), Codex, 82 to 52.
Which is cheaper per task, Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2 or GPT-6.1 Sol (medium), Codex?
Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2, $0.0096 to $0.046.
Which writes fewer output tokens per task, Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2 or GPT-6.1 Sol (medium), Codex?
GPT-6.1 Sol (medium), Codex, 1k to 7k.
Which has the larger context window, Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2 or GPT-6.1 Sol (medium), Codex?
GPT-6.1 Sol (medium), Codex, 1,050,000 tokens to 262,144 tokens.

More: Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2 · GPT-6.1 Sol (medium), Codex · All comparisons