Axis Spatial

Step 5 Preview (Reasoning), Terminus-2 vs. GPT-6 Sol (medium), Codex

Step 5 Preview (Reasoning), Terminus-2 against GPT-6 Sol (medium), Codex: Geospatial Agent Index, each evaluation, cost, time and tokens, on the same tasks and limits. The harnesses differ, so part of any gap can come from the harness. Methodology.

Side by side

Step 5 Preview (Reasoning), Terminus-2 vs. GPT-6 Sol (medium), Codex
MetricStep 5 Preview (Reasoning), Terminus-2GPT-6 Sol (medium), Codex
Geospatial Agent Index: Text only3480
Geospatial Agent Index: Text + visionNo dataNo data
Earth-Bench V2 score3277
GeoBenchX score1775
GS-QA2 score5287
Vision agents scoreNo data91
GeoAgentBench score (Guided workflows; not in the Agent Index)50100
GeoAnalystBench score (Guided workflows; not in the Agent Index)53No data
OGD4All score (standalone; in no index)No dataNo data
GeoNatureAgent score (standalone; in no index)No dataNo data
MultiGlobeQA score (standalone; in no index)No dataNo data
GeoAgentEval score (standalone; in no index)No dataNo data
Remote sensing and raster analysis score3588
GIS analysis score6783
Climate and time series score3476
Spatial statistics score050
Making maps score19100
Recognising infeasible requests score2475
Cost per task$0.071$0.047
Time per task (at 100 output tokens/s)7.9 min (estimated)0.3 min
Tokens per attempt90k86k
Turns per attempt11.16.4
Input price per 1M tokens$1.00$2.00
Output price per 1M tokens$2.70$10.00
Context window1,024,0001,050,000
Image inputYesYes
DeveloperStepFunOpenAI

Charts

Not yet ranked. GPT-6 Sol (medium), Codex. Grey placeholders mark these entries in the index, cost and output token charts; their height is not a value. Bars appear once it has a score on every index evaluation. Results so far are in the side-by-side table.

Geospatial Agent Index

Equal average of Earth-Bench V2, GeoBenchX and GS-QA2, 0 to 100 · Higher is better

Geospatial Agent IndexScores 0 to 100: Step 5 Preview (Reasoning), Terminus-2: 34; GPT-6 Sol (medium), Codex: Not yet ranked025507510034Step 5 Preview (Reasoning)Not yetrankedGPT-6 Sol (medium)
Data table: Geospatial Agent Index
Geospatial Agent Index
ModelDeveloperGeospatial Agent Index
Step 5 Preview (Reasoning), Terminus-2StepFun34

Cost per task

Average cost per task (USD) · Lower is better

Cost per taskCost per task in US dollars: Step 5 Preview (Reasoning), Terminus-2: $0.071; GPT-6 Sol (medium), Codex: Not yet ranked$0$0.02$0.04$0.06$0.08$0.071Step 5 Preview (Reasoning)Not yetrankedGPT-6 Sol (medium)
How to read this chart

Not shown: not yet ranked. 1 entry with too few tasks run so far. Every entry is on the models page.

Data table: Cost per task
Cost per task
ModelDeveloperCost per task
Step 5 Preview (Reasoning), Terminus-2StepFun$0.071

Output tokens per task

Average output tokens per attempt, reasoning included · Lower is better

Output tokens per taskOutput tokens per task: Step 5 Preview (Reasoning), Terminus-2: 10k; GPT-6 Sol (medium), Codex: Not yet ranked05k10k15k20k10kStep 5 Preview (Reasoning)Not yetrankedGPT-6 Sol (medium)
How to read this chart

Not shown: not yet ranked. 1 entry with too few tasks run so far. Every entry is on the models page.

Data table: Output tokens per task
Output tokens per task
ModelDeveloperOutput tokens per task
Step 5 Preview (Reasoning), Terminus-2StepFun10k

Frequently asked questions

Which scores higher on the Geospatial Agent Index, Step 5 Preview (Reasoning), Terminus-2 or GPT-6 Sol (medium), Codex?
Not comparable yet: GPT-6 Sol (medium), Codex is not yet ranked.
Which is cheaper per task, Step 5 Preview (Reasoning), Terminus-2 or GPT-6 Sol (medium), Codex?
GPT-6 Sol (medium), Codex, $0.047 to $0.071.
Which writes fewer output tokens per task, Step 5 Preview (Reasoning), Terminus-2 or GPT-6 Sol (medium), Codex?
GPT-6 Sol (medium), Codex, 1k to 10k.
Which has the larger context window, Step 5 Preview (Reasoning), Terminus-2 or GPT-6 Sol (medium), Codex?
GPT-6 Sol (medium), Codex, 1,050,000 tokens to 1,024,000 tokens.

More: Step 5 Preview (Reasoning), Terminus-2 · GPT-6 Sol (medium), Codex · All comparisons