Axis Spatial

Step 5 Preview (Reasoning), Terminus-2 vs. GPT-6 Luna (xhigh), Codex

Step 5 Preview (Reasoning), Terminus-2 against GPT-6 Luna (xhigh), Codex: Geospatial Agent Index, each evaluation, cost, time and tokens, on the same tasks and limits. The harnesses differ, so part of any gap can come from the harness. Methodology.

Side by side

Step 5 Preview (Reasoning), Terminus-2 vs. GPT-6 Luna (xhigh), Codex
MetricStep 5 Preview (Reasoning), Terminus-2GPT-6 Luna (xhigh), Codex
Geospatial Agent Index: Text only3473
Geospatial Agent Index: Text + visionNo data72
Earth-Bench V2 score3267
GeoBenchX score1773
GS-QA2 score5278
Vision agents scoreNo data70
GeoAgentBench score (Guided workflows; not in the Agent Index)5096
GeoAnalystBench score (Guided workflows; not in the Agent Index)53100
OGD4All score (standalone; in no index)No dataNo data
GeoNatureAgent score (standalone; in no index)No dataNo data
MultiGlobeQA score (standalone; in no index)No dataNo data
GeoAgentEval score (standalone; in no index)No dataNo data
Remote sensing and raster analysis score3573
GIS analysis score6778
Climate and time series score3473
Spatial statistics score046
Making maps score1972
Recognising infeasible requests score2480
Cost per task$0.071$0.0070
Time per task (at 100 output tokens/s)7.9 min (estimated)1.4 min
Tokens per attempt90k182k
Turns per attempt11.18.8
Input price per 1M tokens$1.00$0.10
Output price per 1M tokens$2.70$0.50
Context window1,024,0001,050,000
Image inputYesYes
DeveloperStepFunOpenAI

Charts

Geospatial Agent Index

Equal average of Earth-Bench V2, GeoBenchX and GS-QA2, 0 to 100 · Higher is better

Geospatial Agent IndexScores 0 to 100: GPT-6 Luna (xhigh), Codex: 73; Step 5 Preview (Reasoning), Terminus-2: 34025507510073GPT-6 Luna (xhigh)34Step 5 Preview (Reasoning)
Data table: Geospatial Agent Index
Geospatial Agent Index
ModelDeveloperGeospatial Agent Index
GPT-6 Luna (xhigh), CodexOpenAI73
Step 5 Preview (Reasoning), Terminus-2StepFun34

Cost per task

Average cost per task (USD) · Lower is better

Cost per taskCost per task in US dollars: GPT-6 Luna (xhigh), Codex: $0.0070; Step 5 Preview (Reasoning), Terminus-2: $0.071$0$0.02$0.04$0.06$0.08$0.0070GPT-6 Luna (xhigh)$0.071Step 5 Preview (Reasoning)
Data table: Cost per task
Cost per task
ModelDeveloperCost per task
GPT-6 Luna (xhigh), CodexOpenAI$0.0070
Step 5 Preview (Reasoning), Terminus-2StepFun$0.071

Output tokens per task

Average output tokens per attempt, reasoning included · Lower is better

Output tokens per taskOutput tokens per task: GPT-6 Luna (xhigh), Codex: 6k; Step 5 Preview (Reasoning), Terminus-2: 10k05k10k15k20k6kGPT-6 Luna (xhigh)10kStep 5 Preview (Reasoning)
Data table: Output tokens per task
Output tokens per task
ModelDeveloperOutput tokens per task
GPT-6 Luna (xhigh), CodexOpenAI6k
Step 5 Preview (Reasoning), Terminus-2StepFun10k

Frequently asked questions

Which scores higher on the Geospatial Agent Index, Step 5 Preview (Reasoning), Terminus-2 or GPT-6 Luna (xhigh), Codex?
GPT-6 Luna (xhigh), Codex, 73 to 34.
Which is cheaper per task, Step 5 Preview (Reasoning), Terminus-2 or GPT-6 Luna (xhigh), Codex?
GPT-6 Luna (xhigh), Codex, $0.0070 to $0.071.
Which writes fewer output tokens per task, Step 5 Preview (Reasoning), Terminus-2 or GPT-6 Luna (xhigh), Codex?
GPT-6 Luna (xhigh), Codex, 6k to 10k.
Which has the larger context window, Step 5 Preview (Reasoning), Terminus-2 or GPT-6 Luna (xhigh), Codex?
GPT-6 Luna (xhigh), Codex, 1,050,000 tokens to 1,024,000 tokens.

More: Step 5 Preview (Reasoning), Terminus-2 · GPT-6 Luna (xhigh), Codex · All comparisons