Axis Spatial

Step 5 Preview (Reasoning), Terminus-2 vs. DeepSeek V4 Flash (high), Codex

Step 5 Preview (Reasoning), Terminus-2 against DeepSeek V4 Flash (high), Codex: Geospatial Agent Index, each evaluation, cost, time and tokens, on the same tasks and limits. The harnesses differ, so part of any gap can come from the harness. Methodology.

Side by side

Step 5 Preview (Reasoning), Terminus-2 vs. DeepSeek V4 Flash (high), Codex
MetricStep 5 Preview (Reasoning), Terminus-2DeepSeek V4 Flash (high), Codex
Geospatial Agent Index: Text only3459
Geospatial Agent Index: Text + visionNo dataNo image input
Earth-Bench V2 score3257
GeoBenchX score1747
GS-QA2 score5274
Vision agents scoreNo dataNo image input
GeoAgentBench score (Guided workflows; not in the Agent Index)5088
GeoAnalystBench score (Guided workflows; not in the Agent Index)5389
OGD4All score (standalone; in no index)No dataNo data
GeoNatureAgent score (standalone; in no index)No dataNo data
MultiGlobeQA score (standalone; in no index)No dataNo data
GeoAgentEval score (standalone; in no index)No dataNo data
Remote sensing and raster analysis score3568
GIS analysis score6775
Climate and time series score3458
Spatial statistics score033
Making maps score1961
Recognising infeasible requests score2432
Cost per task$0.071$0.085
Time per task (at 100 output tokens/s)7.9 min (estimated)6.5 min
Tokens per attempt90k1.13M
Turns per attempt11.125.4
Input price per 1M tokens$1.00$0.44
Output price per 1M tokens$2.70$1.32
Context window1,024,0001,048,576
Image inputYesNo
DeveloperStepFunDeepSeek

Charts

Geospatial Agent Index

Equal average of Earth-Bench V2, GeoBenchX and GS-QA2, 0 to 100 · Higher is better

Geospatial Agent IndexScores 0 to 100: DeepSeek V4 Flash (high), Codex: 59; Step 5 Preview (Reasoning), Terminus-2: 34025507510059DeepSeek V4 Flash (high)34Step 5 Preview (Reasoning)
Data table: Geospatial Agent Index
Geospatial Agent Index
ModelDeveloperGeospatial Agent Index
DeepSeek V4 Flash (high), CodexDeepSeek59
Step 5 Preview (Reasoning), Terminus-2StepFun34

Cost per task

Average cost per task (USD) · Lower is better

Cost per taskCost per task in US dollars: Step 5 Preview (Reasoning), Terminus-2: $0.071; DeepSeek V4 Flash (high), Codex: $0.085$0$0.025$0.05$0.075$0.10$0.071Step 5 Preview (Reasoning)$0.085DeepSeek V4 Flash (high)
Data table: Cost per task
Cost per task
ModelDeveloperCost per task
Step 5 Preview (Reasoning), Terminus-2StepFun$0.071
DeepSeek V4 Flash (high), CodexDeepSeek$0.085

Output tokens per task

Average output tokens per attempt, reasoning included · Lower is better

Output tokens per taskOutput tokens per task: Step 5 Preview (Reasoning), Terminus-2: 10k; DeepSeek V4 Flash (high), Codex: 19k05k10k15k20k10kStep 5 Preview (Reasoning)19kDeepSeek V4 Flash (high)
Data table: Output tokens per task
Output tokens per task
ModelDeveloperOutput tokens per task
Step 5 Preview (Reasoning), Terminus-2StepFun10k
DeepSeek V4 Flash (high), CodexDeepSeek19k

Frequently asked questions

Which scores higher on the Geospatial Agent Index, Step 5 Preview (Reasoning), Terminus-2 or DeepSeek V4 Flash (high), Codex?
DeepSeek V4 Flash (high), Codex, 59 to 34.
Which is cheaper per task, Step 5 Preview (Reasoning), Terminus-2 or DeepSeek V4 Flash (high), Codex?
Step 5 Preview (Reasoning), Terminus-2, $0.071 to $0.085.
Which writes fewer output tokens per task, Step 5 Preview (Reasoning), Terminus-2 or DeepSeek V4 Flash (high), Codex?
Step 5 Preview (Reasoning), Terminus-2, 10k to 19k.
Which has the larger context window, Step 5 Preview (Reasoning), Terminus-2 or DeepSeek V4 Flash (high), Codex?
DeepSeek V4 Flash (high), Codex, 1,048,576 tokens to 1,024,000 tokens.

More: Step 5 Preview (Reasoning), Terminus-2 · DeepSeek V4 Flash (high), Codex · All comparisons