Axis Spatial

gpt-oss-120b (low), Terminus-2 vs. Step 5 Preview (Reasoning), Terminus-2

gpt-oss-120b (low), Terminus-2 against Step 5 Preview (Reasoning), Terminus-2: Geospatial Agent Index, each evaluation, cost, time and tokens, on the same tasks and limits. Methodology.

Side by side

gpt-oss-120b (low), Terminus-2 vs. Step 5 Preview (Reasoning), Terminus-2
Metricgpt-oss-120b (low), Terminus-2Step 5 Preview (Reasoning), Terminus-2
Geospatial Agent Index: Text only3134
Geospatial Agent Index: Text + visionNo image inputNo data
Earth-Bench V2 score2832
GeoBenchX score3717
GS-QA2 score2952
Vision agents scoreNo image inputNo data
GeoAgentBench score (Guided workflows; not in the Agent Index)6050
GeoAnalystBench score (Guided workflows; not in the Agent Index)4753
OGD4All score (standalone; in no index)No dataNo data
GeoNatureAgent score (standalone; in no index)No dataNo data
MultiGlobeQA score (standalone; in no index)No dataNo data
GeoAgentEval score (standalone; in no index)No dataNo data
Remote sensing and raster analysis score2535
GIS analysis score3467
Climate and time series score2934
Spatial statistics score80
Making maps score2119
Recognising infeasible requests score6024
Cost per task$0.0046$0.071
Time per task (at 100 output tokens/s)0.5 min7.9 min (estimated)
Tokens per attempt11k90k
Turns per attempt2.911.1
Input price per 1M tokens$0.35$1.00
Output price per 1M tokens$0.75$2.70
Context window128,0001,024,000
Image inputNoYes
DeveloperOpenAIStepFun

Charts

Geospatial Agent Index

Equal average of Earth-Bench V2, GeoBenchX and GS-QA2, 0 to 100 · Higher is better

Geospatial Agent IndexScores 0 to 100: Step 5 Preview (Reasoning), Terminus-2: 34; gpt-oss-120b (low), Terminus-2: 31025507510034Step 5 Preview (Reasoning)31gpt-oss-120b (low)
Data table: Geospatial Agent Index
Geospatial Agent Index
ModelDeveloperGeospatial Agent Index
Step 5 Preview (Reasoning), Terminus-2StepFun34
gpt-oss-120b (low), Terminus-2OpenAI31

Cost per task

Average cost per task (USD) · Lower is better

Cost per taskCost per task in US dollars: gpt-oss-120b (low), Terminus-2: $0.0046; Step 5 Preview (Reasoning), Terminus-2: $0.071$0$0.02$0.04$0.06$0.08$0.0046gpt-oss-120b (low)$0.071Step 5 Preview (Reasoning)
Data table: Cost per task
Cost per task
ModelDeveloperCost per task
gpt-oss-120b (low), Terminus-2OpenAI$0.0046
Step 5 Preview (Reasoning), Terminus-2StepFun$0.071

Output tokens per task

Average output tokens per attempt, reasoning included · Lower is better

Output tokens per taskOutput tokens per task: gpt-oss-120b (low), Terminus-2: 2k; Step 5 Preview (Reasoning), Terminus-2: 10k05k10k15k20k2kgpt-oss-120b (low)10kStep 5 Preview (Reasoning)
Data table: Output tokens per task
Output tokens per task
ModelDeveloperOutput tokens per task
gpt-oss-120b (low), Terminus-2OpenAI2k
Step 5 Preview (Reasoning), Terminus-2StepFun10k

Frequently asked questions

Which scores higher on the Geospatial Agent Index, gpt-oss-120b (low), Terminus-2 or Step 5 Preview (Reasoning), Terminus-2?
Step 5 Preview (Reasoning), Terminus-2, 34 to 31.
Which is cheaper per task, gpt-oss-120b (low), Terminus-2 or Step 5 Preview (Reasoning), Terminus-2?
gpt-oss-120b (low), Terminus-2, $0.0046 to $0.071.
Which writes fewer output tokens per task, gpt-oss-120b (low), Terminus-2 or Step 5 Preview (Reasoning), Terminus-2?
gpt-oss-120b (low), Terminus-2, 2k to 10k.
Which has the larger context window, gpt-oss-120b (low), Terminus-2 or Step 5 Preview (Reasoning), Terminus-2?
Step 5 Preview (Reasoning), Terminus-2, 1,024,000 tokens to 128,000 tokens.

More: gpt-oss-120b (low), Terminus-2 · Step 5 Preview (Reasoning), Terminus-2 · All comparisons