Axis Spatial

gpt-oss-20b (high), Terminus-2 vs. Step 5 Preview (Reasoning), Terminus-2

gpt-oss-20b (high), Terminus-2 against Step 5 Preview (Reasoning), Terminus-2: Geospatial Agent Index, each evaluation, cost, time and tokens, on the same tasks and limits. Methodology.

Side by side

gpt-oss-20b (high), Terminus-2 vs. Step 5 Preview (Reasoning), Terminus-2
Metricgpt-oss-20b (high), Terminus-2Step 5 Preview (Reasoning), Terminus-2
Geospatial Agent Index: Text only3334
Geospatial Agent Index: Text + visionNo image inputNo data
Earth-Bench V2 score3232
GeoBenchX score3817
GS-QA2 score3052
Vision agents scoreNo image inputNo data
GeoAgentBench score (Guided workflows; not in the Agent Index)5350
GeoAnalystBench score (Guided workflows; not in the Agent Index)3753
OGD4All score (standalone; in no index)No dataNo data
GeoNatureAgent score (standalone; in no index)No dataNo data
MultiGlobeQA score (standalone; in no index)No dataNo data
GeoAgentEval score (standalone; in no index)No dataNo data
Remote sensing and raster analysis score3335
GIS analysis score2667
Climate and time series score3134
Spatial statistics score00
Making maps score2119
Recognising infeasible requests score6724
Cost per task$0.017$0.071
Time per task (at 100 output tokens/s)7.2 min7.9 min (estimated)
Tokens per attempt67k90k
Turns per attempt5.211.1
Input price per 1M tokens$0.20$1.00
Output price per 1M tokens$0.30$2.70
Context window128,0001,024,000
Image inputNoYes
DeveloperOpenAIStepFun

Charts

Geospatial Agent Index

Equal average of Earth-Bench V2, GeoBenchX and GS-QA2, 0 to 100 · Higher is better

Geospatial Agent IndexScores 0 to 100: Step 5 Preview (Reasoning), Terminus-2: 34; gpt-oss-20b (high), Terminus-2: 33025507510034Step 5 Preview (Reasoning)33gpt-oss-20b (high)
Data table: Geospatial Agent Index
Geospatial Agent Index
ModelDeveloperGeospatial Agent Index
Step 5 Preview (Reasoning), Terminus-2StepFun34
gpt-oss-20b (high), Terminus-2OpenAI33

Cost per task

Average cost per task (USD) · Lower is better

Cost per taskCost per task in US dollars: gpt-oss-20b (high), Terminus-2: $0.017; Step 5 Preview (Reasoning), Terminus-2: $0.071$0$0.02$0.04$0.06$0.08$0.017gpt-oss-20b (high)$0.071Step 5 Preview (Reasoning)
Data table: Cost per task
Cost per task
ModelDeveloperCost per task
gpt-oss-20b (high), Terminus-2OpenAI$0.017
Step 5 Preview (Reasoning), Terminus-2StepFun$0.071

Output tokens per task

Average output tokens per attempt, reasoning included · Lower is better

Output tokens per taskOutput tokens per task: Step 5 Preview (Reasoning), Terminus-2: 10k; gpt-oss-20b (high), Terminus-2: 40k010k20k30k40k10kStep 5 Preview (Reasoning)40kgpt-oss-20b (high)
Data table: Output tokens per task
Output tokens per task
ModelDeveloperOutput tokens per task
Step 5 Preview (Reasoning), Terminus-2StepFun10k
gpt-oss-20b (high), Terminus-2OpenAI40k

Frequently asked questions

Which scores higher on the Geospatial Agent Index, gpt-oss-20b (high), Terminus-2 or Step 5 Preview (Reasoning), Terminus-2?
Step 5 Preview (Reasoning), Terminus-2, 34 to 33.
Which is cheaper per task, gpt-oss-20b (high), Terminus-2 or Step 5 Preview (Reasoning), Terminus-2?
gpt-oss-20b (high), Terminus-2, $0.017 to $0.071.
Which writes fewer output tokens per task, gpt-oss-20b (high), Terminus-2 or Step 5 Preview (Reasoning), Terminus-2?
Step 5 Preview (Reasoning), Terminus-2, 10k to 40k.
Which has the larger context window, gpt-oss-20b (high), Terminus-2 or Step 5 Preview (Reasoning), Terminus-2?
Step 5 Preview (Reasoning), Terminus-2, 1,024,000 tokens to 128,000 tokens.

More: gpt-oss-20b (high), Terminus-2 · Step 5 Preview (Reasoning), Terminus-2 · All comparisons