Axis Spatial

Terminus-2 – gpt-oss-120b (high) vs. Terminus-2 – Kimi K3 (always on): geospatial agent comparison

Comparison between Terminus-2 – gpt-oss-120b (high) and Terminus-2 – Kimi K3 (always on) on the Geospatial Agent Index, each benchmark, cost, time and token use, from the same tasks, agent and limits. Methodology.

Side by side

Terminus-2 – gpt-oss-120b (high) vs. Terminus-2 – Kimi K3 (always on)
MetricTerminus-2 – gpt-oss-120b (high)Terminus-2 – Kimi K3 (always on)
Geospatial Agent Index34*58*
Earth-Bench V2 score3261
GeoBenchX score3655
GeoAgentBench score (guided GIS workflow; outside the index)6694
GeoAnalystBench score (guided GIS workflow; outside the index)5889
Raster and remote sensing score2959
Vector and overlay score5033
Networks and routing scoreNo dataNo data
Climate and time series score3866
Spatial statistics and interpolation score050
Mapping and cartography score3278
Recognising infeasible requests score4438
Cost per task$0.033$0.336
Time per task5.2 min3.9 min
Tokens per attempt79k76k
Turns per attempt6.27.7
Attempts decided320320
Input price per 1M tokens$0.35$3.00
Output price per 1M tokens$0.75$15.00
Context window128,0001,000,000
Image inputNoYes
DeveloperOpenAIMoonshot AI

Charts

Geospatial Agent Index

Equal-weight average of the evaluation scores, 0 to 100 · Higher is better

  • Planned attempts still to come
Geospatial Agent IndexTerminus-2 – Kimi K3 (always on): 58* (partial coverage); Terminus-2 – gpt-oss-120b (high): 34* (partial coverage)025507510058*Kimi K3 (always on)34*gpt-oss-120b (high)
Data table: Geospatial Agent Index
Geospatial Agent Index
ModelCreatorGeospatial Agent IndexRange while attempts are pendingBenchmarks coveredCoverage (attempts)
Terminus-2 – Kimi K3 (always on)Moonshot AI58*No pending judgements; coverage incomplete; 1 trace review declined by the judge2 of 2320 of 614 planned attempts
Terminus-2 – gpt-oss-120b (high)OpenAI34*No pending judgements; coverage incomplete2 of 2320 of 614 planned attempts

Cost per task

Average cost per task (USD) · Lower is better

  • Planned attempts still to come
Cost per taskTerminus-2 – gpt-oss-120b (high): $0.033 (partial coverage); Terminus-2 – Kimi K3 (always on): $0.336 (partial coverage)$0$0.100$0.200$0.300$0.400$0.033gpt-oss-120b (high)$0.336Kimi K3 (always on)
Data table: Cost per task
Cost per task
ModelCreatorCost per taskCoverage (attempts)
Terminus-2 – gpt-oss-120b (high)OpenAI$0.033320 of 614 planned attempts
Terminus-2 – Kimi K3 (always on)Moonshot AI$0.336320 of 614 planned attempts

Time per task

Average agent wall time per task · Lower is better

  • Planned attempts still to come
Time per taskTerminus-2 – Kimi K3 (always on): 3.9 min (partial coverage); Terminus-2 – gpt-oss-120b (high): 5.2 min (partial coverage)0m2m3m5m7m3.9 minKimi K3 (always on)5.2 mingpt-oss-120b (high)
Data table: Time per task
Time per task
ModelCreatorTime per taskCoverage (attempts)
Terminus-2 – gpt-oss-120b (high)OpenAI5.2 min320 of 614 planned attempts
Terminus-2 – Kimi K3 (always on)Moonshot AI3.9 min320 of 614 planned attempts

Frequently asked questions

Which scores higher on the Geospatial Agent Index, Terminus-2 – gpt-oss-120b (high) or Terminus-2 – Kimi K3 (always on)?
Terminus-2 – Kimi K3 (always on), at 58 against 34 for Terminus-2 – gpt-oss-120b (high). Terminus-2 – gpt-oss-120b (high): 320 of 614 planned attempts. Terminus-2 – Kimi K3 (always on): 320 of 614 planned attempts. Coverage is partial; scores can change as more attempts are decided.
Which is cheaper per task, Terminus-2 – gpt-oss-120b (high) or Terminus-2 – Kimi K3 (always on)?
Terminus-2 – gpt-oss-120b (high), at $0.033 against $0.336 for Terminus-2 – Kimi K3 (always on).
Which is faster per task, Terminus-2 – gpt-oss-120b (high) or Terminus-2 – Kimi K3 (always on)?
Terminus-2 – Kimi K3 (always on), at 3.9 min against 5.2 min for Terminus-2 – gpt-oss-120b (high).
Which has the larger context window, Terminus-2 – gpt-oss-120b (high) or Terminus-2 – Kimi K3 (always on)?
Terminus-2 – Kimi K3 (always on), at 1,000,000 tokens against 128,000 tokens for Terminus-2 – gpt-oss-120b (high).

More: Terminus-2 – gpt-oss-120b (high) · Terminus-2 – Kimi K3 (always on) · all comparisons