Axis Spatial

Terminus-2 – gpt-oss-120b (low) vs. Terminus-2 – Kimi K3 (always on): geospatial agent comparison

Comparison between Terminus-2 – gpt-oss-120b (low) and Terminus-2 – Kimi K3 (always on) on the Geospatial Agent Index, each benchmark, cost, time and token use, from the same tasks, agent and limits. Methodology.

Side by side

Terminus-2 – gpt-oss-120b (low) vs. Terminus-2 – Kimi K3 (always on)
MetricTerminus-2 – gpt-oss-120b (low)Terminus-2 – Kimi K3 (always on)
Geospatial Agent Index25*58*
Earth-Bench V2 score2061
GeoBenchX score3155
GeoAgentBench score (guided GIS workflow; outside the index)5494
GeoAnalystBench score (guided GIS workflow; outside the index)4789
Raster and remote sensing score1659
Vector and overlay score5033
Networks and routing scoreNo dataNo data
Climate and time series score2466
Spatial statistics and interpolation score050
Mapping and cartography score1978
Recognising infeasible requests score4738
Cost per task$0.0061$0.336
Time per task0.9 min3.9 min
Tokens per attempt15k76k
Turns per attempt3.17.7
Attempts decided320320
Input price per 1M tokens$0.35$3.00
Output price per 1M tokens$0.75$15.00
Context window128,0001,000,000
Image inputNoYes
DeveloperOpenAIMoonshot AI

Charts

Geospatial Agent Index

Equal-weight average of the evaluation scores, 0 to 100 · Higher is better

  • Planned attempts still to come
Geospatial Agent IndexTerminus-2 – Kimi K3 (always on): 58* (partial coverage); Terminus-2 – gpt-oss-120b (low): 25* (partial coverage)025507510058*Kimi K3 (always on)25*gpt-oss-120b (low)
Data table: Geospatial Agent Index
Geospatial Agent Index
ModelCreatorGeospatial Agent IndexRange while attempts are pendingBenchmarks coveredCoverage (attempts)
Terminus-2 – Kimi K3 (always on)Moonshot AI58*No pending judgements; coverage incomplete; 1 trace review declined by the judge2 of 2320 of 614 planned attempts
Terminus-2 – gpt-oss-120b (low)OpenAI25*No pending judgements; coverage incomplete2 of 2320 of 614 planned attempts

Cost per task

Average cost per task (USD) · Lower is better

  • Planned attempts still to come
Cost per taskTerminus-2 – gpt-oss-120b (low): $0.0061 (partial coverage); Terminus-2 – Kimi K3 (always on): $0.336 (partial coverage)$0$0.100$0.200$0.300$0.400$0.0061gpt-oss-120b (low)$0.336Kimi K3 (always on)
Data table: Cost per task
Cost per task
ModelCreatorCost per taskCoverage (attempts)
Terminus-2 – gpt-oss-120b (low)OpenAI$0.0061320 of 614 planned attempts
Terminus-2 – Kimi K3 (always on)Moonshot AI$0.336320 of 614 planned attempts

Time per task

Average agent wall time per task · Lower is better

  • Planned attempts still to come
Time per taskTerminus-2 – gpt-oss-120b (low): 0.9 min (partial coverage); Terminus-2 – Kimi K3 (always on): 3.9 min (partial coverage)0m1m2m3m4m0.9 mingpt-oss-120b (low)3.9 minKimi K3 (always on)
Data table: Time per task
Time per task
ModelCreatorTime per taskCoverage (attempts)
Terminus-2 – gpt-oss-120b (low)OpenAI0.9 min320 of 614 planned attempts
Terminus-2 – Kimi K3 (always on)Moonshot AI3.9 min320 of 614 planned attempts

Frequently asked questions

Which scores higher on the Geospatial Agent Index, Terminus-2 – gpt-oss-120b (low) or Terminus-2 – Kimi K3 (always on)?
Terminus-2 – Kimi K3 (always on), at 58 against 25 for Terminus-2 – gpt-oss-120b (low). Terminus-2 – gpt-oss-120b (low): 320 of 614 planned attempts. Terminus-2 – Kimi K3 (always on): 320 of 614 planned attempts. Coverage is partial; scores can change as more attempts are decided.
Which is cheaper per task, Terminus-2 – gpt-oss-120b (low) or Terminus-2 – Kimi K3 (always on)?
Terminus-2 – gpt-oss-120b (low), at $0.0061 against $0.336 for Terminus-2 – Kimi K3 (always on).
Which is faster per task, Terminus-2 – gpt-oss-120b (low) or Terminus-2 – Kimi K3 (always on)?
Terminus-2 – gpt-oss-120b (low), at 0.9 min against 3.9 min for Terminus-2 – Kimi K3 (always on).
Which has the larger context window, Terminus-2 – gpt-oss-120b (low) or Terminus-2 – Kimi K3 (always on)?
Terminus-2 – Kimi K3 (always on), at 1,000,000 tokens against 128,000 tokens for Terminus-2 – gpt-oss-120b (low).

More: Terminus-2 – gpt-oss-120b (low) · Terminus-2 – Kimi K3 (always on) · all comparisons