Axis Spatial

Terminus-2 – Kimi K3 (always on) vs. Codex – GPT-6.1 Sol (medium): geospatial agent comparison

Comparison between Terminus-2 – Kimi K3 (always on) and Codex – GPT-6.1 Sol (medium) on the Geospatial Agent Index, each benchmark, cost, time and token use, from the same tasks, agent and limits. Methodology.

Side by side

Terminus-2 – Kimi K3 (always on) vs. Codex – GPT-6.1 Sol (medium)
MetricTerminus-2 – Kimi K3 (always on)Codex – GPT-6.1 Sol (medium)
Geospatial Agent Index58*65*
Earth-Bench V2 score6161
GeoBenchX score5569
GeoAgentBench score (guided GIS workflow; outside the index)94100
GeoAnalystBench score (guided GIS workflow; outside the index)89100
Raster and remote sensing score5959
Vector and overlay score3367
Networks and routing scoreNo dataNo data
Climate and time series score6668
Spatial statistics and interpolation score5029
Mapping and cartography score7878
Recognising infeasible requests score3870
Cost per task$0.336$0.061
Time per task3.9 min1.4 min
Tokens per attempt76k112k
Turns per attempt7.76.5
Attempts decided320320
Input price per 1M tokens$3.00$2.00
Output price per 1M tokens$15.00$10.00
Context window1,000,000No data
Image inputYesNo data
DeveloperMoonshot AIOpenAI

Charts

Geospatial Agent Index

Equal-weight average of the evaluation scores, 0 to 100 · Higher is better

  • Planned attempts still to come
Geospatial Agent IndexCodex – GPT-6.1 Sol (medium): 65* (partial coverage); Terminus-2 – Kimi K3 (always on): 58* (partial coverage)025507510065*GPT-6.1 Sol (medium)58*Kimi K3 (always on)
Data table: Geospatial Agent Index
Geospatial Agent Index
ModelCreatorGeospatial Agent IndexRange while attempts are pendingBenchmarks coveredCoverage (attempts)
Codex – GPT-6.1 Sol (medium)OpenAI65*No pending judgements; coverage incomplete2 of 2320 of 614 planned attempts
Terminus-2 – Kimi K3 (always on)Moonshot AI58*No pending judgements; coverage incomplete; 1 trace review declined by the judge2 of 2320 of 614 planned attempts

Cost per task

Average cost per task (USD) · Lower is better

  • Planned attempts still to come
Cost per taskCodex – GPT-6.1 Sol (medium): $0.061 (partial coverage); Terminus-2 – Kimi K3 (always on): $0.336 (partial coverage)$0$0.100$0.200$0.300$0.400$0.061GPT-6.1 Sol (medium)$0.336Kimi K3 (always on)
Data table: Cost per task
Cost per task
ModelCreatorCost per taskCoverage (attempts)
Terminus-2 – Kimi K3 (always on)Moonshot AI$0.336320 of 614 planned attempts
Codex – GPT-6.1 Sol (medium)OpenAI$0.061320 of 614 planned attempts

Time per task

Average agent wall time per task · Lower is better

  • Planned attempts still to come
Time per taskCodex – GPT-6.1 Sol (medium): 1.4 min (partial coverage); Terminus-2 – Kimi K3 (always on): 3.9 min (partial coverage)0m1m2m3m4m1.4 minGPT-6.1 Sol (medium)3.9 minKimi K3 (always on)
Data table: Time per task
Time per task
ModelCreatorTime per taskCoverage (attempts)
Terminus-2 – Kimi K3 (always on)Moonshot AI3.9 min320 of 614 planned attempts
Codex – GPT-6.1 Sol (medium)OpenAI1.4 min320 of 614 planned attempts

Frequently asked questions

Which scores higher on the Geospatial Agent Index, Terminus-2 – Kimi K3 (always on) or Codex – GPT-6.1 Sol (medium)?
Codex – GPT-6.1 Sol (medium), at 65 against 58 for Terminus-2 – Kimi K3 (always on). Terminus-2 – Kimi K3 (always on): 320 of 614 planned attempts. Codex – GPT-6.1 Sol (medium): 320 of 614 planned attempts. Coverage is partial; scores can change as more attempts are decided.
Which is cheaper per task, Terminus-2 – Kimi K3 (always on) or Codex – GPT-6.1 Sol (medium)?
Codex – GPT-6.1 Sol (medium), at $0.061 against $0.336 for Terminus-2 – Kimi K3 (always on).
Which is faster per task, Terminus-2 – Kimi K3 (always on) or Codex – GPT-6.1 Sol (medium)?
Codex – GPT-6.1 Sol (medium), at 1.4 min against 3.9 min for Terminus-2 – Kimi K3 (always on).
Which has the larger context window, Terminus-2 – Kimi K3 (always on) or Codex – GPT-6.1 Sol (medium)?
Not known yet: Codex – GPT-6.1 Sol (medium) has no context window data.

More: Terminus-2 – Kimi K3 (always on) · Codex – GPT-6.1 Sol (medium) · all comparisons