Terminus-2 – GLM-5.3 (low) vs. Codex – GPT-6.1 Sol (xhigh): geospatial agent comparison
Comparison between Terminus-2 – GLM-5.3 (low) and Codex – GPT-6.1 Sol (xhigh) on the Geospatial Agent Index, each benchmark, cost, time and token use, from the same tasks, agent and limits. Methodology.
Side by side
| Metric | Terminus-2 – GLM-5.3 (low) | Codex – GPT-6.1 Sol (xhigh) |
|---|---|---|
| Geospatial Agent Index | 71* (partial: 0.9 of 3 attempts) | 78* (partial: 2 of 3 attempts) |
| GeoAgentBench score | 95 | 100 |
| GeoBenchX score | 51 | 64 |
| Earth-Bench score | 38 | 48 |
| GeoAnalystBench score | 100 | 100 |
| Raster and remote sensing score | 65 | 70 |
| Vector and overlay score | 79 | 78 |
| Networks and routing score | 100 | 100 |
| Climate and time series score | 60 | 72 |
| Spatial statistics and interpolation score | 50 | 62 |
| Mapping and cartography score | 72 | 73 |
| Recognising infeasible requests score | 38 | 66 |
| Cost per task | $0.250 | $0.124 |
| Time per task | 6.7 min | 3.0 min |
| Tokens per attempt | 205k | 201k |
| Turns per attempt | 10.7 | 9.0 |
| Attempts decided | 238 | 551 |
| Input price per 1M tokens | $1.40 | $2.00 |
| Output price per 1M tokens | $4.40 | $10.00 |
| Context window | 1,048,576 | No data |
| Image input | No | No data |
| Developer | Z.ai | OpenAI |
Charts
Geospatial Agent Index
Equal-weight average of the evaluation scores, 0 to 100 · Higher is better
First eight selected entries in metric order. Full results in table view.
Data table: Geospatial Agent Index
| Model | Creator | Geospatial Agent Index | Range while attempts are pending | Benchmarks covered | Coverage (attempts) |
|---|---|---|---|---|---|
| Codex – GPT-6.1 Sol (xhigh) | OpenAI | 78* (partial: 2 of 3 attempts) | 74 to 79 | 4 of 4 | 551 of 870 planned attempts |
| Terminus-2 – GLM-5.3 (low) | Z.ai | 71* (partial: 0.9 of 3 attempts) | 61 to 72 | 4 of 4 | 238 of 290 planned attempts |
Codex – GPT-6.1 Sol (xhigh)
Terminus-2 – GLM-5.3 (low)Cost per task
Average cost per task (USD) · Lower is better
First eight selected entries in metric order. Full results in table view.
Data table: Cost per task
| Model | Creator | Cost per task | Coverage (attempts) |
|---|---|---|---|
| Terminus-2 – GLM-5.3 (low) | Z.ai | $0.250 | 258 of 290 planned attempts |
| Codex – GPT-6.1 Sol (xhigh) | OpenAI | $0.124 | 591 of 870 planned attempts |
Time per task
Average agent wall time per task · Lower is better
First eight selected entries in metric order. Full results in table view.
Data table: Time per task
| Model | Creator | Time per task | Coverage (attempts) |
|---|---|---|---|
| Terminus-2 – GLM-5.3 (low) | Z.ai | 6.7 min | 258 of 290 planned attempts |
| Codex – GPT-6.1 Sol (xhigh) | OpenAI | 3.0 min | 591 of 870 planned attempts |
Frequently asked questions
- Which scores higher on the Geospatial Agent Index, Terminus-2 – GLM-5.3 (low) or Codex – GPT-6.1 Sol (xhigh)?
- Codex – GPT-6.1 Sol (xhigh), at 78 against 71 for Terminus-2 – GLM-5.3 (low). Terminus-2 – GLM-5.3 (low): 238 of 290 planned attempts. Codex – GPT-6.1 Sol (xhigh): 551 of 870 planned attempts. Coverage is partial; scores can change as more attempts are decided.
- Which is cheaper per task, Terminus-2 – GLM-5.3 (low) or Codex – GPT-6.1 Sol (xhigh)?
- Codex – GPT-6.1 Sol (xhigh), at $0.124 against $0.250 for Terminus-2 – GLM-5.3 (low).
- Which is faster per task, Terminus-2 – GLM-5.3 (low) or Codex – GPT-6.1 Sol (xhigh)?
- Codex – GPT-6.1 Sol (xhigh), at 3.0 min against 6.7 min for Terminus-2 – GLM-5.3 (low).
- Which has the larger context window, Terminus-2 – GLM-5.3 (low) or Codex – GPT-6.1 Sol (xhigh)?
- Not known yet: Codex – GPT-6.1 Sol (xhigh) has no context window data.
More: Terminus-2 – GLM-5.3 (low) · Codex – GPT-6.1 Sol (xhigh) · all comparisons