Terminus-2 – Mistral Small 3.1 24B (Non-reasoning) vs. Claude Code – Claude Sonnet 5.5 (xhigh): geospatial agent comparison
Comparison between Terminus-2 – Mistral Small 3.1 24B (Non-reasoning) and Claude Code – Claude Sonnet 5.5 (xhigh) on the Geospatial Agent Index, each benchmark, cost, time and token use, from the same tasks, agent and limits. Methodology.
Side by side
| Metric | Terminus-2 – Mistral Small 3.1 24B (Non-reasoning) | Claude Code – Claude Sonnet 5.5 (xhigh) |
|---|---|---|
| Geospatial Agent Index | 0* (attempts per task: 1 on 9 of 290 tasks so far) | 74 (attempts per task: 1) |
| GeoAgentBench score | No data | 94 |
| GeoBenchX score | No data | 65 |
| Earth-Bench score | 0 | 48 |
| GeoAnalystBench score | No data | 89 |
| Raster and remote sensing score | 0 | 71 |
| Vector and overlay score | No data | 67 |
| Networks and routing score | No data | 100 |
| Climate and time series score | 0 | 71 |
| Spatial statistics and interpolation score | No data | 58 |
| Mapping and cartography score | No data | 75 |
| Recognising infeasible requests score | No data | 63 |
| Cost per task | $0.247 | $0.163 |
| Time per task | 15.6 min | 1.4 min |
| Tokens per attempt | 693k | 217k |
| Turns per attempt | 25.7 | 7.9 |
| Attempts decided | 9 | 290 |
| Input price per 1M tokens | $0.35 | $2.00 |
| Output price per 1M tokens | $0.56 | $10.00 |
| Context window | 128,000 | No data |
| Image input | Yes | No data |
| Developer | Mistral AI | Anthropic |
Charts
Geospatial Agent Index
Equal-weight average of the evaluation scores, 0 to 100 · Higher is better
First eight selected entries in metric order. Full results in table view.
Data table: Geospatial Agent Index
| Model | Creator | Geospatial Agent Index | Range while attempts are pending | Benchmarks covered | Coverage (attempts) |
|---|---|---|---|---|---|
| Claude Code – Claude Sonnet 5.5 (xhigh) | Anthropic | 74 (attempts per task: 1) | No pending judgements | 4 of 4 | 290 of 290 planned attempts |
| Terminus-2 – Mistral Small 3.1 24B (Non-reasoning) | Mistral AI | 0* (attempts per task: 1 on 9 of 290 tasks so far) | No pending judgements; coverage incomplete | 1 of 4 | 9 of 351 planned attempts |
Claude Code – Claude Sonnet 5.5 (xhigh)Cost per task
Average cost per task (USD) · Lower is better
First eight selected entries in metric order. Full results in table view.
Data table: Cost per task
| Model | Creator | Cost per task | Coverage (attempts) |
|---|---|---|---|
| Terminus-2 – Mistral Small 3.1 24B (Non-reasoning) | Mistral AI | $0.247 | 9 of 351 planned attempts |
| Claude Code – Claude Sonnet 5.5 (xhigh) | Anthropic | $0.163 | 290 of 290 planned attempts |
Time per task
Average agent wall time per task · Lower is better
First eight selected entries in metric order. Full results in table view.
Data table: Time per task
| Model | Creator | Time per task | Coverage (attempts) |
|---|---|---|---|
| Terminus-2 – Mistral Small 3.1 24B (Non-reasoning) | Mistral AI | 15.6 min | 9 of 351 planned attempts |
| Claude Code – Claude Sonnet 5.5 (xhigh) | Anthropic | 1.4 min | 290 of 290 planned attempts |
Frequently asked questions
- Which scores higher on the Geospatial Agent Index, Terminus-2 – Mistral Small 3.1 24B (Non-reasoning) or Claude Code – Claude Sonnet 5.5 (xhigh)?
- Not comparable yet: Terminus-2 – Mistral Small 3.1 24B (Non-reasoning) has scores on 1 of 4 benchmarks, so it is not yet ranked. Terminus-2 – Mistral Small 3.1 24B (Non-reasoning): 9 of 351 planned attempts. Claude Code – Claude Sonnet 5.5 (xhigh): 290 of 290 planned attempts. Coverage is partial; scores can change as more attempts are decided.
- Which is cheaper per task, Terminus-2 – Mistral Small 3.1 24B (Non-reasoning) or Claude Code – Claude Sonnet 5.5 (xhigh)?
- Claude Code – Claude Sonnet 5.5 (xhigh), at $0.163 against $0.247 for Terminus-2 – Mistral Small 3.1 24B (Non-reasoning).
- Which is faster per task, Terminus-2 – Mistral Small 3.1 24B (Non-reasoning) or Claude Code – Claude Sonnet 5.5 (xhigh)?
- Claude Code – Claude Sonnet 5.5 (xhigh), at 1.4 min against 15.6 min for Terminus-2 – Mistral Small 3.1 24B (Non-reasoning).
- Which has the larger context window, Terminus-2 – Mistral Small 3.1 24B (Non-reasoning) or Claude Code – Claude Sonnet 5.5 (xhigh)?
- Not known yet: Claude Code – Claude Sonnet 5.5 (xhigh) has no context window data.
More: Terminus-2 – Mistral Small 3.1 24B (Non-reasoning) · Claude Code – Claude Sonnet 5.5 (xhigh) · all comparisons