Axis Spatial

StepFun

Step 5 Preview (Reasoning)

In Terminus-2 · Open weights

Overview

In Terminus-2 it ranks 66th of 74 entries on the Geospatial Agent Index, at 33.8. It costs $0.071 per task, less than the median entry ($0.081) and takes 7.9 min per task, slower than the median entry (2.0 min).

Compare head to head: gpt-oss-20b (high), Terminus-2 · Mistral Large 3 (Non-reasoning), Terminus-2 · Gemini 3.1 Flash-Lite (minimal), Terminus-2 · gpt-oss-120b (low), Terminus-2 · GLM-4.7-Flash (Reasoning), Claude Code · gpt-oss-120b (high), Codex · all comparisons.

Technical specification

Developer
StepFun
Weights
Open
Harness
Terminus-2 2.0.0
Reasoning setting
Reasoning
Context window
1,024,000 tokens
Maximum output tokens
65,536
Image input
Yes
Temperature
0.6
Input price per 1M tokens
$1.00
Cached input price per 1M tokens
$0.050
Output price per 1M tokens
$2.70
Map and trace judge
Claude Sonnet 5.5
Reward hacking
1.9% of reviewed passing attempts flaggedSafety page

How models are selected.

Agent tasks by evaluation

All

Geospatial Agent Index: Text only

Equal average of Earth-Bench V2, GeoBenchX and GS-QA2, 0 to 100 · Higher is better

Geospatial Agent Index: Text onlyScores 0 to 100: Claude Opus 5.5 (xhigh), Claude Code: 85; GPT-6.1 Sol (xhigh), Codex: 82; Claude Sonnet 5.5 (xhigh), Claude Code: 79; Claude Haiku 5.5 (xhigh), Claude Code: 76; GLM-5.3 (max), Claude Code: 73; GPT-5.6 Luna (xhigh), Codex: 73; Kimi K3 (Reasoning), Terminus-2: 72; Kimi K2.7 Code (Reasoning), Kimi Code: 72; GLM-5.3-Flash (max), Claude Code: 72; Gemini 3.8 Flash (low), Terminus-2: 71; DeepSeek V4 Pro (max), Terminus-2: 71; DeepSeek V4.1 Flash (max), Codex: 71; GPT-5.6 Terra (high), Codex: 69; Qwen 3.8 27B (xhigh), Qwen Code: 68; Nemotron 3 Ultra (high), Terminus-2: 68; Gemini 3.1 Flash-Lite (high), Terminus-2: 56; Gemma 4 26B A4B (Reasoning), Terminus-2: 56; Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2: 52; MiniMax M3.1 Flash (max), Terminus-2: 51; gpt-oss-120b (high), Terminus-2: 46; Step 5 Preview (Reasoning), Terminus-2: 34; gpt-oss-20b (high), Terminus-2: 33; Mistral Large 3 (Non-reasoning), Terminus-2: 33; Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2: 20; Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2: 11; Llama 3.3 70B (Non-reasoning), Terminus-2: 80255075100Claude Opus 5.5 (xhigh)Claude Code85GPT-6.1 Sol (xhigh)Codex82Claude Sonnet 5.5 (xhigh)Claude Code79Claude Haiku 5.5 (xhigh)Claude Code76GLM-5.3 (max)Claude Code73GPT-5.6 Luna (xhigh)Codex73Kimi K3 (Reasoning)Terminus-272Kimi K2.7 Code (Reasoning)Kimi Code72GLM-5.3-Flash (max)Claude Code72Gemini 3.8 Flash (low)Terminus-271DeepSeek V4 Pro (max)Terminus-271DeepSeek V4.1 Flash (max)Codex71GPT-5.6 Terra (high)Codex69Qwen 3.8 27B (xhigh)Qwen Code68Nemotron 3 Ultra (high)Terminus-268Gemini 3.1 Flash-Lite (high)Terminus-256Gemma 4 26B A4B (Reasoning)Terminus-256Nemotron 3.5 Super VL 120B (Reasoning)Terminus-252MiniMax M3.1 Flash (max)Terminus-251gpt-oss-120b (high)Terminus-246Step 5 Preview (Reasoning)Terminus-234gpt-oss-20b (high)Terminus-233Mistral Large 3 (Non-reasoning)Terminus-233Nemotron 3 Nano Omni 30B (Reasoning)Terminus-220Nemotron 3.5 Lightning 30B (Reasoning)Terminus-211Llama 3.3 70B (Non-reasoning)Terminus-28
Data table: Geospatial Agent Index: Text only
Geospatial Agent Index: Text only
ModelDeveloperGeospatial Agent Index: Text only
Claude Opus 5.5 (xhigh), Claude CodeAnthropic85
Claude Opus 5.5 (high), Claude CodeAnthropic82
GPT-6.1 Sol (xhigh), CodexOpenAI82
GPT-6.1 Sol (medium), CodexOpenAI82
Claude Opus 5.5 (medium), Claude CodeAnthropic80
GPT-6.1 Sol (high), CodexOpenAI80
Claude Opus 5 (high), Claude CodeAnthropic80
GPT-6 Sol (high), CodexOpenAI80
Claude Sonnet 5.5 (xhigh), Claude CodeAnthropic79
Claude Sonnet 5.5 (high), Claude CodeAnthropic78
Claude Opus 4.8 (high), Claude CodeAnthropic76
Claude Haiku 5.5 (xhigh), Claude CodeAnthropic76
Claude Haiku 5.5 (high), Claude CodeAnthropic76
GPT-5.6 Sol (high), CodexOpenAI75
Claude Sonnet 5 (high), Claude CodeAnthropic74
Claude Opus 5.5 (low), Claude CodeAnthropic74
Claude Opus 4.7 (high), Claude CodeAnthropic74
GLM-5.3 (max), Claude CodeZ.ai73
GLM-5.2 (max), Claude CodeZ.ai73
GPT-5.6 Luna (xhigh), CodexOpenAI73
GPT-6 Luna (xhigh), CodexOpenAI73
Claude Haiku 5.5 (medium), Claude CodeAnthropic72
Kimi K3 (Reasoning), Terminus-2Moonshot AI72
DeepSeek V4 Flash (high), Terminus-2DeepSeek72
Kimi K2.7 Code (Reasoning), Kimi CodeMoonshot AI72
GLM-5.2 (max), Terminus-2Z.ai72
GPT-5.6 Luna (high), CodexOpenAI72
GLM-5.3-Flash (max), Claude CodeZ.ai72
GPT-6 Luna (high), CodexOpenAI71
Gemini 3.8 Flash (low), Terminus-2Google71
Kimi K2.7 Code (Reasoning), Terminus-2Moonshot AI71
DeepSeek V4 Pro (max), Terminus-2DeepSeek71
Claude Sonnet 5.5 (medium), Claude CodeAnthropic71
GLM-5.2 (high), Terminus-2Z.ai71
DeepSeek V4.1 Flash (max), CodexDeepSeek71
GLM-5.3 (max), Terminus-2Z.ai70
DeepSeek V4 Pro (high), Terminus-2DeepSeek70
Claude Haiku 5.5 (low), Claude CodeAnthropic70
Kimi K2.6 (Reasoning), Terminus-2Moonshot AI70
GPT-5.6 Terra (high), CodexOpenAI69
Claude Sonnet 5.5 (low), Claude CodeAnthropic69
DeepSeek V4 Flash (max), Terminus-2DeepSeek69
Kimi K2.6 (Reasoning), Kimi CodeMoonshot AI69
Qwen 3.8 27B (xhigh), Qwen CodeAlibaba (Qwen)68
Nemotron 3 Ultra (high), Terminus-2NVIDIA68
GPT-5.6 Luna (medium), CodexOpenAI66
GLM-5.3 (low), Terminus-2Z.ai66
GLM-5.2 (Non-reasoning), Terminus-2Z.ai63
GLM-5.3-Flash (max), Terminus-2Z.ai63
GLM-5.3-Flash (low), Terminus-2Z.ai62
Qwen 3.8 27B (xhigh), Terminus-2Alibaba (Qwen)61
GPT-5.6 Luna (low), CodexOpenAI61
DeepSeek V4 Flash (high), CodexDeepSeek59
Claude Haiku 4.5 (Reasoning), Claude CodeAnthropic58
GPT-6 Luna (medium), CodexOpenAI57
Gemini 3.1 Flash-Lite (high), Terminus-2Google56
Gemma 4 26B A4B (Reasoning), Terminus-2Google56
Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2NVIDIA52
GPT-6 Luna (low), CodexOpenAI51
MiniMax M3.1 Flash (max), Terminus-2MiniMax51
Gemini 3.1 Flash-Lite (low), Terminus-2Google48
gpt-oss-120b (high), Terminus-2OpenAI46
GLM-4.7-Flash (Reasoning), Terminus-2Z.ai43
gpt-oss-120b (high), CodexOpenAI43
GLM-4.7-Flash (Reasoning), Claude CodeZ.ai41
Step 5 Preview (Reasoning), Terminus-2StepFun34
gpt-oss-20b (high), Terminus-2OpenAI33
Mistral Large 3 (Non-reasoning), Terminus-2Mistral AI33
Gemini 3.1 Flash-Lite (minimal), Terminus-2Google32
gpt-oss-120b (low), Terminus-2OpenAI31
Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2NVIDIA20
Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2NVIDIA11
gpt-oss-20b (high), CodexOpenAI9
Llama 3.3 70B (Non-reasoning), Terminus-2Meta8

Open weights

Geospatial Agent Index: Text only

Equal average of Earth-Bench V2, GeoBenchX and GS-QA2, 0 to 100 · Higher is better

Geospatial Agent Index: Text onlyScores 0 to 100: GLM-5.3 (max), Claude Code: 73; Kimi K3 (Reasoning), Terminus-2: 72; Kimi K2.7 Code (Reasoning), Kimi Code: 72; GLM-5.3-Flash (max), Claude Code: 72; DeepSeek V4 Pro (max), Terminus-2: 71; DeepSeek V4.1 Flash (max), Codex: 71; Qwen 3.8 27B (xhigh), Qwen Code: 68; Nemotron 3 Ultra (high), Terminus-2: 68; Gemma 4 26B A4B (Reasoning), Terminus-2: 56; Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2: 52; MiniMax M3.1 Flash (max), Terminus-2: 51; gpt-oss-120b (high), Terminus-2: 46; Step 5 Preview (Reasoning), Terminus-2: 34; gpt-oss-20b (high), Terminus-2: 33; Mistral Large 3 (Non-reasoning), Terminus-2: 33; Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2: 20; Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2: 11; Llama 3.3 70B (Non-reasoning), Terminus-2: 80255075100GLM-5.3 (max)Claude Code73Kimi K3 (Reasoning)Terminus-272Kimi K2.7 Code (Reasoning)Kimi Code72GLM-5.3-Flash (max)Claude Code72DeepSeek V4 Pro (max)Terminus-271DeepSeek V4.1 Flash (max)Codex71Qwen 3.8 27B (xhigh)Qwen Code68Nemotron 3 Ultra (high)Terminus-268Gemma 4 26B A4B (Reasoning)Terminus-256Nemotron 3.5 Super VL 120B (Reasoning)Terminus-252MiniMax M3.1 Flash (max)Terminus-251gpt-oss-120b (high)Terminus-246Step 5 Preview (Reasoning)Terminus-234gpt-oss-20b (high)Terminus-233Mistral Large 3 (Non-reasoning)Terminus-233Nemotron 3 Nano Omni 30B (Reasoning)Terminus-220Nemotron 3.5 Lightning 30B (Reasoning)Terminus-211Llama 3.3 70B (Non-reasoning)Terminus-28
Data table: Geospatial Agent Index: Text only
Geospatial Agent Index: Text only
ModelDeveloperGeospatial Agent Index: Text only
GLM-5.3 (max), Claude CodeZ.ai73
GLM-5.2 (max), Claude CodeZ.ai73
Kimi K3 (Reasoning), Terminus-2Moonshot AI72
DeepSeek V4 Flash (high), Terminus-2DeepSeek72
Kimi K2.7 Code (Reasoning), Kimi CodeMoonshot AI72
GLM-5.2 (max), Terminus-2Z.ai72
GLM-5.3-Flash (max), Claude CodeZ.ai72
Kimi K2.7 Code (Reasoning), Terminus-2Moonshot AI71
DeepSeek V4 Pro (max), Terminus-2DeepSeek71
GLM-5.2 (high), Terminus-2Z.ai71
DeepSeek V4.1 Flash (max), CodexDeepSeek71
GLM-5.3 (max), Terminus-2Z.ai70
DeepSeek V4 Pro (high), Terminus-2DeepSeek70
Kimi K2.6 (Reasoning), Terminus-2Moonshot AI70
DeepSeek V4 Flash (max), Terminus-2DeepSeek69
Kimi K2.6 (Reasoning), Kimi CodeMoonshot AI69
Qwen 3.8 27B (xhigh), Qwen CodeAlibaba (Qwen)68
Nemotron 3 Ultra (high), Terminus-2NVIDIA68
GLM-5.3 (low), Terminus-2Z.ai66
GLM-5.2 (Non-reasoning), Terminus-2Z.ai63
GLM-5.3-Flash (max), Terminus-2Z.ai63
GLM-5.3-Flash (low), Terminus-2Z.ai62
Qwen 3.8 27B (xhigh), Terminus-2Alibaba (Qwen)61
DeepSeek V4 Flash (high), CodexDeepSeek59
Gemma 4 26B A4B (Reasoning), Terminus-2Google56
Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2NVIDIA52
MiniMax M3.1 Flash (max), Terminus-2MiniMax51
gpt-oss-120b (high), Terminus-2OpenAI46
GLM-4.7-Flash (Reasoning), Terminus-2Z.ai43
gpt-oss-120b (high), CodexOpenAI43
GLM-4.7-Flash (Reasoning), Claude CodeZ.ai41
Step 5 Preview (Reasoning), Terminus-2StepFun34
gpt-oss-20b (high), Terminus-2OpenAI33
Mistral Large 3 (Non-reasoning), Terminus-2Mistral AI33
gpt-oss-120b (low), Terminus-2OpenAI31
Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2NVIDIA20
Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2NVIDIA11
gpt-oss-20b (high), CodexOpenAI9
Llama 3.3 70B (Non-reasoning), Terminus-2Meta8

All

Earth-Bench V2 score

Share of tasks passed, 0 to 100 · Higher is better

Earth-Bench V2 scoreScores 0 to 100: Claude Opus 5.5 (xhigh), Claude Code: 77; GPT-6 Sol (high), Codex: 75; GLM-5.3 (max), Claude Code: 74; Kimi K3 (Reasoning), Terminus-2: 72; Kimi K2.7 Code (Reasoning), Kimi Code: 71; GLM-5.3-Flash (max), Claude Code: 69; Nemotron 3 Ultra (high), Terminus-2: 68; Claude Sonnet 5.5 (xhigh), Claude Code: 68; Claude Haiku 5.5 (xhigh), Claude Code: 68; Qwen 3.8 27B (xhigh), Qwen Code: 68; DeepSeek V4 Pro (max), Terminus-2: 67; GPT-6 Luna (xhigh), Codex: 67; DeepSeek V4.1 Flash (max), Codex: 66; GPT-5.6 Terra (high), Codex: 62; Gemini 3.1 Pro (preview) (high), Terminus-2: 59; Gemini 3.8 Flash (low), Terminus-2: 54; Gemini 3.1 Flash-Lite (high), Terminus-2: 53; gpt-oss-120b (high), Terminus-2: 50; Gemma 4 26B A4B (Reasoning), Terminus-2: 46; Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2: 46; MiniMax M3.1 Flash (max), Terminus-2: 39; gpt-oss-20b (high), Terminus-2: 32; Step 5 Preview (Reasoning), Terminus-2: 32; Mistral Large 3 (Non-reasoning), Terminus-2: 31; Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2: 29; Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2: 16; Llama 3.3 70B (Non-reasoning), Terminus-2: 90255075100Claude Opus 5.5 (xhigh)Claude Code77GPT-6 Sol (high)Codex75GLM-5.3 (max)Claude Code74Kimi K3 (Reasoning)Terminus-272Kimi K2.7 Code (Reasoning)Kimi Code71GLM-5.3-Flash (max)Claude Code69Nemotron 3 Ultra (high)Terminus-268Claude Sonnet 5.5 (xhigh)Claude Code68Claude Haiku 5.5 (xhigh)Claude Code68Qwen 3.8 27B (xhigh)Qwen Code68DeepSeek V4 Pro (max)Terminus-267GPT-6 Luna (xhigh)Codex67DeepSeek V4.1 Flash (max)Codex66GPT-5.6 Terra (high)Codex62Gemini 3.1 Pro (preview) (high)Terminus-259Gemini 3.8 Flash (low)Terminus-254Gemini 3.1 Flash-Lite (high)Terminus-253gpt-oss-120b (high)Terminus-250Gemma 4 26B A4B (Reasoning)Terminus-246Nemotron 3.5 Super VL 120B (Reasoning)Terminus-246MiniMax M3.1 Flash (max)Terminus-239gpt-oss-20b (high)Terminus-232Step 5 Preview (Reasoning)Terminus-232Mistral Large 3 (Non-reasoning)Terminus-231Nemotron 3 Nano Omni 30B (Reasoning)Terminus-229Nemotron 3.5 Lightning 30B (Reasoning)Terminus-216Llama 3.3 70B (Non-reasoning)Terminus-29
How to read this chart

About this evaluation. Earth observation data analysis. Earth-Bench V2 results and background.

Data table: Earth-Bench V2 score
Earth-Bench V2 score
ModelDeveloperEarth-Bench V2 score
Claude Opus 5.5 (high), Claude CodeAnthropic79
Claude Opus 5.5 (xhigh), Claude CodeAnthropic77
GPT-6 Sol (medium), CodexOpenAI77
GPT-6 Sol (high), CodexOpenAI75
GLM-5.3 (max), Claude CodeZ.ai74
Claude Opus 5 (high), Claude CodeAnthropic74
DeepSeek V4 Flash (high), Terminus-2DeepSeek72
Kimi K3 (Reasoning), Terminus-2Moonshot AI72
Claude Opus 5.5 (medium), Claude CodeAnthropic72
Claude Haiku 5.5 (high), Claude CodeAnthropic72
GPT-6.1 Sol (medium), CodexOpenAI72
GPT-6.1 Sol (high), CodexOpenAI72
GPT-6.1 Sol (xhigh), CodexOpenAI72
GLM-5.2 (max), Claude CodeZ.ai71
Kimi K2.7 Code (Reasoning), Kimi CodeMoonshot AI71
Claude Sonnet 5.5 (high), Claude CodeAnthropic71
Claude Opus 4.8 (high), Claude CodeAnthropic71
Kimi K2.7 Code (Reasoning), Terminus-2Moonshot AI69
Claude Opus 4.7 (high), Claude CodeAnthropic69
GLM-5.3-Flash (max), Claude CodeZ.ai69
DeepSeek V4 Pro (high), Terminus-2DeepSeek68
Nemotron 3 Ultra (high), Terminus-2NVIDIA68
Claude Sonnet 5.5 (xhigh), Claude CodeAnthropic68
Claude Haiku 5.5 (xhigh), Claude CodeAnthropic68
Claude Sonnet 5 (high), Claude CodeAnthropic68
GPT-5.6 Sol (high), CodexOpenAI68
GLM-5.2 (high), Terminus-2Z.ai68
GLM-5.2 (max), Terminus-2Z.ai68
Kimi K2.6 (Reasoning), Terminus-2Moonshot AI68
Qwen 3.8 27B (xhigh), Qwen CodeAlibaba (Qwen)68
Claude Haiku 5.5 (medium), Claude CodeAnthropic68
DeepSeek V4 Pro (max), Terminus-2DeepSeek67
GPT-6 Luna (xhigh), CodexOpenAI67
GPT-5.6 Luna (high), CodexOpenAI67
DeepSeek V4.1 Flash (max), CodexDeepSeek66
DeepSeek V4 Flash (max), Terminus-2DeepSeek66
GPT-5.6 Luna (xhigh), CodexOpenAI65
GLM-5.3 (max), Terminus-2Z.ai64
Kimi K2.6 (Reasoning), Kimi CodeMoonshot AI63
GPT-6 Luna (high), CodexOpenAI63
Claude Haiku 5.5 (low), Claude CodeAnthropic62
GPT-5.6 Terra (high), CodexOpenAI62
Claude Sonnet 4.6 (high), Terminus-2Anthropic59
Gemini 3.1 Pro (preview) (high), Terminus-2Google59
Claude Opus 5.5 (low), Claude CodeAnthropic59
GLM-5.2 (Non-reasoning), Terminus-2Z.ai58
Claude Sonnet 5.5 (medium), Claude CodeAnthropic58
GLM-5.3 (low), Terminus-2Z.ai57
DeepSeek V4 Pro (high), CodexDeepSeek57
DeepSeek V4 Flash (high), CodexDeepSeek57
GPT-5.6 Luna (medium), CodexOpenAI56
Claude Sonnet 5.5 (low), Claude CodeAnthropic56
Gemini 3.8 Flash (low), Terminus-2Google54
Gemini 3.1 Flash-Lite (high), Terminus-2Google53
GLM-5.3-Flash (low), Terminus-2Z.ai53
GLM-5.3-Flash (max), Terminus-2Z.ai51
Claude Haiku 4.5 (Reasoning), Claude CodeAnthropic51
gpt-oss-120b (high), Terminus-2OpenAI50
GPT-6 Luna (medium), CodexOpenAI50
gpt-oss-120b (high), CodexOpenAI49
Gemma 4 26B A4B (Reasoning), Terminus-2Google46
Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2NVIDIA46
Gemini 3.8 Flash (high), Terminus-2Google44
GLM-4.7-Flash (Reasoning), Terminus-2Z.ai44
GPT-5.6 Luna (low), CodexOpenAI44
Qwen 3.8 27B (xhigh), Terminus-2Alibaba (Qwen)44
GPT-6 Luna (low), CodexOpenAI44
Gemini 3.1 Flash-Lite (low), Terminus-2Google43
Gemini 3.1 Pro (preview) (low), Terminus-2Google41
MiniMax M3.1 Flash (max), Terminus-2MiniMax39
GLM-4.7-Flash (Reasoning), Claude CodeZ.ai38
Gemini 3.1 Flash-Lite (minimal), Terminus-2Google34
gpt-oss-20b (high), Terminus-2OpenAI32
Step 5 Preview (Reasoning), Terminus-2StepFun32
Mistral Large 3 (Non-reasoning), Terminus-2Mistral AI31
Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2NVIDIA29
gpt-oss-120b (low), Terminus-2OpenAI28
Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2NVIDIA16
Llama 3.3 70B (Non-reasoning), Terminus-2Meta9
gpt-oss-20b (high), CodexOpenAI6

Open weights

Earth-Bench V2 score

Share of tasks passed, 0 to 100 · Higher is better

Earth-Bench V2 scoreScores 0 to 100: GLM-5.3 (max), Claude Code: 74; Kimi K3 (Reasoning), Terminus-2: 72; Kimi K2.7 Code (Reasoning), Kimi Code: 71; GLM-5.3-Flash (max), Claude Code: 69; Nemotron 3 Ultra (high), Terminus-2: 68; Qwen 3.8 27B (xhigh), Qwen Code: 68; DeepSeek V4 Pro (max), Terminus-2: 67; DeepSeek V4.1 Flash (max), Codex: 66; gpt-oss-120b (high), Terminus-2: 50; Gemma 4 26B A4B (Reasoning), Terminus-2: 46; Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2: 46; MiniMax M3.1 Flash (max), Terminus-2: 39; gpt-oss-20b (high), Terminus-2: 32; Step 5 Preview (Reasoning), Terminus-2: 32; Mistral Large 3 (Non-reasoning), Terminus-2: 31; Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2: 29; Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2: 16; Llama 3.3 70B (Non-reasoning), Terminus-2: 90255075100GLM-5.3 (max)Claude Code74Kimi K3 (Reasoning)Terminus-272Kimi K2.7 Code (Reasoning)Kimi Code71GLM-5.3-Flash (max)Claude Code69Nemotron 3 Ultra (high)Terminus-268Qwen 3.8 27B (xhigh)Qwen Code68DeepSeek V4 Pro (max)Terminus-267DeepSeek V4.1 Flash (max)Codex66gpt-oss-120b (high)Terminus-250Gemma 4 26B A4B (Reasoning)Terminus-246Nemotron 3.5 Super VL 120B (Reasoning)Terminus-246MiniMax M3.1 Flash (max)Terminus-239gpt-oss-20b (high)Terminus-232Step 5 Preview (Reasoning)Terminus-232Mistral Large 3 (Non-reasoning)Terminus-231Nemotron 3 Nano Omni 30B (Reasoning)Terminus-229Nemotron 3.5 Lightning 30B (Reasoning)Terminus-216Llama 3.3 70B (Non-reasoning)Terminus-29
How to read this chart

About this evaluation. Earth observation data analysis. Earth-Bench V2 results and background.

Data table: Earth-Bench V2 score
Earth-Bench V2 score
ModelDeveloperEarth-Bench V2 score
GLM-5.3 (max), Claude CodeZ.ai74
DeepSeek V4 Flash (high), Terminus-2DeepSeek72
Kimi K3 (Reasoning), Terminus-2Moonshot AI72
GLM-5.2 (max), Claude CodeZ.ai71
Kimi K2.7 Code (Reasoning), Kimi CodeMoonshot AI71
Kimi K2.7 Code (Reasoning), Terminus-2Moonshot AI69
GLM-5.3-Flash (max), Claude CodeZ.ai69
DeepSeek V4 Pro (high), Terminus-2DeepSeek68
Nemotron 3 Ultra (high), Terminus-2NVIDIA68
GLM-5.2 (high), Terminus-2Z.ai68
GLM-5.2 (max), Terminus-2Z.ai68
Kimi K2.6 (Reasoning), Terminus-2Moonshot AI68
Qwen 3.8 27B (xhigh), Qwen CodeAlibaba (Qwen)68
DeepSeek V4 Pro (max), Terminus-2DeepSeek67
DeepSeek V4.1 Flash (max), CodexDeepSeek66
DeepSeek V4 Flash (max), Terminus-2DeepSeek66
GLM-5.3 (max), Terminus-2Z.ai64
Kimi K2.6 (Reasoning), Kimi CodeMoonshot AI63
GLM-5.2 (Non-reasoning), Terminus-2Z.ai58
GLM-5.3 (low), Terminus-2Z.ai57
DeepSeek V4 Pro (high), CodexDeepSeek57
DeepSeek V4 Flash (high), CodexDeepSeek57
GLM-5.3-Flash (low), Terminus-2Z.ai53
GLM-5.3-Flash (max), Terminus-2Z.ai51
gpt-oss-120b (high), Terminus-2OpenAI50
gpt-oss-120b (high), CodexOpenAI49
Gemma 4 26B A4B (Reasoning), Terminus-2Google46
Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2NVIDIA46
GLM-4.7-Flash (Reasoning), Terminus-2Z.ai44
Qwen 3.8 27B (xhigh), Terminus-2Alibaba (Qwen)44
MiniMax M3.1 Flash (max), Terminus-2MiniMax39
GLM-4.7-Flash (Reasoning), Claude CodeZ.ai38
gpt-oss-20b (high), Terminus-2OpenAI32
Step 5 Preview (Reasoning), Terminus-2StepFun32
Mistral Large 3 (Non-reasoning), Terminus-2Mistral AI31
Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2NVIDIA29
gpt-oss-120b (low), Terminus-2OpenAI28
Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2NVIDIA16
Llama 3.3 70B (Non-reasoning), Terminus-2Meta9
gpt-oss-20b (high), CodexOpenAI6

All

GeoBenchX score

Share of tasks passed, 0 to 100 · Higher is better

GeoBenchX scoreScores 0 to 100: Claude Opus 5.5 (xhigh), Claude Code: 83; Claude Sonnet 5.5 (xhigh), Claude Code: 81; GPT-6.1 Sol (xhigh), Codex: 79; Claude Haiku 5.5 (xhigh), Claude Code: 77; Gemini 3.8 Flash (low), Terminus-2: 74; GPT-6 Luna (xhigh), Codex: 73; Gemini 3.1 Pro (preview) (high), Terminus-2: 73; GLM-5.3-Flash (max), Claude Code: 70; GLM-5.2 (max), Terminus-2: 67; DeepSeek V4 Pro (max), Terminus-2: 67; GPT-5.6 Terra (high), Codex: 67; Qwen 3.8 27B (xhigh), Terminus-2: 66; Nemotron 3 Ultra (high), Terminus-2: 65; Kimi K3 (Reasoning), Terminus-2: 64; Kimi K2.7 Code (Reasoning), Kimi Code: 64; Gemma 4 26B A4B (Reasoning), Terminus-2: 63; DeepSeek V4 Flash (max), Terminus-2: 62; Gemini 3.1 Flash-Lite (high), Terminus-2: 61; gpt-oss-120b (high), Codex: 55; Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2: 53; MiniMax M3.1 Flash (max), Terminus-2: 41; gpt-oss-20b (high), Terminus-2: 38; Mistral Large 3 (Non-reasoning), Terminus-2: 29; Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2: 21; Step 5 Preview (Reasoning), Terminus-2: 17; Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2: 12; Llama 3.3 70B (Non-reasoning), Terminus-2: 60255075100Claude Opus 5.5 (xhigh)Claude Code83Claude Sonnet 5.5 (xhigh)Claude Code81GPT-6.1 Sol (xhigh)Codex79Claude Haiku 5.5 (xhigh)Claude Code77Gemini 3.8 Flash (low)Terminus-274GPT-6 Luna (xhigh)Codex73Gemini 3.1 Pro (preview) (high)Terminus-273GLM-5.3-Flash (max)Claude Code70GLM-5.2 (max)Terminus-267DeepSeek V4 Pro (max)Terminus-267GPT-5.6 Terra (high)Codex67Qwen 3.8 27B (xhigh)Terminus-266Nemotron 3 Ultra (high)Terminus-265Kimi K3 (Reasoning)Terminus-264Kimi K2.7 Code (Reasoning)Kimi Code64Gemma 4 26B A4B (Reasoning)Terminus-263DeepSeek V4 Flash (max)Terminus-262Gemini 3.1 Flash-Lite (high)Terminus-261gpt-oss-120b (high)Codex55Nemotron 3.5 Super VL 120B (Reasoning)Terminus-253MiniMax M3.1 Flash (max)Terminus-241gpt-oss-20b (high)Terminus-238Mistral Large 3 (Non-reasoning)Terminus-229Nemotron 3 Nano Omni 30B (Reasoning)Terminus-221Step 5 Preview (Reasoning)Terminus-217Nemotron 3.5 Lightning 30B (Reasoning)Terminus-212Llama 3.3 70B (Non-reasoning)Terminus-26
How to read this chart

About this evaluation. Maps, numbers and lists from country and city data; some tasks should be declined. GeoBenchX results and background.

Data table: GeoBenchX score
GeoBenchX score
ModelDeveloperGeoBenchX score
Claude Opus 5.5 (xhigh), Claude CodeAnthropic83
Claude Sonnet 5.5 (high), Claude CodeAnthropic81
Claude Sonnet 5.5 (xhigh), Claude CodeAnthropic81
Claude Opus 5.5 (medium), Claude CodeAnthropic79
GPT-6.1 Sol (medium), CodexOpenAI79
GPT-6.1 Sol (xhigh), CodexOpenAI79
Claude Opus 5.5 (high), Claude CodeAnthropic79
Claude Haiku 5.5 (xhigh), Claude CodeAnthropic77
Claude Sonnet 5 (high), Claude CodeAnthropic77
Claude Opus 5.5 (low), Claude CodeAnthropic77
Claude Sonnet 5.5 (low), Claude CodeAnthropic77
GPT-6.1 Sol (high), CodexOpenAI77
Claude Sonnet 5.5 (medium), Claude CodeAnthropic76
GPT-6 Sol (medium), CodexOpenAI75
Claude Opus 5 (high), Claude CodeAnthropic75
GPT-6 Sol (high), CodexOpenAI75
Gemini 3.1 Pro (preview) (low), Terminus-2Google74
Gemini 3.8 Flash (low), Terminus-2Google74
GPT-6 Luna (high), CodexOpenAI74
Gemini 3.1 Pro (preview) (high), Terminus-2Google73
Claude Opus 4.8 (high), Claude CodeAnthropic73
GPT-6 Luna (xhigh), CodexOpenAI73
Claude Haiku 5.5 (low), Claude CodeAnthropic73
Claude Opus 4.7 (high), Claude CodeAnthropic73
Claude Haiku 5.5 (high), Claude CodeAnthropic72
Claude Haiku 5.5 (medium), Claude CodeAnthropic71
GLM-5.3-Flash (max), Claude CodeZ.ai70
GPT-5.6 Sol (high), CodexOpenAI70
GPT-5.6 Luna (xhigh), CodexOpenAI68
GLM-5.2 (max), Terminus-2Z.ai67
GPT-5.6 Luna (high), CodexOpenAI67
DeepSeek V4 Pro (max), Terminus-2DeepSeek67
GLM-5.2 (high), Terminus-2Z.ai67
GPT-5.6 Terra (high), CodexOpenAI67
Qwen 3.8 27B (xhigh), Terminus-2Alibaba (Qwen)66
GLM-5.2 (max), Claude CodeZ.ai66
DeepSeek V4 Pro (high), CodexDeepSeek66
DeepSeek V4 Pro (high), Terminus-2DeepSeek65
DeepSeek V4 Flash (high), Terminus-2DeepSeek65
GLM-5.3 (max), Terminus-2Z.ai65
Nemotron 3 Ultra (high), Terminus-2NVIDIA65
GLM-5.3 (max), Claude CodeZ.ai65
Kimi K2.6 (Reasoning), Terminus-2Moonshot AI64
Kimi K3 (Reasoning), Terminus-2Moonshot AI64
Kimi K2.6 (Reasoning), Kimi CodeMoonshot AI64
Kimi K2.7 Code (Reasoning), Kimi CodeMoonshot AI64
Gemma 4 26B A4B (Reasoning), Terminus-2Google63
GPT-5.6 Luna (medium), CodexOpenAI63
DeepSeek V4 Flash (max), Terminus-2DeepSeek62
Kimi K2.7 Code (Reasoning), Terminus-2Moonshot AI62
Qwen 3.8 27B (xhigh), Qwen CodeAlibaba (Qwen)62
GPT-5.6 Luna (low), CodexOpenAI62
Gemini 3.1 Flash-Lite (high), Terminus-2Google61
GLM-5.2 (Non-reasoning), Terminus-2Z.ai60
GLM-5.3 (low), Terminus-2Z.ai60
GPT-6 Luna (medium), CodexOpenAI57
Claude Sonnet 4.6 (high), Terminus-2Anthropic57
GLM-5.3-Flash (low), Terminus-2Z.ai57
GLM-5.3-Flash (max), Terminus-2Z.ai57
DeepSeek V4.1 Flash (max), CodexDeepSeek56
gpt-oss-120b (high), CodexOpenAI55
Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2NVIDIA53
Claude Haiku 4.5 (Reasoning), Claude CodeAnthropic53
GPT-6 Luna (low), CodexOpenAI51
Gemini 3.1 Flash-Lite (low), Terminus-2Google51
Gemini 3.8 Flash (high), Terminus-2Google51
DeepSeek V4 Flash (high), CodexDeepSeek47
gpt-oss-120b (high), Terminus-2OpenAI45
Gemini 3.1 Flash-Lite (minimal), Terminus-2Google44
GLM-4.7-Flash (Reasoning), Terminus-2Z.ai42
MiniMax M3.1 Flash (max), Terminus-2MiniMax41
GLM-4.7-Flash (Reasoning), Claude CodeZ.ai39
gpt-oss-20b (high), Terminus-2OpenAI38
gpt-oss-120b (low), Terminus-2OpenAI37
Mistral Large 3 (Non-reasoning), Terminus-2Mistral AI29
Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2NVIDIA21
Step 5 Preview (Reasoning), Terminus-2StepFun17
Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2NVIDIA12
gpt-oss-20b (high), CodexOpenAI10
Llama 3.3 70B (Non-reasoning), Terminus-2Meta6

Open weights

GeoBenchX score

Share of tasks passed, 0 to 100 · Higher is better

GeoBenchX scoreScores 0 to 100: GLM-5.3-Flash (max), Claude Code: 70; GLM-5.2 (max), Terminus-2: 67; DeepSeek V4 Pro (max), Terminus-2: 67; Qwen 3.8 27B (xhigh), Terminus-2: 66; Nemotron 3 Ultra (high), Terminus-2: 65; Kimi K3 (Reasoning), Terminus-2: 64; Kimi K2.7 Code (Reasoning), Kimi Code: 64; Gemma 4 26B A4B (Reasoning), Terminus-2: 63; DeepSeek V4 Flash (max), Terminus-2: 62; gpt-oss-120b (high), Codex: 55; Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2: 53; MiniMax M3.1 Flash (max), Terminus-2: 41; gpt-oss-20b (high), Terminus-2: 38; Mistral Large 3 (Non-reasoning), Terminus-2: 29; Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2: 21; Step 5 Preview (Reasoning), Terminus-2: 17; Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2: 12; Llama 3.3 70B (Non-reasoning), Terminus-2: 60255075100GLM-5.3-Flash (max)Claude Code70GLM-5.2 (max)Terminus-267DeepSeek V4 Pro (max)Terminus-267Qwen 3.8 27B (xhigh)Terminus-266Nemotron 3 Ultra (high)Terminus-265Kimi K3 (Reasoning)Terminus-264Kimi K2.7 Code (Reasoning)Kimi Code64Gemma 4 26B A4B (Reasoning)Terminus-263DeepSeek V4 Flash (max)Terminus-262gpt-oss-120b (high)Codex55Nemotron 3.5 Super VL 120B (Reasoning)Terminus-253MiniMax M3.1 Flash (max)Terminus-241gpt-oss-20b (high)Terminus-238Mistral Large 3 (Non-reasoning)Terminus-229Nemotron 3 Nano Omni 30B (Reasoning)Terminus-221Step 5 Preview (Reasoning)Terminus-217Nemotron 3.5 Lightning 30B (Reasoning)Terminus-212Llama 3.3 70B (Non-reasoning)Terminus-26
How to read this chart

About this evaluation. Maps, numbers and lists from country and city data; some tasks should be declined. GeoBenchX results and background.

Data table: GeoBenchX score
GeoBenchX score
ModelDeveloperGeoBenchX score
GLM-5.3-Flash (max), Claude CodeZ.ai70
GLM-5.2 (max), Terminus-2Z.ai67
DeepSeek V4 Pro (max), Terminus-2DeepSeek67
GLM-5.2 (high), Terminus-2Z.ai67
Qwen 3.8 27B (xhigh), Terminus-2Alibaba (Qwen)66
GLM-5.2 (max), Claude CodeZ.ai66
DeepSeek V4 Pro (high), CodexDeepSeek66
DeepSeek V4 Pro (high), Terminus-2DeepSeek65
DeepSeek V4 Flash (high), Terminus-2DeepSeek65
GLM-5.3 (max), Terminus-2Z.ai65
Nemotron 3 Ultra (high), Terminus-2NVIDIA65
GLM-5.3 (max), Claude CodeZ.ai65
Kimi K2.6 (Reasoning), Terminus-2Moonshot AI64
Kimi K3 (Reasoning), Terminus-2Moonshot AI64
Kimi K2.6 (Reasoning), Kimi CodeMoonshot AI64
Kimi K2.7 Code (Reasoning), Kimi CodeMoonshot AI64
Gemma 4 26B A4B (Reasoning), Terminus-2Google63
DeepSeek V4 Flash (max), Terminus-2DeepSeek62
Kimi K2.7 Code (Reasoning), Terminus-2Moonshot AI62
Qwen 3.8 27B (xhigh), Qwen CodeAlibaba (Qwen)62
GLM-5.2 (Non-reasoning), Terminus-2Z.ai60
GLM-5.3 (low), Terminus-2Z.ai60
GLM-5.3-Flash (low), Terminus-2Z.ai57
GLM-5.3-Flash (max), Terminus-2Z.ai57
DeepSeek V4.1 Flash (max), CodexDeepSeek56
gpt-oss-120b (high), CodexOpenAI55
Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2NVIDIA53
DeepSeek V4 Flash (high), CodexDeepSeek47
gpt-oss-120b (high), Terminus-2OpenAI45
GLM-4.7-Flash (Reasoning), Terminus-2Z.ai42
MiniMax M3.1 Flash (max), Terminus-2MiniMax41
GLM-4.7-Flash (Reasoning), Claude CodeZ.ai39
gpt-oss-20b (high), Terminus-2OpenAI38
gpt-oss-120b (low), Terminus-2OpenAI37
Mistral Large 3 (Non-reasoning), Terminus-2Mistral AI29
Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2NVIDIA21
Step 5 Preview (Reasoning), Terminus-2StepFun17
Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2NVIDIA12
gpt-oss-20b (high), CodexOpenAI10
Llama 3.3 70B (Non-reasoning), Terminus-2Meta6

All

GS-QA2 score

Share of tasks passed, 0 to 100 · Higher is better

GS-QA2 scoreScores 0 to 100: GPT-6.1 Sol (xhigh), Codex: 94; Claude Opus 5.5 (xhigh), Claude Code: 94; DeepSeek V4.1 Flash (max), Codex: 89; Claude Sonnet 5.5 (xhigh), Claude Code: 87; Gemini 3.8 Flash (low), Terminus-2: 86; GPT-5.6 Luna (xhigh), Codex: 85; GLM-5.2 (max), Claude Code: 83; Kimi K2.7 Code (Reasoning), Terminus-2: 82; Claude Haiku 5.5 (xhigh), Claude Code: 81; Kimi K3 (Reasoning), Terminus-2: 80; GPT-5.6 Terra (high), Codex: 80; DeepSeek V4 Pro (max), Terminus-2: 80; GLM-5.3-Flash (max), Terminus-2: 80; Qwen 3.8 27B (xhigh), Qwen Code: 75; MiniMax M3.1 Flash (max), Terminus-2: 71; Nemotron 3 Ultra (high), Terminus-2: 70; Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2: 59; Gemma 4 26B A4B (Reasoning), Terminus-2: 58; Gemini 3.1 Flash-Lite (high), Terminus-2: 55; Step 5 Preview (Reasoning), Terminus-2: 52; gpt-oss-120b (high), Terminus-2: 42; Mistral Large 3 (Non-reasoning), Terminus-2: 39; gpt-oss-20b (high), Terminus-2: 30; Llama 3.3 70B (Non-reasoning), Terminus-2: 10; Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2: 9; Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2: 40255075100GPT-6.1 Sol (xhigh)Codex94Claude Opus 5.5 (xhigh)Claude Code94DeepSeek V4.1 Flash (max)Codex89Claude Sonnet 5.5 (xhigh)Claude Code87Gemini 3.8 Flash (low)Terminus-286GPT-5.6 Luna (xhigh)Codex85GLM-5.2 (max)Claude Code83Kimi K2.7 Code (Reasoning)Terminus-282Claude Haiku 5.5 (xhigh)Claude Code81Kimi K3 (Reasoning)Terminus-280GPT-5.6 Terra (high)Codex80DeepSeek V4 Pro (max)Terminus-280GLM-5.3-Flash (max)Terminus-280Qwen 3.8 27B (xhigh)Qwen Code75MiniMax M3.1 Flash (max)Terminus-271Nemotron 3 Ultra (high)Terminus-270Nemotron 3.5 Super VL 120B (Reasoning)Terminus-259Gemma 4 26B A4B (Reasoning)Terminus-258Gemini 3.1 Flash-Lite (high)Terminus-255Step 5 Preview (Reasoning)Terminus-252gpt-oss-120b (high)Terminus-242Mistral Large 3 (Non-reasoning)Terminus-239gpt-oss-20b (high)Terminus-230Llama 3.3 70B (Non-reasoning)Terminus-210Nemotron 3 Nano Omni 30B (Reasoning)Terminus-29Nemotron 3.5 Lightning 30B (Reasoning)Terminus-24
How to read this chart

About this evaluation. Spatial data reasoning over map and elevation data. GS-QA2 results and background.

Data table: GS-QA2 score
GS-QA2 score
ModelDeveloperGS-QA2 score
GPT-5.6 Sol (medium), CodexOpenAI100
Claude Opus 5.5 (xhigh), Claude CodeAnthropic94
GPT-6.1 Sol (xhigh), CodexOpenAI94
GPT-6.1 Sol (medium), CodexOpenAI93
GPT-6.1 Sol (high), CodexOpenAI93
Claude Opus 5 (high), Claude CodeAnthropic91
Claude Opus 5.5 (medium), Claude CodeAnthropic90
Claude Opus 5.5 (high), Claude CodeAnthropic90
DeepSeek V4.1 Flash (max), CodexDeepSeek89
GPT-6 Sol (high), CodexOpenAI89
Claude Sonnet 5.5 (xhigh), Claude CodeAnthropic87
GPT-6 Sol (medium), CodexOpenAI87
GPT-5.6 Sol (high), CodexOpenAI87
Claude Opus 5.5 (low), Claude CodeAnthropic86
Gemini 3.8 Flash (low), Terminus-2Google86
GPT-5.6 Luna (xhigh), CodexOpenAI85
Claude Opus 4.8 (high), Claude CodeAnthropic84
Claude Haiku 5.5 (high), Claude CodeAnthropic83
Claude Sonnet 5.5 (high), Claude CodeAnthropic83
GLM-5.2 (max), Claude CodeZ.ai83
GLM-5.3 (max), Terminus-2Z.ai83
Kimi K2.7 Code (Reasoning), Terminus-2Moonshot AI82
Claude Haiku 5.5 (xhigh), Claude CodeAnthropic81
GLM-5.3 (max), Claude CodeZ.ai81
GPT-5.6 Luna (high), CodexOpenAI81
GLM-5.2 (max), Terminus-2Z.ai80
Kimi K2.7 Code (Reasoning), Kimi CodeMoonshot AI80
Kimi K3 (Reasoning), Terminus-2Moonshot AI80
GPT-5.6 Luna (medium), CodexOpenAI80
Kimi K2.6 (Reasoning), Kimi CodeMoonshot AI80
GPT-5.6 Terra (high), CodexOpenAI80
GLM-5.3 (low), Terminus-2Z.ai80
DeepSeek V4 Pro (max), Terminus-2DeepSeek80
GLM-5.3-Flash (max), Terminus-2Z.ai80
DeepSeek V4 Flash (max), Terminus-2DeepSeek80
DeepSeek V4 Flash (high), Terminus-2DeepSeek79
Claude Haiku 5.5 (medium), Claude CodeAnthropic79
Claude Opus 4.7 (high), Claude CodeAnthropic79
Claude Sonnet 5.5 (medium), Claude CodeAnthropic79
GLM-5.2 (high), Terminus-2Z.ai78
GPT-6 Luna (xhigh), CodexOpenAI78
Claude Sonnet 5 (high), Claude CodeAnthropic77
DeepSeek V4 Pro (high), Terminus-2DeepSeek77
Kimi K2.6 (Reasoning), Terminus-2Moonshot AI77
GPT-6 Luna (high), CodexOpenAI77
GLM-5.3-Flash (max), Claude CodeZ.ai76
GPT-5.6 Luna (low), CodexOpenAI76
GLM-5.3-Flash (low), Terminus-2Z.ai76
Claude Sonnet 5.5 (low), Claude CodeAnthropic76
Qwen 3.8 27B (xhigh), Qwen CodeAlibaba (Qwen)75
Claude Haiku 5.5 (low), Claude CodeAnthropic75
DeepSeek V4 Flash (high), CodexDeepSeek74
Qwen 3.8 27B (xhigh), Terminus-2Alibaba (Qwen)74
GLM-5.2 (Non-reasoning), Terminus-2Z.ai72
MiniMax M3.1 Flash (max), Terminus-2MiniMax71
Nemotron 3 Ultra (high), Terminus-2NVIDIA70
Claude Haiku 4.5 (Reasoning), Claude CodeAnthropic69
GPT-6 Luna (medium), CodexOpenAI65
GPT-6 Luna (low), CodexOpenAI59
Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2NVIDIA59
Gemma 4 26B A4B (Reasoning), Terminus-2Google58
Gemini 3.1 Flash-Lite (high), Terminus-2Google55
Step 5 Preview (Reasoning), Terminus-2StepFun52
Gemini 3.1 Flash-Lite (low), Terminus-2Google49
GLM-4.7-Flash (Reasoning), Claude CodeZ.ai48
GLM-4.7-Flash (Reasoning), Terminus-2Z.ai43
gpt-oss-120b (high), Terminus-2OpenAI42
Mistral Large 3 (Non-reasoning), Terminus-2Mistral AI39
gpt-oss-20b (high), Terminus-2OpenAI30
gpt-oss-120b (low), Terminus-2OpenAI29
gpt-oss-120b (high), CodexOpenAI25
Gemini 3.1 Flash-Lite (minimal), Terminus-2Google18
gpt-oss-20b (high), CodexOpenAI12
Llama 3.3 70B (Non-reasoning), Terminus-2Meta10
Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2NVIDIA9
Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2NVIDIA4

Open weights

GS-QA2 score

Share of tasks passed, 0 to 100 · Higher is better

GS-QA2 scoreScores 0 to 100: DeepSeek V4.1 Flash (max), Codex: 89; GLM-5.2 (max), Claude Code: 83; Kimi K2.7 Code (Reasoning), Terminus-2: 82; Kimi K3 (Reasoning), Terminus-2: 80; DeepSeek V4 Pro (max), Terminus-2: 80; GLM-5.3-Flash (max), Terminus-2: 80; Qwen 3.8 27B (xhigh), Qwen Code: 75; MiniMax M3.1 Flash (max), Terminus-2: 71; Nemotron 3 Ultra (high), Terminus-2: 70; Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2: 59; Gemma 4 26B A4B (Reasoning), Terminus-2: 58; Step 5 Preview (Reasoning), Terminus-2: 52; gpt-oss-120b (high), Terminus-2: 42; Mistral Large 3 (Non-reasoning), Terminus-2: 39; gpt-oss-20b (high), Terminus-2: 30; Llama 3.3 70B (Non-reasoning), Terminus-2: 10; Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2: 9; Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2: 40255075100DeepSeek V4.1 Flash (max)Codex89GLM-5.2 (max)Claude Code83Kimi K2.7 Code (Reasoning)Terminus-282Kimi K3 (Reasoning)Terminus-280DeepSeek V4 Pro (max)Terminus-280GLM-5.3-Flash (max)Terminus-280Qwen 3.8 27B (xhigh)Qwen Code75MiniMax M3.1 Flash (max)Terminus-271Nemotron 3 Ultra (high)Terminus-270Nemotron 3.5 Super VL 120B (Reasoning)Terminus-259Gemma 4 26B A4B (Reasoning)Terminus-258Step 5 Preview (Reasoning)Terminus-252gpt-oss-120b (high)Terminus-242Mistral Large 3 (Non-reasoning)Terminus-239gpt-oss-20b (high)Terminus-230Llama 3.3 70B (Non-reasoning)Terminus-210Nemotron 3 Nano Omni 30B (Reasoning)Terminus-29Nemotron 3.5 Lightning 30B (Reasoning)Terminus-24
How to read this chart

About this evaluation. Spatial data reasoning over map and elevation data. GS-QA2 results and background.

Data table: GS-QA2 score
GS-QA2 score
ModelDeveloperGS-QA2 score
DeepSeek V4.1 Flash (max), CodexDeepSeek89
GLM-5.2 (max), Claude CodeZ.ai83
GLM-5.3 (max), Terminus-2Z.ai83
Kimi K2.7 Code (Reasoning), Terminus-2Moonshot AI82
GLM-5.3 (max), Claude CodeZ.ai81
GLM-5.2 (max), Terminus-2Z.ai80
Kimi K2.7 Code (Reasoning), Kimi CodeMoonshot AI80
Kimi K3 (Reasoning), Terminus-2Moonshot AI80
Kimi K2.6 (Reasoning), Kimi CodeMoonshot AI80
GLM-5.3 (low), Terminus-2Z.ai80
DeepSeek V4 Pro (max), Terminus-2DeepSeek80
GLM-5.3-Flash (max), Terminus-2Z.ai80
DeepSeek V4 Flash (max), Terminus-2DeepSeek80
DeepSeek V4 Flash (high), Terminus-2DeepSeek79
GLM-5.2 (high), Terminus-2Z.ai78
DeepSeek V4 Pro (high), Terminus-2DeepSeek77
Kimi K2.6 (Reasoning), Terminus-2Moonshot AI77
GLM-5.3-Flash (max), Claude CodeZ.ai76
GLM-5.3-Flash (low), Terminus-2Z.ai76
Qwen 3.8 27B (xhigh), Qwen CodeAlibaba (Qwen)75
DeepSeek V4 Flash (high), CodexDeepSeek74
Qwen 3.8 27B (xhigh), Terminus-2Alibaba (Qwen)74
GLM-5.2 (Non-reasoning), Terminus-2Z.ai72
MiniMax M3.1 Flash (max), Terminus-2MiniMax71
Nemotron 3 Ultra (high), Terminus-2NVIDIA70
Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2NVIDIA59
Gemma 4 26B A4B (Reasoning), Terminus-2Google58
Step 5 Preview (Reasoning), Terminus-2StepFun52
GLM-4.7-Flash (Reasoning), Claude CodeZ.ai48
GLM-4.7-Flash (Reasoning), Terminus-2Z.ai43
gpt-oss-120b (high), Terminus-2OpenAI42
Mistral Large 3 (Non-reasoning), Terminus-2Mistral AI39
gpt-oss-20b (high), Terminus-2OpenAI30
gpt-oss-120b (low), Terminus-2OpenAI29
gpt-oss-120b (high), CodexOpenAI25
gpt-oss-20b (high), CodexOpenAI12
Llama 3.3 70B (Non-reasoning), Terminus-2Meta10
Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2NVIDIA9
Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2NVIDIA4

All

GeoAgentBench score

Share of tasks passed, 0 to 100 · Higher is better

GeoAgentBench scoreScores 0 to 100: GPT-6.1 Sol (xhigh), Codex: 100; Claude Haiku 5.5 (xhigh), Claude Code: 100; Claude Opus 5 (high), Claude Code: 100; GLM-5.3-Flash (max), Claude Code: 98; Gemini 3.8 Flash (low), Terminus-2: 98; GPT-5.6 Luna (xhigh), Codex: 98; Claude Sonnet 5.5 (xhigh), Claude Code: 98; GLM-5.3 (max), Claude Code: 98; DeepSeek V4 Flash (max), Terminus-2: 96; Nemotron 3 Ultra (high), Terminus-2: 96; GPT-5.6 Terra (high), Codex: 96; DeepSeek V4 Pro (max), Terminus-2: 96; Qwen 3.8 27B (xhigh), Qwen Code: 94; Kimi K3 (Reasoning), Terminus-2: 94; Kimi K2.7 Code (Reasoning), Terminus-2: 92; MiniMax M3.1 Flash (max), Terminus-2: 88; Gemma 4 26B A4B (Reasoning), Terminus-2: 86; Gemini 3.1 Pro (preview) (high), Terminus-2: 86; gpt-oss-120b (high), Terminus-2: 70; Gemini 3.1 Flash-Lite (high), Terminus-2: 70; Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2: 68; gpt-oss-20b (high), Terminus-2: 53; Step 5 Preview (Reasoning), Terminus-2: 50; Mistral Large 3 (Non-reasoning), Terminus-2: 46; Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2: 26; Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2: 10; Llama 3.3 70B (Non-reasoning), Terminus-2: 80255075100GPT-6.1 Sol (xhigh)Codex100Claude Haiku 5.5 (xhigh)Claude Code100Claude Opus 5 (high)Claude Code100GLM-5.3-Flash (max)Claude Code98Gemini 3.8 Flash (low)Terminus-298GPT-5.6 Luna (xhigh)Codex98Claude Sonnet 5.5 (xhigh)Claude Code98GLM-5.3 (max)Claude Code98DeepSeek V4 Flash (max)Terminus-296Nemotron 3 Ultra (high)Terminus-296GPT-5.6 Terra (high)Codex96DeepSeek V4 Pro (max)Terminus-296Qwen 3.8 27B (xhigh)Qwen Code94Kimi K3 (Reasoning)Terminus-294Kimi K2.7 Code (Reasoning)Terminus-292MiniMax M3.1 Flash (max)Terminus-288Gemma 4 26B A4B (Reasoning)Terminus-286Gemini 3.1 Pro (preview) (high)Terminus-286gpt-oss-120b (high)Terminus-270Gemini 3.1 Flash-Lite (high)Terminus-270Nemotron 3.5 Super VL 120B (Reasoning)Terminus-268gpt-oss-20b (high)Terminus-253Step 5 Preview (Reasoning)Terminus-250Mistral Large 3 (Non-reasoning)Terminus-246Nemotron 3 Nano Omni 30B (Reasoning)Terminus-226Nemotron 3.5 Lightning 30B (Reasoning)Terminus-210Llama 3.3 70B (Non-reasoning)Terminus-28
How to read this chart

About this evaluation. Multi-step spatial execution. GeoAgentBench results and background.

Data table: GeoAgentBench score
GeoAgentBench score
ModelDeveloperGeoAgentBench score
Claude Opus 5.5 (high), Claude CodeAnthropic100
Claude Haiku 5.5 (xhigh), Claude CodeAnthropic100
Claude Opus 5 (high), Claude CodeAnthropic100
GPT-6.1 Sol (medium), CodexOpenAI100
GPT-6.1 Sol (high), CodexOpenAI100
GPT-6.1 Sol (xhigh), CodexOpenAI100
GPT-6 Sol (medium), CodexOpenAI100
GPT-6 Sol (high), CodexOpenAI100
GPT-5.6 Sol (high), CodexOpenAI100
Gemini 3.8 Flash (low), Terminus-2Google98
GLM-5.3-Flash (max), Claude CodeZ.ai98
GLM-5.3 (max), Claude CodeZ.ai98
Claude Opus 5.5 (medium), Claude CodeAnthropic98
Claude Sonnet 5.5 (medium), Claude CodeAnthropic98
Claude Sonnet 5.5 (high), Claude CodeAnthropic98
Claude Haiku 5.5 (high), Claude CodeAnthropic98
Claude Opus 5.5 (xhigh), Claude CodeAnthropic98
Claude Sonnet 5.5 (xhigh), Claude CodeAnthropic98
Claude Sonnet 5 (high), Claude CodeAnthropic98
GPT-5.6 Luna (medium), CodexOpenAI98
GPT-5.6 Luna (high), CodexOpenAI98
GPT-5.6 Luna (xhigh), CodexOpenAI98
Claude Sonnet 4.6 (high), Terminus-2Anthropic96
DeepSeek V4 Flash (max), Terminus-2DeepSeek96
DeepSeek V4 Pro (max), Terminus-2DeepSeek96
DeepSeek V4 Pro (high), Terminus-2DeepSeek96
Nemotron 3 Ultra (high), Terminus-2NVIDIA96
Claude Opus 5.5 (low), Claude CodeAnthropic96
Claude Opus 4.8 (high), Claude CodeAnthropic96
Claude Opus 4.7 (high), Claude CodeAnthropic96
GPT-6 Luna (xhigh), CodexOpenAI96
GPT-6 Luna (high), CodexOpenAI96
GPT-5.6 Terra (high), CodexOpenAI96
DeepSeek V4 Flash (high), Terminus-2DeepSeek94
GLM-5.2 (high), Terminus-2Z.ai94
GLM-5.2 (max), Terminus-2Z.ai94
GLM-5.3-Flash (low), Terminus-2Z.ai94
GLM-5.3 (max), Terminus-2Z.ai94
Kimi K3 (Reasoning), Terminus-2Moonshot AI94
Qwen 3.8 27B (xhigh), Qwen CodeAlibaba (Qwen)94
Claude Haiku 5.5 (medium), Claude CodeAnthropic94
Claude Sonnet 5.5 (low), Claude CodeAnthropic94
GPT-6 Luna (medium), CodexOpenAI94
GLM-5.2 (Non-reasoning), Terminus-2Z.ai92
GLM-5.3 (low), Terminus-2Z.ai92
Kimi K2.7 Code (Reasoning), Terminus-2Moonshot AI92
Claude Haiku 5.5 (low), Claude CodeAnthropic92
GPT-6 Luna (low), CodexOpenAI92
Kimi K2.6 (Reasoning), Terminus-2Moonshot AI90
DeepSeek V4.1 Flash (max), CodexDeepSeek90
MiniMax M3.1 Flash (max), Terminus-2MiniMax88
DeepSeek V4 Flash (high), CodexDeepSeek88
Gemini 3.1 Pro (preview) (high), Terminus-2Google86
Gemma 4 26B A4B (Reasoning), Terminus-2Google86
GPT-5.6 Luna (low), CodexOpenAI86
Gemini 3.1 Pro (preview) (low), Terminus-2Google84
GLM-5.3-Flash (max), Terminus-2Z.ai84
Claude Haiku 4.5 (Reasoning), Claude CodeAnthropic78
Gemini 3.8 Flash (high), Terminus-2Google74
Gemini 3.1 Flash-Lite (high), Terminus-2Google70
gpt-oss-120b (high), Terminus-2OpenAI70
Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2NVIDIA68
gpt-oss-120b (low), Terminus-2OpenAI60
Qwen 3.8 27B (xhigh), Terminus-2Alibaba (Qwen)60
gpt-oss-120b (high), CodexOpenAI58
gpt-oss-20b (high), Terminus-2OpenAI53
Gemini 3.1 Flash-Lite (low), Terminus-2Google52
Step 5 Preview (Reasoning), Terminus-2StepFun50
Mistral Large 3 (Non-reasoning), Terminus-2Mistral AI46
Gemini 3.1 Flash-Lite (minimal), Terminus-2Google42
GLM-4.7-Flash (Reasoning), Terminus-2Z.ai42
GLM-4.7-Flash (Reasoning), Claude CodeZ.ai30
Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2NVIDIA26
Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2NVIDIA10
gpt-oss-20b (high), CodexOpenAI10
Llama 3.3 70B (Non-reasoning), Terminus-2Meta8

Open weights

GeoAgentBench score

Share of tasks passed, 0 to 100 · Higher is better

GeoAgentBench scoreScores 0 to 100: GLM-5.3-Flash (max), Claude Code: 98; GLM-5.3 (max), Claude Code: 98; DeepSeek V4 Flash (max), Terminus-2: 96; Nemotron 3 Ultra (high), Terminus-2: 96; DeepSeek V4 Pro (max), Terminus-2: 96; Qwen 3.8 27B (xhigh), Qwen Code: 94; Kimi K3 (Reasoning), Terminus-2: 94; Kimi K2.7 Code (Reasoning), Terminus-2: 92; MiniMax M3.1 Flash (max), Terminus-2: 88; Gemma 4 26B A4B (Reasoning), Terminus-2: 86; gpt-oss-120b (high), Terminus-2: 70; Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2: 68; gpt-oss-20b (high), Terminus-2: 53; Step 5 Preview (Reasoning), Terminus-2: 50; Mistral Large 3 (Non-reasoning), Terminus-2: 46; Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2: 26; Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2: 10; Llama 3.3 70B (Non-reasoning), Terminus-2: 80255075100GLM-5.3-Flash (max)Claude Code98GLM-5.3 (max)Claude Code98DeepSeek V4 Flash (max)Terminus-296Nemotron 3 Ultra (high)Terminus-296DeepSeek V4 Pro (max)Terminus-296Qwen 3.8 27B (xhigh)Qwen Code94Kimi K3 (Reasoning)Terminus-294Kimi K2.7 Code (Reasoning)Terminus-292MiniMax M3.1 Flash (max)Terminus-288Gemma 4 26B A4B (Reasoning)Terminus-286gpt-oss-120b (high)Terminus-270Nemotron 3.5 Super VL 120B (Reasoning)Terminus-268gpt-oss-20b (high)Terminus-253Step 5 Preview (Reasoning)Terminus-250Mistral Large 3 (Non-reasoning)Terminus-246Nemotron 3 Nano Omni 30B (Reasoning)Terminus-226Nemotron 3.5 Lightning 30B (Reasoning)Terminus-210Llama 3.3 70B (Non-reasoning)Terminus-28
How to read this chart

About this evaluation. Multi-step spatial execution. GeoAgentBench results and background.

Data table: GeoAgentBench score
GeoAgentBench score
ModelDeveloperGeoAgentBench score
GLM-5.3-Flash (max), Claude CodeZ.ai98
GLM-5.3 (max), Claude CodeZ.ai98
DeepSeek V4 Flash (max), Terminus-2DeepSeek96
DeepSeek V4 Pro (max), Terminus-2DeepSeek96
DeepSeek V4 Pro (high), Terminus-2DeepSeek96
Nemotron 3 Ultra (high), Terminus-2NVIDIA96
DeepSeek V4 Flash (high), Terminus-2DeepSeek94
GLM-5.2 (high), Terminus-2Z.ai94
GLM-5.2 (max), Terminus-2Z.ai94
GLM-5.3-Flash (low), Terminus-2Z.ai94
GLM-5.3 (max), Terminus-2Z.ai94
Kimi K3 (Reasoning), Terminus-2Moonshot AI94
Qwen 3.8 27B (xhigh), Qwen CodeAlibaba (Qwen)94
GLM-5.2 (Non-reasoning), Terminus-2Z.ai92
GLM-5.3 (low), Terminus-2Z.ai92
Kimi K2.7 Code (Reasoning), Terminus-2Moonshot AI92
Kimi K2.6 (Reasoning), Terminus-2Moonshot AI90
DeepSeek V4.1 Flash (max), CodexDeepSeek90
MiniMax M3.1 Flash (max), Terminus-2MiniMax88
DeepSeek V4 Flash (high), CodexDeepSeek88
Gemma 4 26B A4B (Reasoning), Terminus-2Google86
GLM-5.3-Flash (max), Terminus-2Z.ai84
gpt-oss-120b (high), Terminus-2OpenAI70
Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2NVIDIA68
gpt-oss-120b (low), Terminus-2OpenAI60
Qwen 3.8 27B (xhigh), Terminus-2Alibaba (Qwen)60
gpt-oss-120b (high), CodexOpenAI58
gpt-oss-20b (high), Terminus-2OpenAI53
Step 5 Preview (Reasoning), Terminus-2StepFun50
Mistral Large 3 (Non-reasoning), Terminus-2Mistral AI46
GLM-4.7-Flash (Reasoning), Terminus-2Z.ai42
GLM-4.7-Flash (Reasoning), Claude CodeZ.ai30
Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2NVIDIA26
Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2NVIDIA10
gpt-oss-20b (high), CodexOpenAI10
Llama 3.3 70B (Non-reasoning), Terminus-2Meta8

All

GeoAnalystBench score

Share of tasks passed, 0 to 100 · Higher is better

GeoAnalystBench scoreScores 0 to 100: GPT-6 Luna (xhigh), Codex: 100; Claude Opus 5.5 (xhigh), Claude Code: 100; GLM-5.3-Flash (max), Claude Code: 100; DeepSeek V4 Pro (max), Terminus-2: 100; GPT-6 Sol (high), Codex: 100; Claude Sonnet 4.6 (high), Terminus-2: 100; Gemini 3.1 Pro (preview) (high), Terminus-2: 95; GPT-5.6 Terra (high), Codex: 95; Claude Haiku 5.5 (xhigh), Claude Code: 95; GLM-5.3 (max), Claude Code: 95; DeepSeek V4 Flash (max), Terminus-2: 95; Qwen 3.8 27B (xhigh), Terminus-2: 89; Kimi K3 (Reasoning), Terminus-2: 89; Gemini 3.8 Flash (low), Terminus-2: 89; Kimi K2.7 Code (Reasoning), Terminus-2: 89; Nemotron 3 Ultra (high), Terminus-2: 63; Gemma 4 26B A4B (Reasoning), Terminus-2: 63; Gemini 3.1 Flash-Lite (high), Terminus-2: 58; Step 5 Preview (Reasoning), Terminus-2: 53; gpt-oss-120b (high), Terminus-2: 53; MiniMax M3.1 Flash (max), Terminus-2: 47; Mistral Large 3 (Non-reasoning), Terminus-2: 47; gpt-oss-20b (high), Terminus-2: 37; Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2: 37; Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2: 32; Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2: 16; Llama 3.3 70B (Non-reasoning), Terminus-2: 00255075100GPT-6 Luna (xhigh)Codex100Claude Opus 5.5 (xhigh)Claude Code100GLM-5.3-Flash (max)Claude Code100DeepSeek V4 Pro (max)Terminus-2100GPT-6 Sol (high)Codex100Claude Sonnet 4.6 (high)Terminus-2100Gemini 3.1 Pro (preview) (high)Terminus-295GPT-5.6 Terra (high)Codex95Claude Haiku 5.5 (xhigh)Claude Code95GLM-5.3 (max)Claude Code95DeepSeek V4 Flash (max)Terminus-295Qwen 3.8 27B (xhigh)Terminus-289Kimi K3 (Reasoning)Terminus-289Gemini 3.8 Flash (low)Terminus-289Kimi K2.7 Code (Reasoning)Terminus-289Nemotron 3 Ultra (high)Terminus-263Gemma 4 26B A4B (Reasoning)Terminus-263Gemini 3.1 Flash-Lite (high)Terminus-258Step 5 Preview (Reasoning)Terminus-253gpt-oss-120b (high)Terminus-253MiniMax M3.1 Flash (max)Terminus-247Mistral Large 3 (Non-reasoning)Terminus-247gpt-oss-20b (high)Terminus-237Nemotron 3.5 Super VL 120B (Reasoning)Terminus-237Nemotron 3.5 Lightning 30B (Reasoning)Terminus-232Nemotron 3 Nano Omni 30B (Reasoning)Terminus-216Llama 3.3 70B (Non-reasoning)Terminus-20
How to read this chart

About this evaluation. Spatial workflow and code generation. GeoAnalystBench results and background.

Data table: GeoAnalystBench score
GeoAnalystBench score
ModelDeveloperGeoAnalystBench score
Claude Sonnet 4.6 (high), Terminus-2Anthropic100
DeepSeek V4 Pro (max), Terminus-2DeepSeek100
DeepSeek V4 Pro (high), Terminus-2DeepSeek100
GLM-5.2 (high), Terminus-2Z.ai100
GLM-5.3-Flash (max), Claude CodeZ.ai100
Claude Opus 5.5 (high), Claude CodeAnthropic100
Claude Sonnet 5.5 (high), Claude CodeAnthropic100
Claude Opus 5.5 (xhigh), Claude CodeAnthropic100
Claude Opus 5.5 (low), Claude CodeAnthropic100
Claude Haiku 5.5 (low), Claude CodeAnthropic100
Claude Opus 4.8 (high), Claude CodeAnthropic100
Claude Opus 4.7 (high), Claude CodeAnthropic100
GPT-6.1 Sol (medium), CodexOpenAI100
GPT-6.1 Sol (high), CodexOpenAI100
GPT-6 Luna (xhigh), CodexOpenAI100
GPT-6 Sol (high), CodexOpenAI100
GPT-6 Luna (high), CodexOpenAI100
GPT-5.6 Luna (medium), CodexOpenAI100
GPT-5.6 Luna (high), CodexOpenAI100
GPT-5.6 Luna (xhigh), CodexOpenAI100
DeepSeek V4 Flash (max), Terminus-2DeepSeek95
Gemini 3.1 Pro (preview) (high), Terminus-2Google95
GLM-5.2 (max), Terminus-2Z.ai95
GLM-5.3-Flash (low), Terminus-2Z.ai95
GLM-5.3 (low), Terminus-2Z.ai95
GLM-5.3 (max), Claude CodeZ.ai95
Claude Opus 5.5 (medium), Claude CodeAnthropic95
Claude Sonnet 5.5 (medium), Claude CodeAnthropic95
Claude Haiku 5.5 (medium), Claude CodeAnthropic95
Claude Sonnet 5.5 (xhigh), Claude CodeAnthropic95
Claude Haiku 5.5 (xhigh), Claude CodeAnthropic95
Claude Sonnet 5.5 (low), Claude CodeAnthropic95
Claude Sonnet 5 (high), Claude CodeAnthropic95
GPT-6.1 Sol (xhigh), CodexOpenAI95
GPT-5.6 Terra (high), CodexOpenAI95
GPT-5.6 Luna (low), CodexOpenAI95
DeepSeek V4 Flash (high), Terminus-2DeepSeek89
Gemini 3.8 Flash (low), Terminus-2Google89
Kimi K2.7 Code (Reasoning), Terminus-2Moonshot AI89
Kimi K3 (Reasoning), Terminus-2Moonshot AI89
Qwen 3.8 27B (xhigh), Terminus-2Alibaba (Qwen)89
DeepSeek V4 Flash (high), CodexDeepSeek89
Claude Opus 5 (high), Claude CodeAnthropic89
GPT-6 Luna (medium), CodexOpenAI89
GPT-5.6 Sol (high), CodexOpenAI89
DeepSeek V4.1 Flash (max), CodexDeepSeek88
GLM-5.3-Flash (max), Terminus-2Z.ai84
GLM-5.3 (max), Terminus-2Z.ai84
Claude Haiku 5.5 (high), Claude CodeAnthropic84
Gemini 3.1 Pro (preview) (low), Terminus-2Google79
Kimi K2.6 (Reasoning), Terminus-2Moonshot AI79
Qwen 3.8 27B (xhigh), Qwen CodeAlibaba (Qwen)79
GPT-6 Luna (low), CodexOpenAI79
GLM-5.2 (Non-reasoning), Terminus-2Z.ai74
Claude Haiku 4.5 (Reasoning), Claude CodeAnthropic74
Gemini 3.1 Flash-Lite (low), Terminus-2Google63
Gemma 4 26B A4B (Reasoning), Terminus-2Google63
Nemotron 3 Ultra (high), Terminus-2NVIDIA63
Gemini 3.1 Flash-Lite (high), Terminus-2Google58
gpt-oss-120b (high), Terminus-2OpenAI53
Step 5 Preview (Reasoning), Terminus-2StepFun53
gpt-oss-120b (low), Terminus-2OpenAI47
MiniMax M3.1 Flash (max), Terminus-2MiniMax47
Mistral Large 3 (Non-reasoning), Terminus-2Mistral AI47
Gemini 3.1 Flash-Lite (minimal), Terminus-2Google42
gpt-oss-120b (high), CodexOpenAI42
GLM-4.7-Flash (Reasoning), Terminus-2Z.ai37
gpt-oss-20b (high), Terminus-2OpenAI37
Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2NVIDIA37
Gemini 3.8 Flash (high), Terminus-2Google32
Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2NVIDIA32
GLM-4.7-Flash (Reasoning), Claude CodeZ.ai26
Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2NVIDIA16
gpt-oss-20b (high), CodexOpenAI11
Llama 3.3 70B (Non-reasoning), Terminus-2Meta0

Open weights

GeoAnalystBench score

Share of tasks passed, 0 to 100 · Higher is better

GeoAnalystBench scoreScores 0 to 100: GLM-5.3-Flash (max), Claude Code: 100; DeepSeek V4 Pro (max), Terminus-2: 100; GLM-5.3 (max), Claude Code: 95; DeepSeek V4 Flash (max), Terminus-2: 95; Qwen 3.8 27B (xhigh), Terminus-2: 89; Kimi K3 (Reasoning), Terminus-2: 89; Kimi K2.7 Code (Reasoning), Terminus-2: 89; Gemma 4 26B A4B (Reasoning), Terminus-2: 63; Nemotron 3 Ultra (high), Terminus-2: 63; gpt-oss-120b (high), Terminus-2: 53; Step 5 Preview (Reasoning), Terminus-2: 53; MiniMax M3.1 Flash (max), Terminus-2: 47; Mistral Large 3 (Non-reasoning), Terminus-2: 47; gpt-oss-20b (high), Terminus-2: 37; Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2: 37; Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2: 32; Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2: 16; Llama 3.3 70B (Non-reasoning), Terminus-2: 00255075100GLM-5.3-Flash (max)Claude Code100DeepSeek V4 Pro (max)Terminus-2100GLM-5.3 (max)Claude Code95DeepSeek V4 Flash (max)Terminus-295Qwen 3.8 27B (xhigh)Terminus-289Kimi K3 (Reasoning)Terminus-289Kimi K2.7 Code (Reasoning)Terminus-289Gemma 4 26B A4B (Reasoning)Terminus-263Nemotron 3 Ultra (high)Terminus-263gpt-oss-120b (high)Terminus-253Step 5 Preview (Reasoning)Terminus-253MiniMax M3.1 Flash (max)Terminus-247Mistral Large 3 (Non-reasoning)Terminus-247gpt-oss-20b (high)Terminus-237Nemotron 3.5 Super VL 120B (Reasoning)Terminus-237Nemotron 3.5 Lightning 30B (Reasoning)Terminus-232Nemotron 3 Nano Omni 30B (Reasoning)Terminus-216Llama 3.3 70B (Non-reasoning)Terminus-20
How to read this chart

About this evaluation. Spatial workflow and code generation. GeoAnalystBench results and background.

Data table: GeoAnalystBench score
GeoAnalystBench score
ModelDeveloperGeoAnalystBench score
DeepSeek V4 Pro (max), Terminus-2DeepSeek100
DeepSeek V4 Pro (high), Terminus-2DeepSeek100
GLM-5.2 (high), Terminus-2Z.ai100
GLM-5.3-Flash (max), Claude CodeZ.ai100
DeepSeek V4 Flash (max), Terminus-2DeepSeek95
GLM-5.2 (max), Terminus-2Z.ai95
GLM-5.3-Flash (low), Terminus-2Z.ai95
GLM-5.3 (low), Terminus-2Z.ai95
GLM-5.3 (max), Claude CodeZ.ai95
DeepSeek V4 Flash (high), Terminus-2DeepSeek89
Kimi K2.7 Code (Reasoning), Terminus-2Moonshot AI89
Kimi K3 (Reasoning), Terminus-2Moonshot AI89
Qwen 3.8 27B (xhigh), Terminus-2Alibaba (Qwen)89
DeepSeek V4 Flash (high), CodexDeepSeek89
DeepSeek V4.1 Flash (max), CodexDeepSeek88
GLM-5.3-Flash (max), Terminus-2Z.ai84
GLM-5.3 (max), Terminus-2Z.ai84
Kimi K2.6 (Reasoning), Terminus-2Moonshot AI79
Qwen 3.8 27B (xhigh), Qwen CodeAlibaba (Qwen)79
GLM-5.2 (Non-reasoning), Terminus-2Z.ai74
Gemma 4 26B A4B (Reasoning), Terminus-2Google63
Nemotron 3 Ultra (high), Terminus-2NVIDIA63
gpt-oss-120b (high), Terminus-2OpenAI53
Step 5 Preview (Reasoning), Terminus-2StepFun53
gpt-oss-120b (low), Terminus-2OpenAI47
MiniMax M3.1 Flash (max), Terminus-2MiniMax47
Mistral Large 3 (Non-reasoning), Terminus-2Mistral AI47
gpt-oss-120b (high), CodexOpenAI42
GLM-4.7-Flash (Reasoning), Terminus-2Z.ai37
gpt-oss-20b (high), Terminus-2OpenAI37
Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2NVIDIA37
Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2NVIDIA32
GLM-4.7-Flash (Reasoning), Claude CodeZ.ai26
Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2NVIDIA16
gpt-oss-20b (high), CodexOpenAI11
Llama 3.3 70B (Non-reasoning), Terminus-2Meta0

Cost

All

Cost per task

Average cost per agent task (USD) · Lower is better

Cost per taskCost per task in US dollars: Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2: $0.0096; Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2: $0.012; Claude Haiku 5.5 (xhigh), Claude Code: $0.017; gpt-oss-20b (high), Terminus-2: $0.017; MiniMax M3.1 Flash (max), Terminus-2: $0.017; GPT-5.6 Luna (xhigh), Codex: $0.021; Gemma 4 26B A4B (Reasoning), Terminus-2: $0.021; Llama 3.3 70B (Non-reasoning), Terminus-2: $0.023; Mistral Large 3 (Non-reasoning), Terminus-2: $0.026; gpt-oss-120b (high), Terminus-2: $0.026; Gemini 3.1 Flash-Lite (high), Terminus-2: $0.031; DeepSeek V4.1 Flash (max), Codex: $0.067; Nemotron 3 Ultra (high), Terminus-2: $0.069; Step 5 Preview (Reasoning), Terminus-2: $0.071; GPT-6.1 Sol (xhigh), Codex: $0.085; GLM-5.3-Flash (max), Claude Code: $0.093; GPT-5.6 Terra (high), Codex: $0.10; Claude Sonnet 5.5 (xhigh), Claude Code: $0.11; Gemini 3.8 Flash (low), Terminus-2: $0.11; Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2: $0.13; Kimi K2.7 Code (Reasoning), Kimi Code: $0.18; Qwen 3.8 27B (xhigh), Qwen Code: $0.22; Kimi K3 (Reasoning), Terminus-2: $0.23; Claude Opus 5.5 (xhigh), Claude Code: $0.25; DeepSeek V4 Pro (max), Terminus-2: $0.35; GLM-5.3 (max), Claude Code: $0.48$0$0.15$0.30$0.45$0.60Nemotron 3.5 Super VL 120B (Reasoning)Terminus-2$0.0096Nemotron 3.5 Lightning 30B (Reasoning)Terminus-2$0.012Claude Haiku 5.5 (xhigh)Claude Code$0.017gpt-oss-20b (high)Terminus-2$0.017MiniMax M3.1 Flash (max)Terminus-2$0.017GPT-5.6 Luna (xhigh)Codex$0.021Gemma 4 26B A4B (Reasoning)Terminus-2$0.021Llama 3.3 70B (Non-reasoning)Terminus-2$0.023Mistral Large 3 (Non-reasoning)Terminus-2$0.026gpt-oss-120b (high)Terminus-2$0.026Gemini 3.1 Flash-Lite (high)Terminus-2$0.031DeepSeek V4.1 Flash (max)Codex$0.067Nemotron 3 Ultra (high)Terminus-2$0.069Step 5 Preview (Reasoning)Terminus-2$0.071GPT-6.1 Sol (xhigh)Codex$0.085GLM-5.3-Flash (max)Claude Code$0.093GPT-5.6 Terra (high)Codex$0.10Claude Sonnet 5.5 (xhigh)Claude Code$0.11Gemini 3.8 Flash (low)Terminus-2$0.11Nemotron 3 Nano Omni 30B (Reasoning)Terminus-2$0.13Kimi K2.7 Code (Reasoning)Kimi Code$0.18Qwen 3.8 27B (xhigh)Qwen Code$0.22Kimi K3 (Reasoning)Terminus-2$0.23Claude Opus 5.5 (xhigh)Claude Code$0.25DeepSeek V4 Pro (max)Terminus-2$0.35GLM-5.3 (max)Claude Code$0.48
How to read this chart

What cost is measuring. What one attempt at a task would cost if paid token by token at the provider's published API prices, averaged over attempts: ordinary input tokens, input tokens served from the provider's cache at the lower cached price, tokens written to the cache where the provider charges for that, and output tokens (thinking included). Cost assumes each harness uses the model's pay-per-token API, priced at public list rates; sandboxes and our own engineering time are not included. Failed attempts count too.

How to read this chart. Lower is better. Costs are pay-per-token list prices, not any discount or credit a customer might have.

Data table: Cost per task
Cost per task
ModelDeveloperCost per task
GPT-6 Luna (medium), CodexOpenAI$0.0026
GPT-6 Luna (low), CodexOpenAI$0.0032
GPT-6 Luna (high), CodexOpenAI$0.0040
gpt-oss-120b (low), Terminus-2OpenAI$0.0046
Claude Haiku 5.5 (low), Claude CodeAnthropic$0.0053
GPT-5.6 Luna (low), CodexOpenAI$0.0058
Claude Haiku 5.5 (medium), Claude CodeAnthropic$0.0063
Gemini 3.1 Flash-Lite (minimal), Terminus-2Google$0.0066
GPT-6 Luna (xhigh), CodexOpenAI$0.0070
Claude Haiku 5.5 (high), Claude CodeAnthropic$0.0085
GPT-5.6 Luna (medium), CodexOpenAI$0.0094
Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2NVIDIA$0.0096
Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2NVIDIA$0.012
GPT-5.6 Luna (high), CodexOpenAI$0.016
Claude Haiku 5.5 (xhigh), Claude CodeAnthropic$0.017
gpt-oss-20b (high), Terminus-2OpenAI$0.017
MiniMax M3.1 Flash (max), Terminus-2MiniMax$0.017
Gemini 3.1 Flash-Lite (low), Terminus-2Google$0.018
GPT-5.6 Luna (xhigh), CodexOpenAI$0.021
Gemma 4 26B A4B (Reasoning), Terminus-2Google$0.021
Llama 3.3 70B (Non-reasoning), Terminus-2Meta$0.023
Mistral Large 3 (Non-reasoning), Terminus-2Mistral AI$0.026
gpt-oss-120b (high), Terminus-2OpenAI$0.026
Gemini 3.1 Flash-Lite (high), Terminus-2Google$0.031
GLM-4.7-Flash (Reasoning), Terminus-2Z.ai$0.037
Claude Sonnet 5.5 (low), Claude CodeAnthropic$0.043
GPT-6.1 Sol (medium), CodexOpenAI$0.046
Claude Sonnet 5.5 (medium), Claude CodeAnthropic$0.046
GLM-5.3-Flash (low), Terminus-2Z.ai$0.048
Claude Sonnet 5.5 (high), Claude CodeAnthropic$0.055
GPT-6.1 Sol (high), CodexOpenAI$0.059
DeepSeek V4 Flash (max), Terminus-2DeepSeek$0.062
DeepSeek V4 Flash (high), Terminus-2DeepSeek$0.065
DeepSeek V4.1 Flash (max), CodexDeepSeek$0.067
Nemotron 3 Ultra (high), Terminus-2NVIDIA$0.069
Step 5 Preview (Reasoning), Terminus-2StepFun$0.071
Claude Opus 5.5 (low), Claude CodeAnthropic$0.081
GPT-6 Sol (high), CodexOpenAI$0.082
GPT-6.1 Sol (xhigh), CodexOpenAI$0.085
DeepSeek V4 Flash (high), CodexDeepSeek$0.085
Kimi K2.6 (Reasoning), Terminus-2Moonshot AI$0.089
Claude Haiku 4.5 (Reasoning), Claude CodeAnthropic$0.092
GLM-5.3-Flash (max), Claude CodeZ.ai$0.093
gpt-oss-20b (high), CodexOpenAI$0.094
GLM-5.3-Flash (max), Terminus-2Z.ai$0.094
GLM-5.2 (Non-reasoning), Terminus-2Z.ai$0.099
GPT-5.6 Terra (high), CodexOpenAI$0.10
Qwen 3.8 27B (xhigh), Terminus-2Alibaba (Qwen)$0.10
Claude Sonnet 5.5 (xhigh), Claude CodeAnthropic$0.11
Claude Opus 5.5 (medium), Claude CodeAnthropic$0.11
Kimi K2.7 Code (Reasoning), Terminus-2Moonshot AI$0.11
Gemini 3.8 Flash (low), Terminus-2Google$0.11
Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2NVIDIA$0.13
Claude Opus 5.5 (high), Claude CodeAnthropic$0.13
Kimi K2.7 Code (Reasoning), Kimi CodeMoonshot AI$0.18
Claude Sonnet 5 (high), Claude CodeAnthropic$0.20
GPT-5.6 Sol (high), CodexOpenAI$0.21
GLM-5.2 (high), Terminus-2Z.ai$0.22
Qwen 3.8 27B (xhigh), Qwen CodeAlibaba (Qwen)$0.22
Kimi K3 (Reasoning), Terminus-2Moonshot AI$0.23
Claude Opus 5.5 (xhigh), Claude CodeAnthropic$0.25
gpt-oss-120b (high), CodexOpenAI$0.26
Claude Opus 4.8 (high), Claude CodeAnthropic$0.26
Kimi K2.6 (Reasoning), Kimi CodeMoonshot AI$0.27
GLM-4.7-Flash (Reasoning), Claude CodeZ.ai$0.27
GLM-5.3 (low), Terminus-2Z.ai$0.27
DeepSeek V4 Pro (high), Terminus-2DeepSeek$0.30
Claude Opus 5 (high), Claude CodeAnthropic$0.32
GLM-5.2 (max), Terminus-2Z.ai$0.32
Claude Opus 4.7 (high), Claude CodeAnthropic$0.34
GLM-5.2 (max), Claude CodeZ.ai$0.34
DeepSeek V4 Pro (max), Terminus-2DeepSeek$0.35
GLM-5.3 (max), Terminus-2Z.ai$0.38
GLM-5.3 (max), Claude CodeZ.ai$0.48

Open weights

Cost per task

Average cost per agent task (USD) · Lower is better

Cost per taskCost per task in US dollars: Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2: $0.0096; Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2: $0.012; gpt-oss-20b (high), Terminus-2: $0.017; MiniMax M3.1 Flash (max), Terminus-2: $0.017; Gemma 4 26B A4B (Reasoning), Terminus-2: $0.021; Llama 3.3 70B (Non-reasoning), Terminus-2: $0.023; Mistral Large 3 (Non-reasoning), Terminus-2: $0.026; gpt-oss-120b (high), Terminus-2: $0.026; DeepSeek V4.1 Flash (max), Codex: $0.067; Nemotron 3 Ultra (high), Terminus-2: $0.069; Step 5 Preview (Reasoning), Terminus-2: $0.071; GLM-5.3-Flash (max), Claude Code: $0.093; Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2: $0.13; Kimi K2.7 Code (Reasoning), Kimi Code: $0.18; Qwen 3.8 27B (xhigh), Qwen Code: $0.22; Kimi K3 (Reasoning), Terminus-2: $0.23; DeepSeek V4 Pro (max), Terminus-2: $0.35; GLM-5.3 (max), Claude Code: $0.48$0$0.15$0.30$0.45$0.60Nemotron 3.5 Super VL 120B (Reasoning)Terminus-2$0.0096Nemotron 3.5 Lightning 30B (Reasoning)Terminus-2$0.012gpt-oss-20b (high)Terminus-2$0.017MiniMax M3.1 Flash (max)Terminus-2$0.017Gemma 4 26B A4B (Reasoning)Terminus-2$0.021Llama 3.3 70B (Non-reasoning)Terminus-2$0.023Mistral Large 3 (Non-reasoning)Terminus-2$0.026gpt-oss-120b (high)Terminus-2$0.026DeepSeek V4.1 Flash (max)Codex$0.067Nemotron 3 Ultra (high)Terminus-2$0.069Step 5 Preview (Reasoning)Terminus-2$0.071GLM-5.3-Flash (max)Claude Code$0.093Nemotron 3 Nano Omni 30B (Reasoning)Terminus-2$0.13Kimi K2.7 Code (Reasoning)Kimi Code$0.18Qwen 3.8 27B (xhigh)Qwen Code$0.22Kimi K3 (Reasoning)Terminus-2$0.23DeepSeek V4 Pro (max)Terminus-2$0.35GLM-5.3 (max)Claude Code$0.48
How to read this chart

What cost is measuring. What one attempt at a task would cost if paid token by token at the provider's published API prices, averaged over attempts: ordinary input tokens, input tokens served from the provider's cache at the lower cached price, tokens written to the cache where the provider charges for that, and output tokens (thinking included). Cost assumes each harness uses the model's pay-per-token API, priced at public list rates; sandboxes and our own engineering time are not included. Failed attempts count too.

How to read this chart. Lower is better. Costs are pay-per-token list prices, not any discount or credit a customer might have.

Data table: Cost per task
Cost per task
ModelDeveloperCost per task
gpt-oss-120b (low), Terminus-2OpenAI$0.0046
Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2NVIDIA$0.0096
Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2NVIDIA$0.012
gpt-oss-20b (high), Terminus-2OpenAI$0.017
MiniMax M3.1 Flash (max), Terminus-2MiniMax$0.017
Gemma 4 26B A4B (Reasoning), Terminus-2Google$0.021
Llama 3.3 70B (Non-reasoning), Terminus-2Meta$0.023
Mistral Large 3 (Non-reasoning), Terminus-2Mistral AI$0.026
gpt-oss-120b (high), Terminus-2OpenAI$0.026
GLM-4.7-Flash (Reasoning), Terminus-2Z.ai$0.037
GLM-5.3-Flash (low), Terminus-2Z.ai$0.048
DeepSeek V4 Flash (max), Terminus-2DeepSeek$0.062
DeepSeek V4 Flash (high), Terminus-2DeepSeek$0.065
DeepSeek V4.1 Flash (max), CodexDeepSeek$0.067
Nemotron 3 Ultra (high), Terminus-2NVIDIA$0.069
Step 5 Preview (Reasoning), Terminus-2StepFun$0.071
DeepSeek V4 Flash (high), CodexDeepSeek$0.085
Kimi K2.6 (Reasoning), Terminus-2Moonshot AI$0.089
GLM-5.3-Flash (max), Claude CodeZ.ai$0.093
gpt-oss-20b (high), CodexOpenAI$0.094
GLM-5.3-Flash (max), Terminus-2Z.ai$0.094
GLM-5.2 (Non-reasoning), Terminus-2Z.ai$0.099
Qwen 3.8 27B (xhigh), Terminus-2Alibaba (Qwen)$0.10
Kimi K2.7 Code (Reasoning), Terminus-2Moonshot AI$0.11
Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2NVIDIA$0.13
Kimi K2.7 Code (Reasoning), Kimi CodeMoonshot AI$0.18
GLM-5.2 (high), Terminus-2Z.ai$0.22
Qwen 3.8 27B (xhigh), Qwen CodeAlibaba (Qwen)$0.22
Kimi K3 (Reasoning), Terminus-2Moonshot AI$0.23
gpt-oss-120b (high), CodexOpenAI$0.26
Kimi K2.6 (Reasoning), Kimi CodeMoonshot AI$0.27
GLM-4.7-Flash (Reasoning), Claude CodeZ.ai$0.27
GLM-5.3 (low), Terminus-2Z.ai$0.27
DeepSeek V4 Pro (high), Terminus-2DeepSeek$0.30
GLM-5.2 (max), Terminus-2Z.ai$0.32
GLM-5.2 (max), Claude CodeZ.ai$0.34
DeepSeek V4 Pro (max), Terminus-2DeepSeek$0.35
GLM-5.3 (max), Terminus-2Z.ai$0.38
GLM-5.3 (max), Claude CodeZ.ai$0.48

All

Geospatial Agent Index vs. cost per task

Geospatial Agent Index, Text only; cost per task (USD) · Higher and further left is better

  • Most attractive quadrant
  • Pareto line
Geospatial Agent Index vs. cost per taskGeospatial Agent Index (0 to 100) against cost per task in US dollars, log scale: DeepSeek V4 Pro (max), Terminus-2: 71, $0.35; Gemini 3.1 Flash-Lite (high), Terminus-2: 56.33, $0.031; Gemini 3.8 Flash (low), Terminus-2: 71.24, $0.11; Gemma 4 26B A4B (Reasoning), Terminus-2: 55.79, $0.021; gpt-oss-120b (high), Terminus-2: 45.57, $0.026; gpt-oss-20b (high), Terminus-2: 33.48, $0.017; Kimi K3 (Reasoning), Terminus-2: 71.99, $0.23; Llama 3.3 70B (Non-reasoning), Terminus-2: 8.22, $0.023; MiniMax M3.1 Flash (max), Terminus-2: 50.59, $0.017; Mistral Large 3 (Non-reasoning), Terminus-2: 32.89, $0.026; Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2: 19.89, $0.13; Nemotron 3 Ultra (high), Terminus-2: 67.65, $0.069; Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2: 10.91, $0.012; Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2: 52.45, $0.0096; Step 5 Preview (Reasoning), Terminus-2: 33.8, $0.071; GLM-5.3-Flash (max), Claude Code: 71.56, $0.093; GLM-5.3 (max), Claude Code: 73.4, $0.48; DeepSeek V4.1 Flash (max), Codex: 70.68, $0.067; Kimi K2.7 Code (Reasoning), Kimi Code: 71.76, $0.18; Qwen 3.8 27B (xhigh), Qwen Code: 68.32, $0.22; Claude Opus 5.5 (xhigh), Claude Code: 84.65, $0.25; Claude Sonnet 5.5 (xhigh), Claude Code: 79.01, $0.11; Claude Haiku 5.5 (xhigh), Claude Code: 75.72, $0.017; GPT-6.1 Sol (xhigh), Codex: 81.82, $0.085; GPT-5.6 Terra (high), Codex: 69.32, $0.10; GPT-5.6 Luna (xhigh), Codex: 72.66, $0.021Most attractive quadrant0102030405060708090100$0.005$0.01$0.02$0.05$0.10$0.20$0.50$1.00Cost per task (USD, log scale)Geospatial Agent IndexStep 5 Preview (Reasoning), Terminus-2Claude Opus 5.5 (xhigh), Claude CodeGPT-6.1 Sol (xhigh), CodexClaude Haiku 5.5 (xhigh), Claude CodeGPT-5.6 Luna (xhigh), CodexDeepSeek V4.1 Flash (max), CodexNemotron 3.5 Super VL 120B (Reasoning), Terminus-2Claude Sonnet 5.5 (xhigh), Claude CodeGLM-5.3 (max), Claude CodeKimi K3 (Reasoning), Terminus-2Kimi K2.7 Code (Reasoning), Kimi CodeGLM-5.3-Flash (max), Claude CodeGemini 3.8 Flash (low), Terminus-2DeepSeek V4 Pro (max), Terminus-2GPT-5.6 Terra (high), CodexQwen 3.8 27B (xhigh), Qwen CodeNemotron 3 Ultra (high), Terminus-2Gemini 3.1 Flash-Lite (high), Terminus-2Gemma 4 26B A4B (Reasoning), Terminus-2MiniMax M3.1 Flash (max), Terminus-2gpt-oss-120b (high), Terminus-2gpt-oss-20b (high), Terminus-2Mistral Large 3 (Non-reasoning), Terminus-2Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2Llama 3.3 70B (Non-reasoning), Terminus-2
How to read this chart

Why a log scale. Costs and times differ by a factor of ten or more between models, so equal steps on the axis are equal ratios.

Not yet ranked. Entries with too few tasks run so far are not plotted; the table lists them, and every entry is on the models page.

What cost is measuring. What one attempt at a task would cost if paid token by token at the provider's published API prices, averaged over attempts: ordinary input tokens, input tokens served from the provider's cache at the lower cached price, tokens written to the cache where the provider charges for that, and output tokens (thinking included). Cost assumes each harness uses the model's pay-per-token API, priced at public list rates; sandboxes and our own engineering time are not included. Failed attempts count too.

How to read this chart. Each point is one entry. Further left means a lower average cost per task (log scale); higher means a higher Geospatial Agent Index. Both axes fit the models shown, so the score axis does not start at zero. The shaded most attractive quadrant is the top-left quarter of the plot, split at the middle of each axis: a reading aid that moves with the axes when you change the models shown, not a fixed bar. The dotted Pareto line joins the shown models that no cheaper shown model beats on score.

Data table: Geospatial Agent Index vs. cost per task

Open weights

Geospatial Agent Index vs. cost per task

Geospatial Agent Index, Text only; cost per task (USD) · Higher and further left is better

  • Most attractive quadrant
  • Pareto line
Geospatial Agent Index vs. cost per taskGeospatial Agent Index (0 to 100) against cost per task in US dollars, log scale: DeepSeek V4 Pro (max), Terminus-2: 71, $0.35; Gemma 4 26B A4B (Reasoning), Terminus-2: 55.79, $0.021; gpt-oss-120b (high), Terminus-2: 45.57, $0.026; gpt-oss-20b (high), Terminus-2: 33.48, $0.017; Kimi K3 (Reasoning), Terminus-2: 71.99, $0.23; Llama 3.3 70B (Non-reasoning), Terminus-2: 8.22, $0.023; MiniMax M3.1 Flash (max), Terminus-2: 50.59, $0.017; Mistral Large 3 (Non-reasoning), Terminus-2: 32.89, $0.026; Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2: 19.89, $0.13; Nemotron 3 Ultra (high), Terminus-2: 67.65, $0.069; Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2: 10.91, $0.012; Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2: 52.45, $0.0096; Step 5 Preview (Reasoning), Terminus-2: 33.8, $0.071; GLM-5.3-Flash (max), Claude Code: 71.56, $0.093; GLM-5.3 (max), Claude Code: 73.4, $0.48; DeepSeek V4.1 Flash (max), Codex: 70.68, $0.067; Kimi K2.7 Code (Reasoning), Kimi Code: 71.76, $0.18; Qwen 3.8 27B (xhigh), Qwen Code: 68.32, $0.22Most attractive quadrant01020304050607080$0.005$0.01$0.02$0.05$0.10$0.20$0.50$1.00Cost per task (USD, log scale)Geospatial Agent IndexStep 5 Preview (Reasoning), Terminus-2GLM-5.3 (max), Claude CodeKimi K3 (Reasoning), Terminus-2Kimi K2.7 Code (Reasoning), Kimi CodeGLM-5.3-Flash (max), Claude CodeDeepSeek V4.1 Flash (max), CodexNemotron 3 Ultra (high), Terminus-2Gemma 4 26B A4B (Reasoning), Terminus-2Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2DeepSeek V4 Pro (max), Terminus-2Qwen 3.8 27B (xhigh), Qwen CodeMiniMax M3.1 Flash (max), Terminus-2gpt-oss-120b (high), Terminus-2gpt-oss-20b (high), Terminus-2Mistral Large 3 (Non-reasoning), Terminus-2Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2Llama 3.3 70B (Non-reasoning), Terminus-2
How to read this chart

Why a log scale. Costs and times differ by a factor of ten or more between models, so equal steps on the axis are equal ratios.

What cost is measuring. What one attempt at a task would cost if paid token by token at the provider's published API prices, averaged over attempts: ordinary input tokens, input tokens served from the provider's cache at the lower cached price, tokens written to the cache where the provider charges for that, and output tokens (thinking included). Cost assumes each harness uses the model's pay-per-token API, priced at public list rates; sandboxes and our own engineering time are not included. Failed attempts count too.

How to read this chart. Each point is one entry. Further left means a lower average cost per task (log scale); higher means a higher Geospatial Agent Index. Both axes fit the models shown, so the score axis does not start at zero. The shaded most attractive quadrant is the top-left quarter of the plot, split at the middle of each axis: a reading aid that moves with the axes when you change the models shown, not a fixed bar. The dotted Pareto line joins the shown models that no cheaper shown model beats on score.

Data table: Geospatial Agent Index vs. cost per task

Time

All

Time per task

Average minutes per agent task, at 100 output tokens/s · Lower is better

Time per taskTime per task: GPT-6.1 Sol (xhigh), Codex: 0.8 min; GPT-5.6 Terra (high), Codex: 0.8 min; Mistral Large 3 (Non-reasoning), Terminus-2: 1.1 min; Claude Sonnet 5.5 (xhigh), Claude Code: 1.2 min; Claude Opus 5.5 (xhigh), Claude Code: 1.4 min; GPT-5.6 Luna (xhigh), Codex: 1.7 min; Kimi K2.7 Code (Reasoning), Kimi Code: 1.9 min; Gemini 3.8 Flash (low), Terminus-2: 1.9 min; Llama 3.3 70B (Non-reasoning), Terminus-2: 2.1 min; Nemotron 3 Ultra (high), Terminus-2: 2.4 min; Claude Haiku 5.5 (xhigh), Claude Code: 2.5 min; Kimi K3 (Reasoning), Terminus-2: 2.7 min; gpt-oss-120b (high), Terminus-2: 3.0 min; Gemini 3.1 Flash-Lite (high), Terminus-2: 3.1 min; Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2: 3.8 min; GLM-5.3 (max), Claude Code: 4.3 min; Qwen 3.8 27B (xhigh), Qwen Code: 4.7 min; DeepSeek V4 Pro (max), Terminus-2: 4.9 min; Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2: 4.9 min; Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2: 4.9 min; Gemma 4 26B A4B (Reasoning), Terminus-2: 5.6 min; GLM-5.3-Flash (max), Claude Code: 6.5 min; gpt-oss-20b (high), Terminus-2: 7.2 min; Step 5 Preview (Reasoning), Terminus-2: 7.9 min; DeepSeek V4.1 Flash (max), Codex: 8.6 min; MiniMax M3.1 Flash (max), Terminus-2: 8.6 min02.557.510GPT-6.1 Sol (xhigh)Codex0.8 minGPT-5.6 Terra (high)Codex0.8 minMistral Large 3 (Non-reasoning)Terminus-21.1 minClaude Sonnet 5.5 (xhigh)Claude Code1.2 minClaude Opus 5.5 (xhigh)Claude Code1.4 minGPT-5.6 Luna (xhigh)Codex1.7 minKimi K2.7 Code (Reasoning)Kimi Code1.9 minGemini 3.8 Flash (low)Terminus-21.9 minLlama 3.3 70B (Non-reasoning)Terminus-22.1 minNemotron 3 Ultra (high)Terminus-22.4 minClaude Haiku 5.5 (xhigh)Claude Code2.5 minKimi K3 (Reasoning)Terminus-22.7 mingpt-oss-120b (high)Terminus-23.0 minGemini 3.1 Flash-Lite (high)Terminus-23.1 minNemotron 3.5 Super VL 120B (Reasoning)Terminus-23.8 minGLM-5.3 (max)Claude Code4.3 minQwen 3.8 27B (xhigh)Qwen Code4.7 minDeepSeek V4 Pro (max)Terminus-24.9 minNemotron 3 Nano Omni 30B (Reasoning)Terminus-24.9 minNemotron 3.5 Lightning 30B (Reasoning)Terminus-24.9 minGemma 4 26B A4B (Reasoning)Terminus-25.6 minGLM-5.3-Flash (max)Claude Code6.5 mingpt-oss-20b (high)Terminus-27.2 minStep 5 Preview (Reasoning)Terminus-27.9 minDeepSeek V4.1 Flash (max)Codex8.6 minMiniMax M3.1 Flash (max)Terminus-28.6 min
How to read this chart

What this metric means. Time as if every model wrote 100 output tokens per second: output tokens divided by 100, plus the time the agent's commands took. Serving speed differs between providers and is not ranked.

Data table: Time per task
Time per task
ModelDeveloperTime per task (at 100 output tokens/s)
Claude Opus 5.5 (low), Claude CodeAnthropic0.4 min
Claude Sonnet 5.5 (medium), Claude CodeAnthropic0.4 min
GPT-6.1 Sol (medium), CodexOpenAI0.4 min
GPT-6 Luna (medium), CodexOpenAI0.4 min
Claude Sonnet 5.5 (low), Claude CodeAnthropic0.4 min
GPT-6 Luna (low), CodexOpenAI0.5 min
gpt-oss-120b (low), Terminus-2OpenAI0.5 min
GPT-6.1 Sol (high), CodexOpenAI0.5 min
Claude Opus 5.5 (medium), Claude CodeAnthropic0.5 min
GPT-5.6 Luna (low), CodexOpenAI0.5 min
Gemini 3.1 Flash-Lite (minimal), Terminus-2Google0.6 min
Claude Sonnet 5.5 (high), Claude CodeAnthropic0.6 min
GPT-6 Luna (high), CodexOpenAI0.7 min
Claude Opus 5.5 (high), Claude CodeAnthropic0.7 min
GPT-6 Sol (high), CodexOpenAI0.8 min
GPT-5.6 Luna (medium), CodexOpenAI0.8 min
GPT-6.1 Sol (xhigh), CodexOpenAI0.8 min
GPT-5.6 Terra (high), CodexOpenAI0.8 min
Claude Opus 4.8 (high), Claude CodeAnthropic0.9 min
Claude Haiku 5.5 (low), Claude CodeAnthropic0.9 min
Claude Opus 4.7 (high), Claude CodeAnthropic0.9 min
Claude Haiku 5.5 (medium), Claude CodeAnthropic1.0 min
GPT-5.6 Sol (high), CodexOpenAI1.0 min
Claude Opus 5 (high), Claude CodeAnthropic1.1 min
Mistral Large 3 (Non-reasoning), Terminus-2Mistral AI1.1 min
Claude Sonnet 5.5 (xhigh), Claude CodeAnthropic1.2 min
Claude Haiku 5.5 (high), Claude CodeAnthropic1.4 min
Claude Opus 5.5 (xhigh), Claude CodeAnthropic1.4 min
GPT-6 Luna (xhigh), CodexOpenAI1.4 min
GPT-5.6 Luna (high), CodexOpenAI1.4 min
Claude Sonnet 5 (high), Claude CodeAnthropic1.5 min
GLM-5.2 (Non-reasoning), Terminus-2Z.ai1.5 min
Claude Haiku 4.5 (Reasoning), Claude CodeAnthropic1.6 min
GPT-5.6 Luna (xhigh), CodexOpenAI1.7 min
Gemini 3.1 Flash-Lite (low), Terminus-2Google1.7 min
Kimi K2.7 Code (Reasoning), Kimi CodeMoonshot AI1.9 min
Gemini 3.8 Flash (low), Terminus-2Google1.9 min
Llama 3.3 70B (Non-reasoning), Terminus-2Meta2.1 min
Nemotron 3 Ultra (high), Terminus-2NVIDIA2.4 min
Claude Haiku 5.5 (xhigh), Claude CodeAnthropic2.5 min
GLM-5.3 (low), Terminus-2Z.ai2.7 min
Kimi K3 (Reasoning), Terminus-2Moonshot AI2.7 min
Kimi K2.6 (Reasoning), Kimi CodeMoonshot AI3.0 min
gpt-oss-120b (high), Terminus-2OpenAI3.0 min
Gemini 3.1 Flash-Lite (high), Terminus-2Google3.1 min
Kimi K2.6 (Reasoning), Terminus-2Moonshot AI3.5 min
Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2NVIDIA3.8 min
GLM-4.7-Flash (Reasoning), Claude CodeZ.ai3.8 min
Kimi K2.7 Code (Reasoning), Terminus-2Moonshot AI4.0 min
DeepSeek V4 Pro (high), Terminus-2DeepSeek4.0 min
GLM-5.3 (max), Terminus-2Z.ai4.2 min
GLM-5.3-Flash (low), Terminus-2Z.ai4.2 min
GLM-5.3 (max), Claude CodeZ.ai4.3 min
Qwen 3.8 27B (xhigh), Qwen CodeAlibaba (Qwen)4.7 min
GLM-5.2 (high), Terminus-2Z.ai4.7 min
gpt-oss-20b (high), CodexOpenAI4.8 min
DeepSeek V4 Pro (max), Terminus-2DeepSeek4.9 min
Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2NVIDIA4.9 min
Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2NVIDIA4.9 min
GLM-4.7-Flash (Reasoning), Terminus-2Z.ai5.4 min
Gemma 4 26B A4B (Reasoning), Terminus-2Google5.6 min
DeepSeek V4 Flash (max), Terminus-2DeepSeek5.7 min
DeepSeek V4 Flash (high), Terminus-2DeepSeek5.9 min
gpt-oss-120b (high), CodexOpenAI6.0 min
GLM-5.2 (max), Terminus-2Z.ai6.1 min
GLM-5.2 (max), Claude CodeZ.ai6.3 min
DeepSeek V4 Flash (high), CodexDeepSeek6.5 min
GLM-5.3-Flash (max), Claude CodeZ.ai6.5 min
gpt-oss-20b (high), Terminus-2OpenAI7.2 min
Qwen 3.8 27B (xhigh), Terminus-2Alibaba (Qwen)7.3 min
Step 5 Preview (Reasoning), Terminus-2StepFun7.9 min
GLM-5.3-Flash (max), Terminus-2Z.ai8.5 min
DeepSeek V4.1 Flash (max), CodexDeepSeek8.6 min
MiniMax M3.1 Flash (max), Terminus-2MiniMax8.6 min

Open weights

Time per task

Average minutes per agent task, at 100 output tokens/s · Lower is better

Time per taskTime per task: Mistral Large 3 (Non-reasoning), Terminus-2: 1.1 min; Kimi K2.7 Code (Reasoning), Kimi Code: 1.9 min; Llama 3.3 70B (Non-reasoning), Terminus-2: 2.1 min; Nemotron 3 Ultra (high), Terminus-2: 2.4 min; Kimi K3 (Reasoning), Terminus-2: 2.7 min; gpt-oss-120b (high), Terminus-2: 3.0 min; Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2: 3.8 min; GLM-5.3 (max), Claude Code: 4.3 min; Qwen 3.8 27B (xhigh), Qwen Code: 4.7 min; DeepSeek V4 Pro (max), Terminus-2: 4.9 min; Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2: 4.9 min; Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2: 4.9 min; Gemma 4 26B A4B (Reasoning), Terminus-2: 5.6 min; GLM-5.3-Flash (max), Claude Code: 6.5 min; gpt-oss-20b (high), Terminus-2: 7.2 min; Step 5 Preview (Reasoning), Terminus-2: 7.9 min; DeepSeek V4.1 Flash (max), Codex: 8.6 min; MiniMax M3.1 Flash (max), Terminus-2: 8.6 min02.557.510Mistral Large 3 (Non-reasoning)Terminus-21.1 minKimi K2.7 Code (Reasoning)Kimi Code1.9 minLlama 3.3 70B (Non-reasoning)Terminus-22.1 minNemotron 3 Ultra (high)Terminus-22.4 minKimi K3 (Reasoning)Terminus-22.7 mingpt-oss-120b (high)Terminus-23.0 minNemotron 3.5 Super VL 120B (Reasoning)Terminus-23.8 minGLM-5.3 (max)Claude Code4.3 minQwen 3.8 27B (xhigh)Qwen Code4.7 minDeepSeek V4 Pro (max)Terminus-24.9 minNemotron 3 Nano Omni 30B (Reasoning)Terminus-24.9 minNemotron 3.5 Lightning 30B (Reasoning)Terminus-24.9 minGemma 4 26B A4B (Reasoning)Terminus-25.6 minGLM-5.3-Flash (max)Claude Code6.5 mingpt-oss-20b (high)Terminus-27.2 minStep 5 Preview (Reasoning)Terminus-27.9 minDeepSeek V4.1 Flash (max)Codex8.6 minMiniMax M3.1 Flash (max)Terminus-28.6 min
How to read this chart

What this metric means. Time as if every model wrote 100 output tokens per second: output tokens divided by 100, plus the time the agent's commands took. Serving speed differs between providers and is not ranked.

Data table: Time per task
Time per task
ModelDeveloperTime per task (at 100 output tokens/s)
gpt-oss-120b (low), Terminus-2OpenAI0.5 min
Mistral Large 3 (Non-reasoning), Terminus-2Mistral AI1.1 min
GLM-5.2 (Non-reasoning), Terminus-2Z.ai1.5 min
Kimi K2.7 Code (Reasoning), Kimi CodeMoonshot AI1.9 min
Llama 3.3 70B (Non-reasoning), Terminus-2Meta2.1 min
Nemotron 3 Ultra (high), Terminus-2NVIDIA2.4 min
GLM-5.3 (low), Terminus-2Z.ai2.7 min
Kimi K3 (Reasoning), Terminus-2Moonshot AI2.7 min
Kimi K2.6 (Reasoning), Kimi CodeMoonshot AI3.0 min
gpt-oss-120b (high), Terminus-2OpenAI3.0 min
Kimi K2.6 (Reasoning), Terminus-2Moonshot AI3.5 min
Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2NVIDIA3.8 min
GLM-4.7-Flash (Reasoning), Claude CodeZ.ai3.8 min
Kimi K2.7 Code (Reasoning), Terminus-2Moonshot AI4.0 min
DeepSeek V4 Pro (high), Terminus-2DeepSeek4.0 min
GLM-5.3 (max), Terminus-2Z.ai4.2 min
GLM-5.3-Flash (low), Terminus-2Z.ai4.2 min
GLM-5.3 (max), Claude CodeZ.ai4.3 min
Qwen 3.8 27B (xhigh), Qwen CodeAlibaba (Qwen)4.7 min
GLM-5.2 (high), Terminus-2Z.ai4.7 min
gpt-oss-20b (high), CodexOpenAI4.8 min
DeepSeek V4 Pro (max), Terminus-2DeepSeek4.9 min
Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2NVIDIA4.9 min
Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2NVIDIA4.9 min
GLM-4.7-Flash (Reasoning), Terminus-2Z.ai5.4 min
Gemma 4 26B A4B (Reasoning), Terminus-2Google5.6 min
DeepSeek V4 Flash (max), Terminus-2DeepSeek5.7 min
DeepSeek V4 Flash (high), Terminus-2DeepSeek5.9 min
gpt-oss-120b (high), CodexOpenAI6.0 min
GLM-5.2 (max), Terminus-2Z.ai6.1 min
GLM-5.2 (max), Claude CodeZ.ai6.3 min
DeepSeek V4 Flash (high), CodexDeepSeek6.5 min
GLM-5.3-Flash (max), Claude CodeZ.ai6.5 min
gpt-oss-20b (high), Terminus-2OpenAI7.2 min
Qwen 3.8 27B (xhigh), Terminus-2Alibaba (Qwen)7.3 min
Step 5 Preview (Reasoning), Terminus-2StepFun7.9 min
GLM-5.3-Flash (max), Terminus-2Z.ai8.5 min
DeepSeek V4.1 Flash (max), CodexDeepSeek8.6 min
MiniMax M3.1 Flash (max), Terminus-2MiniMax8.6 min

All

Geospatial Agent Index vs. time per task

Geospatial Agent Index, Text only; time per task (minutes) · Higher and further left is better

  • Most attractive quadrant
  • Pareto line
Geospatial Agent Index vs. time per taskGeospatial Agent Index (0 to 100) against time per task (minutes), log scale: DeepSeek V4 Pro (max), Terminus-2: 71, 4.9 min; Gemini 3.1 Flash-Lite (high), Terminus-2: 56.33, 3.1 min; Gemini 3.8 Flash (low), Terminus-2: 71.24, 1.9 min; Gemma 4 26B A4B (Reasoning), Terminus-2: 55.79, 5.6 min; gpt-oss-120b (high), Terminus-2: 45.57, 3.0 min; gpt-oss-20b (high), Terminus-2: 33.48, 7.2 min; Kimi K3 (Reasoning), Terminus-2: 71.99, 2.7 min; Llama 3.3 70B (Non-reasoning), Terminus-2: 8.22, 2.1 min; MiniMax M3.1 Flash (max), Terminus-2: 50.59, 8.6 min; Mistral Large 3 (Non-reasoning), Terminus-2: 32.89, 1.1 min; Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2: 19.89, 4.9 min; Nemotron 3 Ultra (high), Terminus-2: 67.65, 2.4 min; Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2: 10.91, 4.9 min; Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2: 52.45, 3.8 min; Step 5 Preview (Reasoning), Terminus-2: 33.8, 7.9 min; GLM-5.3-Flash (max), Claude Code: 71.56, 6.5 min; GLM-5.3 (max), Claude Code: 73.4, 4.3 min; DeepSeek V4.1 Flash (max), Codex: 70.68, 8.6 min; Kimi K2.7 Code (Reasoning), Kimi Code: 71.76, 1.9 min; Qwen 3.8 27B (xhigh), Qwen Code: 68.32, 4.7 min; Claude Opus 5.5 (xhigh), Claude Code: 84.65, 1.4 min; Claude Sonnet 5.5 (xhigh), Claude Code: 79.01, 1.2 min; Claude Haiku 5.5 (xhigh), Claude Code: 75.72, 2.5 min; GPT-6.1 Sol (xhigh), Codex: 81.82, 0.8 min; GPT-5.6 Terra (high), Codex: 69.32, 0.8 min; GPT-5.6 Luna (xhigh), Codex: 72.66, 1.7 minMost attractive quadrant01020304050607080901000.5 min1 min2 min5 min10 minTime per task (minutes, log scale)Geospatial Agent IndexStep 5 Preview (Reasoning), Terminus-2Claude Opus 5.5 (xhigh), Claude CodeGPT-6.1 Sol (xhigh), CodexClaude Sonnet 5.5 (xhigh), Claude CodeClaude Haiku 5.5 (xhigh), Claude CodeGLM-5.3 (max), Claude CodeGPT-5.6 Luna (xhigh), CodexKimi K3 (Reasoning), Terminus-2Kimi K2.7 Code (Reasoning), Kimi CodeGLM-5.3-Flash (max), Claude CodeGemini 3.8 Flash (low), Terminus-2DeepSeek V4 Pro (max), Terminus-2DeepSeek V4.1 Flash (max), CodexGPT-5.6 Terra (high), CodexQwen 3.8 27B (xhigh), Qwen CodeNemotron 3 Ultra (high), Terminus-2Gemini 3.1 Flash-Lite (high), Terminus-2Gemma 4 26B A4B (Reasoning), Terminus-2Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2MiniMax M3.1 Flash (max), Terminus-2gpt-oss-120b (high), Terminus-2gpt-oss-20b (high), Terminus-2Mistral Large 3 (Non-reasoning), Terminus-2Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2Llama 3.3 70B (Non-reasoning), Terminus-2
How to read this chart

Why a log scale. Costs and times differ by a factor of ten or more between models, so equal steps on the axis are equal ratios.

What this metric means. Time as if every model wrote 100 output tokens per second: output tokens divided by 100, plus the time the agent's commands took. Serving speed differs between providers and is not ranked.

Not yet ranked. Entries with too few tasks run so far are not plotted; the table lists them, and every entry is on the models page.

How to read this chart. Each point is one entry. Further left means a lower average time per task (log scale); higher means a higher Geospatial Agent Index. Both axes fit the models shown, so the score axis does not start at zero. The shaded most attractive quadrant is the top-left quarter of the plot, split at the middle of each axis: a reading aid that moves with the axes when you change the models shown, not a fixed bar. The dotted Pareto line joins the shown models that no faster shown model beats on score.

Data table: Geospatial Agent Index vs. time per task

Open weights

Geospatial Agent Index vs. time per task

Geospatial Agent Index, Text only; time per task (minutes) · Higher and further left is better

  • Most attractive quadrant
  • Pareto line
Geospatial Agent Index vs. time per taskGeospatial Agent Index (0 to 100) against time per task (minutes), log scale: DeepSeek V4 Pro (max), Terminus-2: 71, 4.9 min; Gemma 4 26B A4B (Reasoning), Terminus-2: 55.79, 5.6 min; gpt-oss-120b (high), Terminus-2: 45.57, 3.0 min; gpt-oss-20b (high), Terminus-2: 33.48, 7.2 min; Kimi K3 (Reasoning), Terminus-2: 71.99, 2.7 min; Llama 3.3 70B (Non-reasoning), Terminus-2: 8.22, 2.1 min; MiniMax M3.1 Flash (max), Terminus-2: 50.59, 8.6 min; Mistral Large 3 (Non-reasoning), Terminus-2: 32.89, 1.1 min; Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2: 19.89, 4.9 min; Nemotron 3 Ultra (high), Terminus-2: 67.65, 2.4 min; Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2: 10.91, 4.9 min; Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2: 52.45, 3.8 min; Step 5 Preview (Reasoning), Terminus-2: 33.8, 7.9 min; GLM-5.3-Flash (max), Claude Code: 71.56, 6.5 min; GLM-5.3 (max), Claude Code: 73.4, 4.3 min; DeepSeek V4.1 Flash (max), Codex: 70.68, 8.6 min; Kimi K2.7 Code (Reasoning), Kimi Code: 71.76, 1.9 min; Qwen 3.8 27B (xhigh), Qwen Code: 68.32, 4.7 minMost attractive quadrant010203040506070801 min2 min5 min10 minTime per task (minutes, log scale)Geospatial Agent IndexStep 5 Preview (Reasoning), Terminus-2GLM-5.3 (max), Claude CodeKimi K3 (Reasoning), Terminus-2Kimi K2.7 Code (Reasoning), Kimi CodeNemotron 3 Ultra (high), Terminus-2Mistral Large 3 (Non-reasoning), Terminus-2GLM-5.3-Flash (max), Claude CodeDeepSeek V4 Pro (max), Terminus-2DeepSeek V4.1 Flash (max), CodexQwen 3.8 27B (xhigh), Qwen CodeGemma 4 26B A4B (Reasoning), Terminus-2Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2MiniMax M3.1 Flash (max), Terminus-2gpt-oss-120b (high), Terminus-2gpt-oss-20b (high), Terminus-2Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2Llama 3.3 70B (Non-reasoning), Terminus-2
How to read this chart

Why a log scale. Costs and times differ by a factor of ten or more between models, so equal steps on the axis are equal ratios.

What this metric means. Time as if every model wrote 100 output tokens per second: output tokens divided by 100, plus the time the agent's commands took. Serving speed differs between providers and is not ranked.

How to read this chart. Each point is one entry. Further left means a lower average time per task (log scale); higher means a higher Geospatial Agent Index. Both axes fit the models shown, so the score axis does not start at zero. The shaded most attractive quadrant is the top-left quarter of the plot, split at the middle of each axis: a reading aid that moves with the axes when you change the models shown, not a fixed bar. The dotted Pareto line joins the shown models that no faster shown model beats on score.

Data table: Geospatial Agent Index vs. time per task

Tokens

All

Output tokens per task

Average output tokens per agent task, reasoning included · Lower is better

Output tokens per taskOutput tokens per task: Llama 3.3 70B (Non-reasoning), Terminus-2: 2k; GPT-5.6 Terra (high), Codex: 3k; GPT-6.1 Sol (xhigh), Codex: 3k; Claude Sonnet 5.5 (xhigh), Claude Code: 4k; Mistral Large 3 (Non-reasoning), Terminus-2: 4k; Claude Opus 5.5 (xhigh), Claude Code: 5k; Kimi K3 (Reasoning), Terminus-2: 6k; Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2: 6k; GPT-5.6 Luna (xhigh), Codex: 7k; Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2: 7k; Gemini 3.8 Flash (low), Terminus-2: 8k; Nemotron 3 Ultra (high), Terminus-2: 10k; Step 5 Preview (Reasoning), Terminus-2: 10k; Kimi K2.7 Code (Reasoning), Kimi Code: 11k; Claude Haiku 5.5 (xhigh), Claude Code: 12k; gpt-oss-120b (high), Terminus-2: 15k; GLM-5.3 (max), Claude Code: 15k; Gemini 3.1 Flash-Lite (high), Terminus-2: 16k; MiniMax M3.1 Flash (max), Terminus-2: 19k; Gemma 4 26B A4B (Reasoning), Terminus-2: 21k; Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2: 22k; DeepSeek V4 Pro (max), Terminus-2: 24k; Qwen 3.8 27B (xhigh), Qwen Code: 28k; GLM-5.3-Flash (max), Claude Code: 29k; DeepSeek V4.1 Flash (max), Codex: 38k; gpt-oss-20b (high), Terminus-2: 40k010k20k30k40kLlama 3.3 70B (Non-reasoning)Terminus-22kGPT-5.6 Terra (high)Codex3kGPT-6.1 Sol (xhigh)Codex3kClaude Sonnet 5.5 (xhigh)Claude Code4kMistral Large 3 (Non-reasoning)Terminus-24kClaude Opus 5.5 (xhigh)Claude Code5kKimi K3 (Reasoning)Terminus-26kNemotron 3.5 Lightning 30B (Reasoning)Terminus-26kGPT-5.6 Luna (xhigh)Codex7kNemotron 3.5 Super VL 120B (Reasoning)Terminus-27kGemini 3.8 Flash (low)Terminus-28kNemotron 3 Ultra (high)Terminus-210kStep 5 Preview (Reasoning)Terminus-210kKimi K2.7 Code (Reasoning)Kimi Code11kClaude Haiku 5.5 (xhigh)Claude Code12kgpt-oss-120b (high)Terminus-215kGLM-5.3 (max)Claude Code15kGemini 3.1 Flash-Lite (high)Terminus-216kMiniMax M3.1 Flash (max)Terminus-219kGemma 4 26B A4B (Reasoning)Terminus-221kNemotron 3 Nano Omni 30B (Reasoning)Terminus-222kDeepSeek V4 Pro (max)Terminus-224kQwen 3.8 27B (xhigh)Qwen Code28kGLM-5.3-Flash (max)Claude Code29kDeepSeek V4.1 Flash (max)Codex38kgpt-oss-20b (high)Terminus-240k
How to read this chart

Output tokens per task. The average number of tokens the model wrote per attempt, its reasoning included, as reported by the provider.

Compare with care. Models use different tokenisers, so the same text is a different number of tokens for different models. Use token counts to see how much work each model did, and cost to compare spending.

Data table: Output tokens per task
Output tokens per task
ModelDeveloperOutput tokens per task
Claude Opus 5.5 (low), Claude CodeAnthropic1k
Claude Sonnet 5.5 (low), Claude CodeAnthropic1k
GPT-6 Luna (medium), CodexOpenAI1k
Claude Sonnet 5.5 (medium), Claude CodeAnthropic1k
GPT-6.1 Sol (medium), CodexOpenAI1k
GPT-6 Luna (low), CodexOpenAI1k
GPT-5.6 Luna (low), CodexOpenAI2k
gpt-oss-120b (low), Terminus-2OpenAI2k
Claude Opus 5.5 (medium), Claude CodeAnthropic2k
Claude Sonnet 5.5 (high), Claude CodeAnthropic2k
GPT-6.1 Sol (high), CodexOpenAI2k
Gemini 3.1 Flash-Lite (minimal), Terminus-2Google2k
Claude Opus 5.5 (high), Claude CodeAnthropic2k
Llama 3.3 70B (Non-reasoning), Terminus-2Meta2k
GPT-6 Luna (high), CodexOpenAI3k
GPT-5.6 Luna (medium), CodexOpenAI3k
GPT-6 Sol (high), CodexOpenAI3k
Claude Haiku 5.5 (low), Claude CodeAnthropic3k
GPT-5.6 Terra (high), CodexOpenAI3k
GPT-6.1 Sol (xhigh), CodexOpenAI3k
Claude Haiku 5.5 (medium), Claude CodeAnthropic4k
GPT-5.6 Sol (high), CodexOpenAI4k
Claude Opus 4.8 (high), Claude CodeAnthropic4k
Claude Opus 4.7 (high), Claude CodeAnthropic4k
Claude Sonnet 5.5 (xhigh), Claude CodeAnthropic4k
Claude Opus 5 (high), Claude CodeAnthropic4k
Mistral Large 3 (Non-reasoning), Terminus-2Mistral AI4k
Claude Opus 5.5 (xhigh), Claude CodeAnthropic5k
GPT-5.6 Luna (high), CodexOpenAI5k
GLM-5.2 (Non-reasoning), Terminus-2Z.ai6k
Claude Haiku 5.5 (high), Claude CodeAnthropic6k
Kimi K3 (Reasoning), Terminus-2Moonshot AI6k
GPT-6 Luna (xhigh), CodexOpenAI6k
Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2NVIDIA6k
Claude Sonnet 5 (high), Claude CodeAnthropic6k
Claude Haiku 4.5 (Reasoning), Claude CodeAnthropic7k
GPT-5.6 Luna (xhigh), CodexOpenAI7k
Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2NVIDIA7k
Gemini 3.1 Flash-Lite (low), Terminus-2Google8k
Gemini 3.8 Flash (low), Terminus-2Google8k
Nemotron 3 Ultra (high), Terminus-2NVIDIA10k
GLM-5.3 (low), Terminus-2Z.ai10k
Step 5 Preview (Reasoning), Terminus-2StepFun10k
Kimi K2.7 Code (Reasoning), Kimi CodeMoonshot AI11k
Kimi K2.7 Code (Reasoning), Terminus-2Moonshot AI12k
Kimi K2.6 (Reasoning), Terminus-2Moonshot AI12k
Claude Haiku 5.5 (xhigh), Claude CodeAnthropic12k
GLM-4.7-Flash (Reasoning), Terminus-2Z.ai14k
GLM-4.7-Flash (Reasoning), Claude CodeZ.ai15k
gpt-oss-120b (high), Terminus-2OpenAI15k
GLM-5.3-Flash (low), Terminus-2Z.ai15k
GLM-5.3 (max), Claude CodeZ.ai15k
Gemini 3.1 Flash-Lite (high), Terminus-2Google16k
Kimi K2.6 (Reasoning), Kimi CodeMoonshot AI18k
DeepSeek V4 Flash (high), CodexDeepSeek19k
MiniMax M3.1 Flash (max), Terminus-2MiniMax19k
Qwen 3.8 27B (xhigh), Terminus-2Alibaba (Qwen)19k
GLM-5.3 (max), Terminus-2Z.ai19k
DeepSeek V4 Pro (high), Terminus-2DeepSeek20k
Gemma 4 26B A4B (Reasoning), Terminus-2Google21k
GLM-5.2 (high), Terminus-2Z.ai22k
Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2NVIDIA22k
gpt-oss-20b (high), CodexOpenAI23k
DeepSeek V4 Pro (max), Terminus-2DeepSeek24k
gpt-oss-120b (high), CodexOpenAI27k
GLM-5.2 (max), Claude CodeZ.ai28k
Qwen 3.8 27B (xhigh), Qwen CodeAlibaba (Qwen)28k
GLM-5.3-Flash (max), Claude CodeZ.ai29k
DeepSeek V4 Flash (max), Terminus-2DeepSeek29k
GLM-5.3-Flash (max), Terminus-2Z.ai30k
GLM-5.2 (max), Terminus-2Z.ai30k
DeepSeek V4 Flash (high), Terminus-2DeepSeek31k
DeepSeek V4.1 Flash (max), CodexDeepSeek38k
gpt-oss-20b (high), Terminus-2OpenAI40k

Open weights

Output tokens per task

Average output tokens per agent task, reasoning included · Lower is better

Output tokens per taskOutput tokens per task: Llama 3.3 70B (Non-reasoning), Terminus-2: 2k; Mistral Large 3 (Non-reasoning), Terminus-2: 4k; Kimi K3 (Reasoning), Terminus-2: 6k; Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2: 6k; Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2: 7k; Nemotron 3 Ultra (high), Terminus-2: 10k; Step 5 Preview (Reasoning), Terminus-2: 10k; Kimi K2.7 Code (Reasoning), Kimi Code: 11k; gpt-oss-120b (high), Terminus-2: 15k; GLM-5.3 (max), Claude Code: 15k; MiniMax M3.1 Flash (max), Terminus-2: 19k; Gemma 4 26B A4B (Reasoning), Terminus-2: 21k; Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2: 22k; DeepSeek V4 Pro (max), Terminus-2: 24k; Qwen 3.8 27B (xhigh), Qwen Code: 28k; GLM-5.3-Flash (max), Claude Code: 29k; DeepSeek V4.1 Flash (max), Codex: 38k; gpt-oss-20b (high), Terminus-2: 40k010k20k30k40kLlama 3.3 70B (Non-reasoning)Terminus-22kMistral Large 3 (Non-reasoning)Terminus-24kKimi K3 (Reasoning)Terminus-26kNemotron 3.5 Lightning 30B (Reasoning)Terminus-26kNemotron 3.5 Super VL 120B (Reasoning)Terminus-27kNemotron 3 Ultra (high)Terminus-210kStep 5 Preview (Reasoning)Terminus-210kKimi K2.7 Code (Reasoning)Kimi Code11kgpt-oss-120b (high)Terminus-215kGLM-5.3 (max)Claude Code15kMiniMax M3.1 Flash (max)Terminus-219kGemma 4 26B A4B (Reasoning)Terminus-221kNemotron 3 Nano Omni 30B (Reasoning)Terminus-222kDeepSeek V4 Pro (max)Terminus-224kQwen 3.8 27B (xhigh)Qwen Code28kGLM-5.3-Flash (max)Claude Code29kDeepSeek V4.1 Flash (max)Codex38kgpt-oss-20b (high)Terminus-240k
How to read this chart

Output tokens per task. The average number of tokens the model wrote per attempt, its reasoning included, as reported by the provider.

Compare with care. Models use different tokenisers, so the same text is a different number of tokens for different models. Use token counts to see how much work each model did, and cost to compare spending.

Data table: Output tokens per task
Output tokens per task
ModelDeveloperOutput tokens per task
gpt-oss-120b (low), Terminus-2OpenAI2k
Llama 3.3 70B (Non-reasoning), Terminus-2Meta2k
Mistral Large 3 (Non-reasoning), Terminus-2Mistral AI4k
GLM-5.2 (Non-reasoning), Terminus-2Z.ai6k
Kimi K3 (Reasoning), Terminus-2Moonshot AI6k
Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2NVIDIA6k
Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2NVIDIA7k
Nemotron 3 Ultra (high), Terminus-2NVIDIA10k
GLM-5.3 (low), Terminus-2Z.ai10k
Step 5 Preview (Reasoning), Terminus-2StepFun10k
Kimi K2.7 Code (Reasoning), Kimi CodeMoonshot AI11k
Kimi K2.7 Code (Reasoning), Terminus-2Moonshot AI12k
Kimi K2.6 (Reasoning), Terminus-2Moonshot AI12k
GLM-4.7-Flash (Reasoning), Terminus-2Z.ai14k
GLM-4.7-Flash (Reasoning), Claude CodeZ.ai15k
gpt-oss-120b (high), Terminus-2OpenAI15k
GLM-5.3-Flash (low), Terminus-2Z.ai15k
GLM-5.3 (max), Claude CodeZ.ai15k
Kimi K2.6 (Reasoning), Kimi CodeMoonshot AI18k
DeepSeek V4 Flash (high), CodexDeepSeek19k
MiniMax M3.1 Flash (max), Terminus-2MiniMax19k
Qwen 3.8 27B (xhigh), Terminus-2Alibaba (Qwen)19k
GLM-5.3 (max), Terminus-2Z.ai19k
DeepSeek V4 Pro (high), Terminus-2DeepSeek20k
Gemma 4 26B A4B (Reasoning), Terminus-2Google21k
GLM-5.2 (high), Terminus-2Z.ai22k
Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2NVIDIA22k
gpt-oss-20b (high), CodexOpenAI23k
DeepSeek V4 Pro (max), Terminus-2DeepSeek24k
gpt-oss-120b (high), CodexOpenAI27k
GLM-5.2 (max), Claude CodeZ.ai28k
Qwen 3.8 27B (xhigh), Qwen CodeAlibaba (Qwen)28k
GLM-5.3-Flash (max), Claude CodeZ.ai29k
DeepSeek V4 Flash (max), Terminus-2DeepSeek29k
GLM-5.3-Flash (max), Terminus-2Z.ai30k
GLM-5.2 (max), Terminus-2Z.ai30k
DeepSeek V4 Flash (high), Terminus-2DeepSeek31k
DeepSeek V4.1 Flash (max), CodexDeepSeek38k
gpt-oss-20b (high), Terminus-2OpenAI40k

All

Turns per task

Average agent turns per task · Lower is better

Turns per taskTurns per task: gpt-oss-20b (high), Terminus-2: 5.2; Mistral Large 3 (Non-reasoning), Terminus-2: 5.2; gpt-oss-120b (high), Terminus-2: 5.8; Claude Sonnet 5.5 (xhigh), Claude Code: 6.6; Claude Opus 5.5 (xhigh), Claude Code: 6.9; Kimi K3 (Reasoning), Terminus-2: 7.2; GPT-6.1 Sol (xhigh), Codex: 7.4; Claude Haiku 5.5 (xhigh), Claude Code: 9.6; GPT-5.6 Terra (high), Codex: 9.6; Gemini 3.1 Flash-Lite (high), Terminus-2: 10.1; Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2: 10.1; Step 5 Preview (Reasoning), Terminus-2: 11.1; Nemotron 3 Ultra (high), Terminus-2: 12.1; MiniMax M3.1 Flash (max), Terminus-2: 13.3; GLM-5.3 (max), Claude Code: 13.4; GPT-5.6 Luna (xhigh), Codex: 13.9; Kimi K2.7 Code (Reasoning), Terminus-2: 14.2; Llama 3.3 70B (Non-reasoning), Terminus-2: 14.4; Gemma 4 26B A4B (Reasoning), Terminus-2: 14.6; DeepSeek V4 Pro (max), Terminus-2: 14.8; Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2: 17.3; Qwen 3.8 27B (xhigh), Qwen Code: 17.6; GLM-5.3-Flash (max), Claude Code: 18.9; Gemini 3.8 Flash (low), Terminus-2: 19.0; DeepSeek V4.1 Flash (max), Codex: 23.4; Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2: 30.7010203040gpt-oss-20b (high)Terminus-25.2Mistral Large 3 (Non-reasoning)Terminus-25.2gpt-oss-120b (high)Terminus-25.8Claude Sonnet 5.5 (xhigh)Claude Code6.6Claude Opus 5.5 (xhigh)Claude Code6.9Kimi K3 (Reasoning)Terminus-27.2GPT-6.1 Sol (xhigh)Codex7.4Claude Haiku 5.5 (xhigh)Claude Code9.6GPT-5.6 Terra (high)Codex9.6Gemini 3.1 Flash-Lite (high)Terminus-210.1Nemotron 3.5 Super VL 120B (Reasoning)Terminus-210.1Step 5 Preview (Reasoning)Terminus-211.1Nemotron 3 Ultra (high)Terminus-212.1MiniMax M3.1 Flash (max)Terminus-213.3GLM-5.3 (max)Claude Code13.4GPT-5.6 Luna (xhigh)Codex13.9Kimi K2.7 Code (Reasoning)Terminus-214.2Llama 3.3 70B (Non-reasoning)Terminus-214.4Gemma 4 26B A4B (Reasoning)Terminus-214.6DeepSeek V4 Pro (max)Terminus-214.8Nemotron 3.5 Lightning 30B (Reasoning)Terminus-217.3Qwen 3.8 27B (xhigh)Qwen Code17.6GLM-5.3-Flash (max)Claude Code18.9Gemini 3.8 Flash (low)Terminus-219.0DeepSeek V4.1 Flash (max)Codex23.4Nemotron 3 Nano Omni 30B (Reasoning)Terminus-230.7
How to read this chart

What this metric means. A turn is one model reply plus the commands it ran.

Data table: Turns per task
Turns per task
ModelDeveloperTurns per task
gpt-oss-120b (low), Terminus-2OpenAI2.9
Claude Opus 5.5 (low), Claude CodeAnthropic3.5
Claude Sonnet 5.5 (low), Claude CodeAnthropic3.9
Claude Sonnet 5.5 (medium), Claude CodeAnthropic4.2
Claude Opus 5.5 (medium), Claude CodeAnthropic4.8
Claude Sonnet 5.5 (high), Claude CodeAnthropic4.8
Gemini 3.1 Flash-Lite (minimal), Terminus-2Google4.9
gpt-oss-20b (high), Terminus-2OpenAI5.2
Mistral Large 3 (Non-reasoning), Terminus-2Mistral AI5.2
Claude Opus 5.5 (high), Claude CodeAnthropic5.3
Claude Haiku 5.5 (low), Claude CodeAnthropic5.5
GPT-6.1 Sol (medium), CodexOpenAI5.8
gpt-oss-120b (high), Terminus-2OpenAI5.8
Claude Opus 4.8 (high), Claude CodeAnthropic6.0
Claude Haiku 5.5 (medium), Claude CodeAnthropic6.1
GPT-6 Luna (medium), CodexOpenAI6.4
GPT-6.1 Sol (high), CodexOpenAI6.6
Claude Sonnet 5.5 (xhigh), Claude CodeAnthropic6.6
Claude Opus 5.5 (xhigh), Claude CodeAnthropic6.9
GPT-5.6 Luna (low), CodexOpenAI7.0
Claude Opus 4.7 (high), Claude CodeAnthropic7.0
Claude Haiku 5.5 (high), Claude CodeAnthropic7.1
Claude Opus 5 (high), Claude CodeAnthropic7.2
Kimi K3 (Reasoning), Terminus-2Moonshot AI7.2
GPT-6.1 Sol (xhigh), CodexOpenAI7.4
GPT-6 Luna (high), CodexOpenAI7.4
GPT-6 Luna (low), CodexOpenAI7.7
GPT-6 Sol (high), CodexOpenAI8.7
Gemini 3.1 Flash-Lite (low), Terminus-2Google8.8
GPT-6 Luna (xhigh), CodexOpenAI8.8
GPT-5.6 Luna (medium), CodexOpenAI9.4
Claude Sonnet 5 (high), Claude CodeAnthropic9.5
GPT-5.6 Sol (high), CodexOpenAI9.5
Claude Haiku 5.5 (xhigh), Claude CodeAnthropic9.6
GPT-5.6 Terra (high), CodexOpenAI9.6
Gemini 3.1 Flash-Lite (high), Terminus-2Google10.1
Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2NVIDIA10.1
GLM-5.3 (max), Terminus-2Z.ai10.4
GLM-5.3 (low), Terminus-2Z.ai10.4
Claude Haiku 4.5 (Reasoning), Claude CodeAnthropic10.6
Step 5 Preview (Reasoning), Terminus-2StepFun11.1
Nemotron 3 Ultra (high), Terminus-2NVIDIA12.1
GPT-5.6 Luna (high), CodexOpenAI12.3
GLM-5.2 (Non-reasoning), Terminus-2Z.ai12.8
Kimi K2.6 (Reasoning), Terminus-2Moonshot AI12.8
GLM-5.2 (high), Terminus-2Z.ai12.9
MiniMax M3.1 Flash (max), Terminus-2MiniMax13.3
GLM-5.3 (max), Claude CodeZ.ai13.4
GLM-5.2 (max), Terminus-2Z.ai13.6
DeepSeek V4 Pro (high), Terminus-2DeepSeek13.9
GPT-5.6 Luna (xhigh), CodexOpenAI13.9
GLM-5.3-Flash (low), Terminus-2Z.ai14.0
Kimi K2.7 Code (Reasoning), Terminus-2Moonshot AI14.2
Llama 3.3 70B (Non-reasoning), Terminus-2Meta14.4
DeepSeek V4 Flash (max), Terminus-2DeepSeek14.4
Gemma 4 26B A4B (Reasoning), Terminus-2Google14.6
DeepSeek V4 Pro (max), Terminus-2DeepSeek14.8
Qwen 3.8 27B (xhigh), Terminus-2Alibaba (Qwen)14.8
GLM-5.2 (max), Claude CodeZ.ai15.4
DeepSeek V4 Flash (high), Terminus-2DeepSeek15.6
GLM-5.3-Flash (max), Terminus-2Z.ai15.8
Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2NVIDIA17.3
Qwen 3.8 27B (xhigh), Qwen CodeAlibaba (Qwen)17.6
GLM-5.3-Flash (max), Claude CodeZ.ai18.9
Gemini 3.8 Flash (low), Terminus-2Google19.0
DeepSeek V4.1 Flash (max), CodexDeepSeek23.4
gpt-oss-20b (high), CodexOpenAI24.2
DeepSeek V4 Flash (high), CodexDeepSeek25.4
GLM-4.7-Flash (Reasoning), Terminus-2Z.ai26.4
gpt-oss-120b (high), CodexOpenAI29.8
Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2NVIDIA30.7
GLM-4.7-Flash (Reasoning), Claude CodeZ.ai37.8

Open weights

Turns per task

Average agent turns per task · Lower is better

Turns per taskTurns per task: gpt-oss-20b (high), Terminus-2: 5.2; Mistral Large 3 (Non-reasoning), Terminus-2: 5.2; gpt-oss-120b (high), Terminus-2: 5.8; Kimi K3 (Reasoning), Terminus-2: 7.2; Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2: 10.1; Step 5 Preview (Reasoning), Terminus-2: 11.1; Nemotron 3 Ultra (high), Terminus-2: 12.1; MiniMax M3.1 Flash (max), Terminus-2: 13.3; GLM-5.3 (max), Claude Code: 13.4; Kimi K2.7 Code (Reasoning), Terminus-2: 14.2; Llama 3.3 70B (Non-reasoning), Terminus-2: 14.4; Gemma 4 26B A4B (Reasoning), Terminus-2: 14.6; DeepSeek V4 Pro (max), Terminus-2: 14.8; Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2: 17.3; Qwen 3.8 27B (xhigh), Qwen Code: 17.6; GLM-5.3-Flash (max), Claude Code: 18.9; DeepSeek V4.1 Flash (max), Codex: 23.4; Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2: 30.7010203040gpt-oss-20b (high)Terminus-25.2Mistral Large 3 (Non-reasoning)Terminus-25.2gpt-oss-120b (high)Terminus-25.8Kimi K3 (Reasoning)Terminus-27.2Nemotron 3.5 Super VL 120B (Reasoning)Terminus-210.1Step 5 Preview (Reasoning)Terminus-211.1Nemotron 3 Ultra (high)Terminus-212.1MiniMax M3.1 Flash (max)Terminus-213.3GLM-5.3 (max)Claude Code13.4Kimi K2.7 Code (Reasoning)Terminus-214.2Llama 3.3 70B (Non-reasoning)Terminus-214.4Gemma 4 26B A4B (Reasoning)Terminus-214.6DeepSeek V4 Pro (max)Terminus-214.8Nemotron 3.5 Lightning 30B (Reasoning)Terminus-217.3Qwen 3.8 27B (xhigh)Qwen Code17.6GLM-5.3-Flash (max)Claude Code18.9DeepSeek V4.1 Flash (max)Codex23.4Nemotron 3 Nano Omni 30B (Reasoning)Terminus-230.7
How to read this chart

What this metric means. A turn is one model reply plus the commands it ran.

Data table: Turns per task
Turns per task
ModelDeveloperTurns per task
gpt-oss-120b (low), Terminus-2OpenAI2.9
gpt-oss-20b (high), Terminus-2OpenAI5.2
Mistral Large 3 (Non-reasoning), Terminus-2Mistral AI5.2
gpt-oss-120b (high), Terminus-2OpenAI5.8
Kimi K3 (Reasoning), Terminus-2Moonshot AI7.2
Nemotron 3.5 Super VL 120B (Reasoning), Terminus-2NVIDIA10.1
GLM-5.3 (max), Terminus-2Z.ai10.4
GLM-5.3 (low), Terminus-2Z.ai10.4
Step 5 Preview (Reasoning), Terminus-2StepFun11.1
Nemotron 3 Ultra (high), Terminus-2NVIDIA12.1
GLM-5.2 (Non-reasoning), Terminus-2Z.ai12.8
Kimi K2.6 (Reasoning), Terminus-2Moonshot AI12.8
GLM-5.2 (high), Terminus-2Z.ai12.9
MiniMax M3.1 Flash (max), Terminus-2MiniMax13.3
GLM-5.3 (max), Claude CodeZ.ai13.4
GLM-5.2 (max), Terminus-2Z.ai13.6
DeepSeek V4 Pro (high), Terminus-2DeepSeek13.9
GLM-5.3-Flash (low), Terminus-2Z.ai14.0
Kimi K2.7 Code (Reasoning), Terminus-2Moonshot AI14.2
Llama 3.3 70B (Non-reasoning), Terminus-2Meta14.4
DeepSeek V4 Flash (max), Terminus-2DeepSeek14.4
Gemma 4 26B A4B (Reasoning), Terminus-2Google14.6
DeepSeek V4 Pro (max), Terminus-2DeepSeek14.8
Qwen 3.8 27B (xhigh), Terminus-2Alibaba (Qwen)14.8
GLM-5.2 (max), Claude CodeZ.ai15.4
DeepSeek V4 Flash (high), Terminus-2DeepSeek15.6
GLM-5.3-Flash (max), Terminus-2Z.ai15.8
Nemotron 3.5 Lightning 30B (Reasoning), Terminus-2NVIDIA17.3
Qwen 3.8 27B (xhigh), Qwen CodeAlibaba (Qwen)17.6
GLM-5.3-Flash (max), Claude CodeZ.ai18.9
DeepSeek V4.1 Flash (max), CodexDeepSeek23.4
gpt-oss-20b (high), CodexOpenAI24.2
DeepSeek V4 Flash (high), CodexDeepSeek25.4
GLM-4.7-Flash (Reasoning), Terminus-2Z.ai26.4
gpt-oss-120b (high), CodexOpenAI29.8
Nemotron 3 Nano Omni 30B (Reasoning), Terminus-2NVIDIA30.7
GLM-4.7-Flash (Reasoning), Claude CodeZ.ai37.8