Axis Spatial

Llama 3.3 70B (Non-reasoning), Terminus-2 vs. Claude Opus 5.5 (low), Claude Code

Llama 3.3 70B (Non-reasoning), Terminus-2 against Claude Opus 5.5 (low), Claude Code: Geospatial Agent Index, each evaluation, cost, time and tokens, on the same tasks and limits. The harnesses differ, so part of any gap can come from the harness. Methodology.

Side by side

Llama 3.3 70B (Non-reasoning), Terminus-2 vs. Claude Opus 5.5 (low), Claude Code
MetricLlama 3.3 70B (Non-reasoning), Terminus-2Claude Opus 5.5 (low), Claude Code
Geospatial Agent Index: Text only874
Geospatial Agent Index: Text + visionNo image input78
Earth-Bench V2 score959
GeoBenchX score677
GS-QA2 score1086
Vision agents scoreNo image input89
GeoAgentBench score (Guided workflows; not in the Agent Index)896
GeoAnalystBench score (Guided workflows; not in the Agent Index)0100
OGD4All score (standalone; in no index)No data95
GeoNatureAgent score (standalone; in no index)No data100
MultiGlobeQA score (standalone; in no index)No data79
GeoAgentEval score (standalone; in no index)No data100
Remote sensing and raster analysis score779
GIS analysis score1284
Climate and time series score1059
Spatial statistics score077
Making maps score277
Recognising infeasible requests score1377
Cost per task$0.023$0.081
Time per task (at 100 output tokens/s)2.1 min0.4 min
Tokens per attempt62k63k
Turns per attempt14.43.5
Input price per 1M tokens$0.29$4.00
Output price per 1M tokens$2.25$20.00
Context window24,0001,000,000
Image inputNoYes
DeveloperMetaAnthropic

Charts

Geospatial Agent Index

Equal average of Earth-Bench V2, GeoBenchX and GS-QA2, 0 to 100 · Higher is better

Geospatial Agent IndexScores 0 to 100: Claude Opus 5.5 (low), Claude Code: 74; Llama 3.3 70B (Non-reasoning), Terminus-2: 8025507510074Claude Opus 5.5 (low)8Llama 3.3 70B (Non-reasoning)
Data table: Geospatial Agent Index
Geospatial Agent Index
ModelDeveloperGeospatial Agent Index
Claude Opus 5.5 (low), Claude CodeAnthropic74
Llama 3.3 70B (Non-reasoning), Terminus-2Meta8

Cost per task

Average cost per task (USD) · Lower is better

Cost per taskCost per task in US dollars: Llama 3.3 70B (Non-reasoning), Terminus-2: $0.023; Claude Opus 5.5 (low), Claude Code: $0.081$0$0.025$0.05$0.075$0.10$0.023Llama 3.3 70B (Non-reasoning)$0.081Claude Opus 5.5 (low)
Data table: Cost per task
Cost per task
ModelDeveloperCost per task
Llama 3.3 70B (Non-reasoning), Terminus-2Meta$0.023
Claude Opus 5.5 (low), Claude CodeAnthropic$0.081

Output tokens per task

Average output tokens per attempt, reasoning included · Lower is better

Output tokens per taskOutput tokens per task: Claude Opus 5.5 (low), Claude Code: 1k; Llama 3.3 70B (Non-reasoning), Terminus-2: 2k01k2k3k4k1kClaude Opus 5.5 (low)2kLlama 3.3 70B (Non-reasoning)
Data table: Output tokens per task
Output tokens per task
ModelDeveloperOutput tokens per task
Claude Opus 5.5 (low), Claude CodeAnthropic1k
Llama 3.3 70B (Non-reasoning), Terminus-2Meta2k

Frequently asked questions

Which scores higher on the Geospatial Agent Index, Llama 3.3 70B (Non-reasoning), Terminus-2 or Claude Opus 5.5 (low), Claude Code?
Claude Opus 5.5 (low), Claude Code, 74 to 8.
Which is cheaper per task, Llama 3.3 70B (Non-reasoning), Terminus-2 or Claude Opus 5.5 (low), Claude Code?
Llama 3.3 70B (Non-reasoning), Terminus-2, $0.023 to $0.081.
Which writes fewer output tokens per task, Llama 3.3 70B (Non-reasoning), Terminus-2 or Claude Opus 5.5 (low), Claude Code?
Claude Opus 5.5 (low), Claude Code, 1k to 2k.
Which has the larger context window, Llama 3.3 70B (Non-reasoning), Terminus-2 or Claude Opus 5.5 (low), Claude Code?
Claude Opus 5.5 (low), Claude Code, 1,000,000 tokens to 24,000 tokens.

More: Llama 3.3 70B (Non-reasoning), Terminus-2 · Claude Opus 5.5 (low), Claude Code · All comparisons