Axis Spatial

Llama 3.3 70B (Non-reasoning), Terminus-2 vs. MiniMax M3.1 Flash (max), Terminus-2

Llama 3.3 70B (Non-reasoning), Terminus-2 against MiniMax M3.1 Flash (max), Terminus-2: Geospatial Agent Index, each evaluation, cost, time and tokens, on the same tasks and limits. Methodology.

Side by side

Llama 3.3 70B (Non-reasoning), Terminus-2 vs. MiniMax M3.1 Flash (max), Terminus-2
MetricLlama 3.3 70B (Non-reasoning), Terminus-2MiniMax M3.1 Flash (max), Terminus-2
Geospatial Agent Index: Text only851
Geospatial Agent Index: Text + visionNo image inputNo data
Earth-Bench V2 score939
GeoBenchX score642
GS-QA2 score1071
Vision agents scoreNo image inputNo data
GeoAgentBench score (Guided workflows; not in the Agent Index)888
GeoAnalystBench score (Guided workflows; not in the Agent Index)047
OGD4All score (standalone; in no index)No dataNo data
GeoNatureAgent score (standalone; in no index)No dataNo data
MultiGlobeQA score (standalone; in no index)No dataNo data
GeoAgentEval score (standalone; in no index)No dataNo data
Remote sensing and raster analysis score757
GIS analysis score1277
Climate and time series score1034
Spatial statistics score025
Making maps score257
Recognising infeasible requests score1330
Cost per task$0.023$0.017
Time per task (at 100 output tokens/s)2.1 min8.4 min
Tokens per attempt62k254k
Turns per attempt14.413.2
Input price per 1M tokens$0.29$0.15
Output price per 1M tokens$2.25$0.60
Context window24,0001,000,000
Image inputNoYes
DeveloperMetaOther

Charts

Geospatial Agent Index

Equal average of Earth-Bench V2, GeoBenchX and GS-QA2, 0 to 100 · Higher is better

Geospatial Agent IndexScores 0 to 100: MiniMax M3.1 Flash (max), Terminus-2: 51; Llama 3.3 70B (Non-reasoning), Terminus-2: 8025507510051MiniMax M3.1 Flash (max)8Llama 3.3 70B (Non-reasoning)
Data table: Geospatial Agent Index
Geospatial Agent Index
ModelDeveloperGeospatial Agent Index
MiniMax M3.1 Flash (max), Terminus-2Other51
Llama 3.3 70B (Non-reasoning), Terminus-2Meta8

Cost per task

Average cost per task (USD) · Lower is better

Cost per taskCost per task in US dollars: MiniMax M3.1 Flash (max), Terminus-2: $0.017; Llama 3.3 70B (Non-reasoning), Terminus-2: $0.023$0$0.01$0.02$0.03$0.04$0.017MiniMax M3.1 Flash (max)$0.023Llama 3.3 70B (Non-reasoning)
Data table: Cost per task
Cost per task
ModelDeveloperCost per task
MiniMax M3.1 Flash (max), Terminus-2Other$0.017
Llama 3.3 70B (Non-reasoning), Terminus-2Meta$0.023

Output tokens per task

Average output tokens per attempt, reasoning included · Lower is better

Output tokens per taskOutput tokens per task: Llama 3.3 70B (Non-reasoning), Terminus-2: 2k; MiniMax M3.1 Flash (max), Terminus-2: 18k05k10k15k20k2kLlama 3.3 70B (Non-reasoning)18kMiniMax M3.1 Flash (max)
Data table: Output tokens per task
Output tokens per task
ModelDeveloperOutput tokens per task
Llama 3.3 70B (Non-reasoning), Terminus-2Meta2k
MiniMax M3.1 Flash (max), Terminus-2Other18k

Frequently asked questions

Which scores higher on the Geospatial Agent Index, Llama 3.3 70B (Non-reasoning), Terminus-2 or MiniMax M3.1 Flash (max), Terminus-2?
MiniMax M3.1 Flash (max), Terminus-2, 51 to 8.
Which is cheaper per task, Llama 3.3 70B (Non-reasoning), Terminus-2 or MiniMax M3.1 Flash (max), Terminus-2?
MiniMax M3.1 Flash (max), Terminus-2, $0.017 to $0.023.
Which writes fewer output tokens per task, Llama 3.3 70B (Non-reasoning), Terminus-2 or MiniMax M3.1 Flash (max), Terminus-2?
Llama 3.3 70B (Non-reasoning), Terminus-2, 2k to 18k.
Which has the larger context window, Llama 3.3 70B (Non-reasoning), Terminus-2 or MiniMax M3.1 Flash (max), Terminus-2?
MiniMax M3.1 Flash (max), Terminus-2, 1,000,000 tokens to 24,000 tokens.

More: Llama 3.3 70B (Non-reasoning), Terminus-2 · MiniMax M3.1 Flash (max), Terminus-2 · All comparisons