Axis Spatial Spatial Intelligence Index

Search modelsMenu

Place and coordinate tasks, closed book benchmark leaderboard

Geocoding, reverse geocoding, distance and direction, with no tools and no internet. A standalone evaluation: its scores are shown here and on model pages, but it is not counted in any index or ranking until more models have run it.

Place and coordinate tasks, closed book score

Share of questions answered correctly, 0 to 100 · Higher is better

Place and coordinate tasks, closed book scoreScores 0 to 100: Claude Opus 5.5 (high): 92; Claude Sonnet 5.5 (high): 85; DeepSeek V4 Flash (max): 72; Claude Haiku 5.5 (high): 69; Nemotron 3 Ultra (high): 67; Step 5 Preview (Reasoning): 60; GLM-5.3-Flash (low): 55; GLM-5.3 (low): 54; Muse Glimmer 30B (high): 52; Nemotron 3.5 Lightning 30B (Reasoning): 45; Mistral Large 4 (high): 42; Nemotron 3.5 Super VL 120B (Reasoning): 42; Qwen 3.6 35B-A3B (Reasoning): 42; MiMo V2.6 Flash (Reasoning): 38; MiniMax M3 (Reasoning): 33; MiniMax M3.1 Flash (max): 28; Laguna XS 2.1 (Reasoning): 22; Qwen 3.8 27B (xhigh): 21; Ministral 3 14B (Non-reasoning): 10; Nemotron 3 Nano Omni 30B (Reasoning): 10; Nemotron 3.5 Bolt E4B (Reasoning): 80255075100Claude Opus 5.5 (high)92Claude Sonnet 5.5 (high)85DeepSeek V4 Flash (max)72Claude Haiku 5.5 (high)69Nemotron 3 Ultra (high)67Step 5 Preview (Reasoning)60GLM-5.3-Flash (low)55GLM-5.3 (low)54Muse Glimmer 30B (high)52Nemotron 3.5 Lightning 30B (Reasoning)45Mistral Large 4 (high)42Nemotron 3.5 Super VL 120B (Reasoning)42Qwen 3.6 35B-A3B (Reasoning)42MiMo V2.6 Flash (Reasoning)38MiniMax M3 (Reasoning)33MiniMax M3.1 Flash (max)28Laguna XS 2.1 (Reasoning)22Qwen 3.8 27B (xhigh)21Ministral 3 14B (Non-reasoning)10Nemotron 3 Nano Omni 30B (Reasoning)10Nemotron 3.5 Bolt E4B (Reasoning)8
How to read this chart

Rows. Each model family once, at its best model and reasoning level, with at least 75% of the questions scored; the table lists every model and level, with how many questions each has scored.

Data table: Place and coordinate tasks, closed book score
Place and coordinate tasks, closed book score (share of questions answered correctly, 0 to 100)
ModelScoreQuestions scoredCost per questionTime per question (at 100 output tokens/s)
Claude Opus 5.5 (high)92144 of 144$0.02615s
Claude Sonnet 5.5 (high)85144 of 144$0.01527s
DeepSeek V4 Flash (max)72144 of 144$0.016139s
DeepSeek V4 Flash (high)71144 of 144$0.015116s
Claude Haiku 5.5 (high)69144 of 144$0.002221s
Nemotron 3 Ultra (high)67144 of 144$0.038496s
DeepSeek V4.1 Flash (max)60144 of 144$0.017136s
Step 5 Preview (Reasoning)60144 of 144$0.084692s
GLM-5.3-Flash (low)55144 of 144$0.001642s
GLM-5.3 (low)54144 of 144$0.009217s
Muse Glimmer 30B (high)52144 of 144$0.018543s
Nemotron 3.5 Lightning 30B (Reasoning)45144 of 144$0.0023144s
Mistral Large 4 (high)42138 of 144$0.0621933s
Nemotron 3.5 Super VL 120B (Reasoning)42140 of 144$0.017322s
Qwen 3.6 35B-A3B (Reasoning)42144 of 144$0.009683s
MiMo V2.6 Flash (Reasoning)38144 of 144$0.0044142s
GLM-5.3-Flash (max)34144 of 144$0.019282s
MiniMax M3 (Reasoning)33144 of 144$0.027130s
GLM-5.3 (max)29144 of 144$0.13192s
MiniMax M3.1 Flash (max)28144 of 144$0.0171580s
Laguna XS 2.1 (Reasoning)22144 of 144$0.0020138s
Qwen 3.8 27B (xhigh)21144 of 144$0.122177s
Ministral 3 14B (Non-reasoning)10144 of 144No data26s
Nemotron 3 Nano Omni 30B (Reasoning)10144 of 144No data203s
Nemotron 3.5 Bolt E4B (Reasoning)8144 of 144No data132s

About this evaluation

48 items built by Axis Spatial on GeoNames and Natural Earth places: find a place's coordinates, name the place at a point, give a distance or a bearing. The model answers in one call with no tools and no internet.

The score is the share of items whose answer is within the task's checked threshold.

Published by Axis Spatial. Licence: GeoNames CC BY 4.0, Natural Earth public domain.

Related links