Axis Spatial

Vision

How well AI models answer geospatial (GIS and Earth observation) questions by looking at satellite and aerial images: a group of the Geospatial Intelligence Index, weighted 2/9, about 22.2%.

Ongoing evaluation: results update as runs complete. Last updated 14 October 2026.

Scores and cost

Vision score

Questions answered from images, look and answer, 0 to 100 · Higher is better

Vision scoreClaude Opus 5.5 (xhigh): 59; Claude Sonnet 5.5 (xhigh): 57; GPT-6.1 Sol (xhigh): 56; Claude Opus 5 (high): 53; Claude Haiku 5.5 (xhigh): 52; GPT-6 Luna (xhigh): 50; Claude Opus 4.8 (high): 50; Kimi K3 (always on): 48; Claude Opus 4.7 (high): 47; Claude Sonnet 5 (high): 47; Kimi K2.6 (always on): 44; GLM-5.3-Flash (max): 44; Kimi K2.7 Code (always on): 44; Gemma 4 26B A4B (thinking on): 43; Claude Haiku 4.5 (thinking 32k): 34; Mistral Small 3.1 24B (Non-reasoning): 330255075100Claude Opus 5.5 (xhigh)59Claude Sonnet 5.5 (xhigh)57GPT-6.1 Sol (xhigh)56Claude Opus 5 (high)53Claude Haiku 5.5 (xhigh)52GPT-6 Luna (xhigh)50Claude Opus 4.8 (high)50Kimi K3 (always on)48Claude Opus 4.7 (high)47Claude Sonnet 5 (high)47Kimi K2.6 (always on)44GLM-5.3-Flash (max)44Kimi K2.7 Code (always on)44Gemma 4 26B A4B (thinking on)43Claude Haiku 4.5 (thinking 32k)34Mistral Small 3.1 24B (Non-reasoning)33
How to read this chart

Rows. Each model once, at its highest reasoning level with a vision score; every level is in the table below the charts. A model that cannot take images scores 0 in the index, labelled, and is listed in that table, not drawn here.

What this metric means. The plain average of the two source scores: the share of questions answered correctly from each source, with no tools and no code.

Data table: Vision score
Vision score
ModelVision scoreEarth-Bench V2 images scoreThinkGeo score
Claude Opus 5.5 (xhigh)58.87048
Claude Sonnet 5.5 (xhigh)57.26847
GPT-6.1 Sol (xhigh)56.47241
Claude Opus 5 (high)53.26838
Claude Haiku 5.5 (xhigh)52.47035
GPT-6 Luna (xhigh)50.46635
Claude Opus 4.8 (high)49.96634
Kimi K3 (always on)48.16630
Claude Opus 4.7 (high)47.46827
Claude Sonnet 5 (high)47.06628
Kimi K2.6 (always on)44.06028
GLM-5.3-Flash (max)43.85335
Kimi K2.7 Code (always on)43.75631
Gemma 4 26B A4B (thinking on)43.26422
Claude Haiku 4.5 (thinking 32k)34.35019
Mistral Small 3.1 24B (Non-reasoning)32.85412

Earth-Bench V2 images: vision score

Share answered correctly, 0 to 100 · Higher is better

Earth-Bench V2 images: vision scoreClaude Opus 5.5 (xhigh): 70; Claude Sonnet 5.5 (xhigh): 68; GPT-6.1 Sol (xhigh): 72; Claude Opus 5 (high): 68; Claude Haiku 5.5 (xhigh): 70; GPT-6 Luna (xhigh): 66; Claude Opus 4.8 (high): 66; Kimi K3 (always on): 66; Claude Opus 4.7 (high): 68; Claude Sonnet 5 (high): 66; Kimi K2.6 (always on): 60; GLM-5.3-Flash (max): 53; Kimi K2.7 Code (always on): 56; Gemma 4 26B A4B (thinking on): 64; Claude Haiku 4.5 (thinking 32k): 50; Mistral Small 3.1 24B (Non-reasoning): 540255075100Claude Opus 5.5 (xhigh)70Claude Sonnet 5.5 (xhigh)68GPT-6.1 Sol (xhigh)72Claude Opus 5 (high)68Claude Haiku 5.5 (xhigh)70GPT-6 Luna (xhigh)66Claude Opus 4.8 (high)66Kimi K3 (always on)66Claude Opus 4.7 (high)68Claude Sonnet 5 (high)66Kimi K2.6 (always on)60GLM-5.3-Flash (max)53Kimi K2.7 Code (always on)56Gemma 4 26B A4B (thinking on)64Claude Haiku 4.5 (thinking 32k)50Mistral Small 3.1 24B (Non-reasoning)54
How to read this chart

Sources. Earth-Bench V2 images: 50 questions; ThinkGeo: 86 questions. Same scale and order in both charts, so a model's two bars compare directly.

Data table: Earth-Bench V2 images: vision score
Earth-Bench V2 images: vision score
ModelEarth-Bench V2 images score
Claude Opus 5.5 (xhigh)70
Claude Sonnet 5.5 (xhigh)68
GPT-6.1 Sol (xhigh)72
Claude Opus 5 (high)68
Claude Haiku 5.5 (xhigh)70
GPT-6 Luna (xhigh)66
Claude Opus 4.8 (high)66
Kimi K3 (always on)66
Claude Opus 4.7 (high)68
Claude Sonnet 5 (high)66
Kimi K2.6 (always on)60
GLM-5.3-Flash (max)53
Kimi K2.7 Code (always on)56
Gemma 4 26B A4B (thinking on)64
Claude Haiku 4.5 (thinking 32k)50
Mistral Small 3.1 24B (Non-reasoning)54

ThinkGeo: vision score

Share answered correctly, 0 to 100 · Higher is better

ThinkGeo: vision scoreClaude Opus 5.5 (xhigh): 48; Claude Sonnet 5.5 (xhigh): 47; GPT-6.1 Sol (xhigh): 41; Claude Opus 5 (high): 38; Claude Haiku 5.5 (xhigh): 35; GPT-6 Luna (xhigh): 35; Claude Opus 4.8 (high): 34; Kimi K3 (always on): 30; Claude Opus 4.7 (high): 27; Claude Sonnet 5 (high): 28; Kimi K2.6 (always on): 28; GLM-5.3-Flash (max): 35; Kimi K2.7 Code (always on): 31; Gemma 4 26B A4B (thinking on): 22; Claude Haiku 4.5 (thinking 32k): 19; Mistral Small 3.1 24B (Non-reasoning): 120255075100Claude Opus 5.5 (xhigh)48Claude Sonnet 5.5 (xhigh)47GPT-6.1 Sol (xhigh)41Claude Opus 5 (high)38Claude Haiku 5.5 (xhigh)35GPT-6 Luna (xhigh)35Claude Opus 4.8 (high)34Kimi K3 (always on)30Claude Opus 4.7 (high)27Claude Sonnet 5 (high)28Kimi K2.6 (always on)28GLM-5.3-Flash (max)35Kimi K2.7 Code (always on)31Gemma 4 26B A4B (thinking on)22Claude Haiku 4.5 (thinking 32k)19Mistral Small 3.1 24B (Non-reasoning)12
How to read this chart

Sources. Earth-Bench V2 images: 50 questions; ThinkGeo: 86 questions. Same scale and order in both charts, so a model's two bars compare directly.

Data table: ThinkGeo: vision score
ThinkGeo: vision score
ModelThinkGeo score
Claude Opus 5.5 (xhigh)48
Claude Sonnet 5.5 (xhigh)47
GPT-6.1 Sol (xhigh)41
Claude Opus 5 (high)38
Claude Haiku 5.5 (xhigh)35
GPT-6 Luna (xhigh)35
Claude Opus 4.8 (high)34
Kimi K3 (always on)30
Claude Opus 4.7 (high)27
Claude Sonnet 5 (high)28
Kimi K2.6 (always on)28
GLM-5.3-Flash (max)35
Kimi K2.7 Code (always on)31
Gemma 4 26B A4B (thinking on)22
Claude Haiku 4.5 (thinking 32k)19
Mistral Small 3.1 24B (Non-reasoning)12

Vision score vs. cost per question

Vision score; cost per question (USD) · Higher and further left is better

  • Most attractive quadrant
  • Pareto line

No model has both a vision score and an exact cost per question yet.

How to read this chart

How to read this chart. Each point is one model at its highest reasoning level. Further left means a lower average cost per question (log scale); higher means a higher vision score. Both axes fit the points shown, so the score axis does not start at zero. The shaded most attractive quadrant is the top-left quarter of the plot, split at the middle of each axis: a reading aid, not a fixed bar. The dotted Pareto line joins the points that no cheaper one beats on score. Only exact costs are plotted; the table lists every entry.

Cost per question. What one question costs at the provider's published API prices: one model call with the question's images, averaged over the questions in the score. A model with any question whose cost was not recorded is not plotted.

Data table: Vision score vs. cost per question
Vision score vs. cost per question
ModelVision scoreCost per questionOn the Pareto line
Claude Opus 5.5 (xhigh)58.8No dataNot plotted
Claude Sonnet 5.5 (xhigh)57.2No dataNot plotted
GPT-6.1 Sol (xhigh)56.4No dataNot plotted
Claude Opus 5 (high)53.2No dataNot plotted
Claude Haiku 5.5 (xhigh)52.4No dataNot plotted
GPT-6 Luna (xhigh)50.4No dataNot plotted
Claude Opus 4.8 (high)49.9No dataNot plotted
Kimi K3 (always on)48.1No dataNot plotted
Claude Opus 4.7 (high)47.4No dataNot plotted
Claude Sonnet 5 (high)47.0No dataNot plotted
Kimi K2.6 (always on)44.0No dataNot plotted
GLM-5.3-Flash (max)43.8No dataNot plotted
Kimi K2.7 Code (always on)43.7No dataNot plotted
Gemma 4 26B A4B (thinking on)43.2No dataNot plotted
Claude Haiku 4.5 (thinking 32k)34.3No dataNot plotted
Mistral Small 3.1 24B (Non-reasoning)32.8No dataNot plotted

Vision includes: 136 questions answered from satellite and aerial images, 50 from Earth-Bench V2 images, 86 from ThinkGeo, one model call per question, from the image alone. See the methodology for how we run each evaluation.

All results

Vision: look and answer, score by source (0 to 100)
ModelVision scoreStatusEarth-Bench V2 images (50 questions)ThinkGeo (86 questions)Questions scoredNot supported by the routeNot scored (provider error)RunsImage input
Claude Opus 5.5 (high)59Scored7444136 of 136001Developer documentation
Claude Sonnet 5.5 (high)59Scored6850136 of 136001Developer documentation
Claude Opus 5.5 (xhigh)59Scored7048136 of 136001Developer documentation
Claude Sonnet 5.5 (xhigh)57Scored6847136 of 136001Developer documentation
Claude Opus 5.5 (medium)57Scored7044136 of 136001Developer documentation
GPT-6.1 Sol (xhigh)56Scored7241136 of 136001Developer documentation
Claude Sonnet 5.5 (medium)56Scored6843136 of 136001Developer documentation
GPT-6.1 Sol (medium)55Scored7237136 of 136001Developer documentation
Claude Opus 5 (high)53Scored6838136 of 136001Developer documentation
GPT-6.1 Sol (high)53Scored6837136 of 136001Developer documentation
Claude Haiku 5.5 (xhigh)52Scored7035136 of 136001Developer documentation
GPT-6 Luna (xhigh)50Scored6635136 of 136001Developer documentation
Claude Opus 4.8 (high)50Scored6634136 of 136001Developer documentation
Kimi K3 (always on)48Scored6630136 of 136001Developer documentation
Claude Haiku 5.5 (high)47Scored6035136 of 136001Developer documentation
Claude Opus 4.7 (high)47Scored6827136 of 136001Developer documentation
Claude Sonnet 5 (high)47Scored6628136 of 136001Developer documentation
Claude Haiku 5.5 (medium)45Scored5635136 of 136001Developer documentation
Kimi K2.6 (always on)44Scored6028136 of 136001Developer documentation
GLM-5.3-Flash (max)44Scored5335122 of 1361401Developer documentation
Kimi K2.7 Code (always on)44Scored5631136 of 136001Developer documentation
Gemma 4 26B A4B (thinking on)43Scored6422135 of 136011Developer documentation
Claude Haiku 4.5 (thinking 32k)34Scored5019136 of 136001Developer documentation
Mistral Small 3.1 24B (Non-reasoning)33Scored5412136 of 136001Developer documentation
Qwen 3.8 27B (xhigh)53*In progress6937128 of 136081Developer documentation
GLM-5.3-Flash (low)46*In progress5636122 of 136681Developer documentation
DeepSeek V4 Flash (high)0 (cannot take images)Cannot take imagesNo dataNo dataNo dataNo dataNo data0Developer documentation
DeepSeek V4 Flash (max)0 (cannot take images)Cannot take imagesNo dataNo dataNo dataNo dataNo data0Developer documentation
DeepSeek V4 Pro (high)0 (cannot take images)Cannot take imagesNo dataNo dataNo dataNo dataNo data0Developer documentation
DeepSeek V4 Pro (max)0 (cannot take images)Cannot take imagesNo dataNo dataNo dataNo dataNo data0Developer documentation
GLM-4.7-Flash (thinking on)0 (cannot take images)Cannot take imagesNo dataNo dataNo dataNo dataNo data0Developer documentation
GLM-5.2 (high)0 (cannot take images)Cannot take imagesNo dataNo dataNo dataNo dataNo data0Developer documentation
GLM-5.2 (max)0 (cannot take images)Cannot take imagesNo dataNo dataNo dataNo dataNo data0Developer documentation
GLM-5.2 (none)0 (cannot take images)Cannot take imagesNo dataNo dataNo dataNo dataNo data0Developer documentation
GLM-5.3 (low)0 (cannot take images)Cannot take imagesNo dataNo dataNo dataNo dataNo data0Developer documentation
GLM-5.3 (max, default)0 (cannot take images)Cannot take imagesNo dataNo dataNo dataNo dataNo data0Developer documentation
Llama 3.3 70B (Non-reasoning)0 (cannot take images)Cannot take imagesNo dataNo dataNo dataNo dataNo data0Developer documentation
gpt-oss-120b (high)0 (cannot take images)Cannot take imagesNo dataNo dataNo dataNo dataNo data0Developer documentation
gpt-oss-120b (low)0 (cannot take images)Cannot take imagesNo dataNo dataNo dataNo dataNo data0Developer documentation
gpt-oss-20b (high)0 (cannot take images)Cannot take imagesNo dataNo dataNo dataNo dataNo data0Developer documentation
Claude Sonnet 4.6 (adaptive, effort high)No dataNot run yetNo dataNo dataNo dataNo dataNo data0Developer documentation
Gemini 3.1 Flash-Lite (high)No dataNot run yetNo dataNo dataNo dataNo dataNo data0Developer documentation
Gemini 3.1 Flash-Lite (low)No dataNot run yetNo dataNo dataNo dataNo dataNo data0Developer documentation
Gemini 3.1 Flash-Lite (minimal)No dataNot run yetNo dataNo dataNo dataNo dataNo data0Developer documentation
Gemini 3.1 Pro (preview) (high)No dataNot run yetNo dataNo dataNo dataNo dataNo data0Developer documentation
Gemini 3.1 Pro (preview) (low)No dataNot run yetNo dataNo dataNo dataNo dataNo data0Developer documentation
Gemini 3.8 Flash (high)No dataNot run yetNo dataNo dataNo dataNo dataNo data0Developer documentation
Gemini 3.8 Flash (low)No dataNot run yetNo dataNo dataNo dataNo dataNo data0Developer documentation

Sources: Earth-Bench V2 (annotations CC BY-NC 4.0) and ThinkGeo (CC BY 4.0); this non-commercial site publishes scores only, never questions or images. Licences in the methodology.

The same questions with an agent that may run code, and harder agent tasks, are on Vision agents.