Axis Spatial

Where the tasks are

The footprint of every task in the Geospatial Agent Index and the guided workflows, coloured by evaluation, to show where the benchmark looks and where it does not. 536 of 621 tasks have a location: 495 at a place and 41 worldwide; 85 have none.

Task footprints

495 tasks at a place, drawn as points and boxes

  • Earth-Bench V2
  • GeoBenchX
  • GS-QA2
  • Guided workflows
  • Point: one place; box: an area, darker where more tasks share it
Where the tasks are: the footprint of every task with a placeWorld map. Earth-Bench V2: 114 of 117 tasks at a place; GeoBenchX: 95 of 150 tasks at a place; GS-QA2: 221 of 221 tasks at a place; Guided workflows: 65 of 69 tasks at a place; Vision agents: 0 of 64 tasks at a place. Points are places smaller than 1.5 degrees across; boxes are larger areas. The 41 worldwide tasks and the 85 tasks with no location are not drawn. Antarctica is not shown.

536 tasks located (495 at a place, 41 worldwide); 85 tasks with no location. Base map: Natural Earth 1:110m land (public domain).

Tasks by evaluation and location
EvaluationTasksAt a placeWorldwideNo location
Earth-Bench V211711403
GeoBenchX150953916
GS-QA222122100
Guided workflows696522
Vision agents640064
All evaluations6214954185
How the footprints are found

Where a footprint comes from. Earth-Bench V2 and guided workflows: the extent of the task's own input data, or the place the task names when its data carry no coordinates. GS-QA2: the place the question names (never its answer). GeoBenchX: the country or region the task names, as the box around those countries' main land areas.

Two places. A task whose data lie in two distant places, such as two cities compared, has a footprint at each.

Tasks with no location

Worldwide tasks

Tasks over every country, or over a group of countries spread across the world, are counted as worldwide and not drawn.