A good score shows
Tool-augmented remote sensing benchmark with step-level and final correctness scoring.
Geospatial agent benchmark · none
ThinkGeo
Also known as: ThinkGeo
Evaluates: models with tool access
Tool-augmented remote sensing benchmark with step-level and final correctness scoring.
At a glance
pending verificationTasks
UnclearAgents run real code
NoData + code public
YesChecked by recomputation
—Data licence
Sources
every claim on this page traces to these records- Source paper: not published, or not yet verified — we do not guess URLs
- Source data: not published, or not yet verified — we do not guess URLs
- Source code: not published, or not yet verified — we do not guess URLs
- Leaderboard: not published, or not yet verified — we do not guess URLs
In shortWhether agents run real code here is not confirmed from public sources, and answers are checked by recomputation, not by another model's opinion. The underlying data and code are not published at a verified link. Source custody, artifact lineage, or production acceptance states. Benchmark scoring, not a production-readiness contract.
Evidence boundaries
what a score on this benchmark does and does not tell youA good score does not show
Source custody, artifact lineage, or production acceptance states. Benchmark scoring, not a production-readiness contract.
Arena status
none — Not downloaded. Identified in Axis geospatial verification gap research as a tool-augmented RS benchmark with step and final correctness. Deeper fields pending verification pending source review.
All recorded facts (22 fields)
- Evaluates
- model+tools
- Task families
- tool-augmented remote sensing
- Task count
- pending verification
- Difficulty
- pending verification
- Geography
- pending verification
- Modality
- mixed
- Input types
- remote-sensing data,tool calls
- Output types
- pending verification
- Execution environment
- pending verification
- Ground truth method
- pending verification
- Verifier method
- step correctness and final correctness
- Deterministic verification
- yes
- Scoring dimensions
- step correctness,final correctness
- Aggregation formula
- pending verification
- Trials policy
- pending verification
- Variance reporting
- pending verification
- Data licence
- pending verification
- Code licence
- pending verification
- Contamination concerns
- pending verification
- Reproducibility status
- pending verification
- First published
- 2025
- Latest known update
- pending verification
Machine-readable record
This entry is available as JSON at /api/registry#thinkgeo. See the registry endpoint.