Codex – gpt-oss-20b (high) vs. Codex – GPT-6.1 Sol (medium): geospatial agent comparison

Comparison between Codex – gpt-oss-20b (high) and Codex – GPT-6.1 Sol (medium) on the Geospatial Agent Index, each benchmark, cost, time and token use, from the same tasks, agent and limits. Methodology.

Side by side

Codex – gpt-oss-20b (high) vs. Codex – GPT-6.1 Sol (medium)
Metric	Codex – gpt-oss-20b (high)	Codex – GPT-6.1 Sol (medium)
Geospatial Agent Index	4* (partial: attempt 1 on 173 of 565 tasks)	72*
Earth-Bench V2 score	0	61
GeoBenchX score	8	69
GS-QA2 score	No data	85
GeoAgentBench score (guided GIS workflow; outside the index)	No data	100
GeoAnalystBench score (guided GIS workflow; outside the index)	No data	100
Raster and remote sensing score	0	74
Vector and overlay score	25	82
Networks and routing score	No data	No data
Climate and time series score	0	68
Spatial statistics and interpolation score	0	29
Mapping and cartography score	4	78
Recognising infeasible requests score	12	70
Cost per task	$0.140	$0.049
Time per task	8.0 min	1.2 min
Tokens per attempt	683k	93k
Turns per attempt	29.5	5.9
Attempts decided	170	565
Input price per 1M tokens	$0.20	$2.00
Output price per 1M tokens	$0.30	$10.00
Context window	128,000	No data
Image input	No	No data
Developer	OpenAI	OpenAI

Charts

Partial coverage. Codex – gpt-oss-20b (high): 32 of 147 Earth-Bench V2 tasks; 141 of 173 GeoBenchX tasks; GS-QA2 incomplete. Grey placeholders identify these entries in the index, cost and output token charts; their height does not represent a value. Comparable bars appear when first-attempt coverage is complete. Their available results remain in the side-by-side table.

Geospatial Agent Index

Equal-weight average of the evaluation scores, 0 to 100 · Higher is better

Planned attempts still to come

Data table: Geospatial Agent Index

Geospatial Agent Index
Model	Creator	Geospatial Agent Index	Range while attempts are pending	Benchmarks covered	Coverage (attempts)
Codex – GPT-6.1 Sol (medium)	OpenAI	72*	No pending judgements; coverage incomplete; 208 results awaiting review	3 of 3	565 of 859 planned attempts

Cost per task

Average cost per task (USD) · Lower is better

Planned attempts still to come

How to read this chart

Not shown: partial coverage. Codex – gpt-oss-20b (high).

Data table: Cost per task

Cost per task
Model	Creator	Cost per task	Coverage (attempts)
Codex – GPT-6.1 Sol (medium)	OpenAI	$0.049	565 of 859 planned attempts

Output tokens per task

Average output tokens per attempt, reasoning included · Lower is better

Planned attempts still to come

How to read this chart

Not shown: partial coverage. Codex – gpt-oss-20b (high).

Data table: Output tokens per task

Output tokens per task
Model	Creator	Output tokens per task	Coverage (attempts)
Codex – GPT-6.1 Sol (medium)	OpenAI	1k	565 of 859 planned attempts

Frequently asked questions

Which scores higher on the Geospatial Agent Index, Codex – gpt-oss-20b (high) or Codex – GPT-6.1 Sol (medium)?

Not comparable yet: Codex – gpt-oss-20b (high) has partial coverage (32 of 147 Earth-Bench V2 tasks; 141 of 173 GeoBenchX tasks; GS-QA2 incomplete), so it is not ranked. Codex – gpt-oss-20b (high): 170 of 614 planned attempts. Codex – GPT-6.1 Sol (medium): 565 of 859 planned attempts. Coverage is partial; scores can change as more attempts are decided.

Which is cheaper per task, Codex – gpt-oss-20b (high) or Codex – GPT-6.1 Sol (medium)?

Codex – GPT-6.1 Sol (medium), at $0.049 against $0.140 for Codex – gpt-oss-20b (high).

Which writes fewer output tokens per task, Codex – gpt-oss-20b (high) or Codex – GPT-6.1 Sol (medium)?

Codex – GPT-6.1 Sol (medium), at 1k against 29k for Codex – gpt-oss-20b (high).

Which has the larger context window, Codex – gpt-oss-20b (high) or Codex – GPT-6.1 Sol (medium)?

Not known yet: Codex – GPT-6.1 Sol (medium) has no context window data.

More: Codex – gpt-oss-20b (high) · Codex – GPT-6.1 Sol (medium) · all comparisons