Experimental run record

Run be0d3ee0

An inspectable execution record: configuration, deterministic outcomes, attempts, artefacts, and failure traces. Comparison applies across the configurations in this run only.

· pack geoworkbench-0.1 · cancelled

← All runs

Trials
2
Accepted
2
Configurations
32
Tasks
1
Cost USD
0.00216

In shortKimi K2.6 led this run: 1/1 tasks accepted (100%) for 0.0010 USD total. This ranking holds inside this run only — it is not a general model ranking.

Comparison across the configurations in this run only

JSON · CSV
Ranked by accepted rate, then total cost. Not comparable across runs or pack versions.
#ModelArchitectureAcceptedRateFirst-attempt successFalse-success rejectedCost USDCost / acceptedMedian msp95 ms
1Kimi K2.6single-shot1/1100%100%00.00100.001020560 ms20560 ms
2Kimi K2.6single-retry1/1100%100%00.00120.001223778 ms23778 ms

Trials

attempt traces expand beneath each trial
Trial outcomes are deterministic verifier results, not model-judge opinions.
TaskConfigurationRetryResultAttemptsCost USDLatency ms
simple-buffer-v6Kimi K2.6single-shotaccepted10.0010 USD20560 ms
Attempt trace undefined
# attempt undefined — model: @cf/moonshotai/kimi-k2.6 — exit 0 — accepted — cost 0.0010 USD — 20560 ms
# verifier: PASS — simple buffer geometry verified
# artifact: download (6171 bytes)
import geopandas as gpd

gdf = gpd.read_file("parcels.geojson")
if gdf.crs is None:
    gdf.set_crs(epsg=3857, inplace=True)
gdf["geometry"] = gdf.geometry.buffer(25)
gdf.to_file("simple_buffers.geojson", driver="GeoJSON")
architecture=single-shot
stage=single-code-generation
--- execution stdout ---
simple-buffer-v6Kimi K2.6single-retryaccepted10.0012 USD23778 ms
Attempt trace undefined
# attempt undefined — model: @cf/moonshotai/kimi-k2.6 — exit 0 — accepted — cost 0.0012 USD — 23778 ms
# verifier: PASS — simple buffer geometry verified
# artifact: download (6171 bytes)
import geopandas as gpd
import shapely

gdf = gpd.read_file("parcels.geojson")
buffered = gdf.copy()
buffered.geometry = gdf.geometry.buffer(25)
buffered.to_file("simple_buffers.geojson", driver="GeoJSON")
architecture=single-retry
stage=single-code-generation
--- execution stdout ---

Cite this record

Axis Spatial. "Experimental run be0d3ee0." Axis Spatial Arena, run be0d3ee0-992f-4026-9a94-3d4256b8382b. Benchmark pack geoworkbench-0.1. https://www.axisspatial.com/arena/runs/be0d3ee0-992f-4026-9a94-3d4256b8382b (accessed 19 Sep 2026).
@misc{axis-spatial-arena-run-be0d3ee0,
  author = {{Axis Spatial}},
  title = {Experimental run be0d3ee0},
  howpublished = {Axis Spatial Arena, run: https://www.axisspatial.com/arena/runs/be0d3ee0-992f-4026-9a94-3d4256b8382b},
  note = {Benchmark pack geoworkbench-0.1},
  year = {2026}
}

Glossary

full protocol in the methodology
Pack version
The pinned set of task definitions a run executed. Results from different pack versions are never compared directly.
Configuration
A complete comparison unit: model, prompt version, tools, retry policy, and pinned task, data, and verifier versions. A model name alone is not comparable.
Lane
One configured route through which a model is reached. Duplicate upstream models across lanes count as adapter evidence, not extra capability.
False-success rejection
A trial whose output looked plausible but failed independent deterministic checks, such as an empty file or a fabricated value.
Token-cost proxy
Cost estimated from reported token usage and list prices at recording time; actual billing may differ.
Sealed snapshot
An immutable, content-addressed copy of a leaderboard computed from a finished run.