2026-07-27T00:14:53.209Z

Simple Buffer (clean v6 fixture)

Quality score100%48 of 48 tasks completed · whole number, no decimals
Source
Claude Haiku 4.5 (AWS Bedrock Frankfurt via AI Gateway BYOK)
Test
simple-buffer-v6 · Accepted
Output
Accepted · 1 attempt(s)
Cost
0.00043 USD
Time
5423 ms
Failure
None
Limit
An empty file, a filename-only artifact, or buffers with a different distance must fail independent geometry checks.
Verifier
simple buffer geometry verified
Source
Claude Haiku 4.5 (AWS Bedrock Frankfurt via AI Gateway BYOK)
Test
simple-buffer-v6 · Accepted
Output
Accepted · 1 attempt(s)
Cost
0.00043 USD
Time
7418 ms
Failure
None
Limit
An empty file, a filename-only artifact, or buffers with a different distance must fail independent geometry checks.
Verifier
simple buffer geometry verified
Source
Claude Haiku 4.5 (AWS Bedrock Frankfurt via AI Gateway BYOK)
Test
simple-buffer-v6 · Accepted
Output
Accepted · 1 attempt(s)
Cost
0.00043 USD
Time
7523 ms
Failure
None
Limit
An empty file, a filename-only artifact, or buffers with a different distance must fail independent geometry checks.
Verifier
simple buffer geometry verified
Source
Claude Haiku 4.5 (AWS Bedrock Frankfurt via AI Gateway BYOK)
Test
simple-buffer-v6 · Accepted
Output
Accepted · 1 attempt(s)
Cost
0.00043 USD
Time
7828 ms
Failure
None
Limit
An empty file, a filename-only artifact, or buffers with a different distance must fail independent geometry checks.
Verifier
simple buffer geometry verified
Source
Claude Haiku 4.5 (AWS Bedrock Frankfurt via AI Gateway BYOK)
Test
simple-buffer-v6 · Accepted
Output
Accepted · 1 attempt(s)
Cost
0.00043 USD
Time
7084 ms
Failure
None
Limit
An empty file, a filename-only artifact, or buffers with a different distance must fail independent geometry checks.
Verifier
simple buffer geometry verified
Source
Claude Haiku 4.5 (AWS Bedrock Frankfurt via AI Gateway BYOK)
Test
simple-buffer-v6 · Accepted
Output
Accepted · 1 attempt(s)
Cost
0.00043 USD
Time
7298 ms
Failure
None
Limit
An empty file, a filename-only artifact, or buffers with a different distance must fail independent geometry checks.
Verifier
simple buffer geometry verified
Source
Claude Haiku 4.5 (AWS Bedrock Frankfurt via AI Gateway BYOK)
Test
simple-buffer-v6 · Accepted
Output
Accepted · 1 attempt(s)
Cost
0.00139 USD
Time
10358 ms
Failure
None
Limit
An empty file, a filename-only artifact, or buffers with a different distance must fail independent geometry checks.
Verifier
simple buffer geometry verified
Source
Claude Haiku 4.5 (AWS Bedrock Frankfurt via AI Gateway BYOK)
Test
simple-buffer-v6 · Accepted
Output
Accepted · 1 attempt(s)
Cost
0.00127 USD
Time
11294 ms
Failure
None
Limit
An empty file, a filename-only artifact, or buffers with a different distance must fail independent geometry checks.
Verifier
simple buffer geometry verified
Source
Claude Haiku 4.5 (AWS Bedrock Frankfurt via AI Gateway BYOK)
Test
simple-buffer-v6 · Accepted
Output
Accepted · 1 attempt(s)
Cost
0.00195 USD
Time
9876 ms
Failure
None
Limit
An empty file, a filename-only artifact, or buffers with a different distance must fail independent geometry checks.
Verifier
simple buffer geometry verified
Source
Claude Haiku 4.5 (AWS Bedrock Frankfurt via AI Gateway BYOK)
Test
simple-buffer-v6 · Accepted
Output
Accepted · 1 attempt(s)
Cost
0.00146 USD
Time
10096 ms
Failure
None
Limit
An empty file, a filename-only artifact, or buffers with a different distance must fail independent geometry checks.
Verifier
simple buffer geometry verified
Source
Claude Haiku 4.5 (AWS Bedrock Frankfurt via AI Gateway BYOK)
Test
simple-buffer-v6 · Accepted
Output
Accepted · 1 attempt(s)
Cost
0.00208 USD
Time
10237 ms
Failure
None
Limit
An empty file, a filename-only artifact, or buffers with a different distance must fail independent geometry checks.
Verifier
simple buffer geometry verified
Source
Claude Haiku 4.5 (AWS Bedrock Frankfurt via AI Gateway BYOK)
Test
simple-buffer-v6 · Accepted
Output
Accepted · 1 attempt(s)
Cost
0.00198 USD
Time
10471 ms
Failure
None
Limit
An empty file, a filename-only artifact, or buffers with a different distance must fail independent geometry checks.
Verifier
simple buffer geometry verified
Source
DeepSeek V4 Flash (AI Gateway BYOK)
Test
simple-buffer-v6 · Accepted
Output
Accepted · 1 attempt(s)
Cost
0.00036 USD
Time
6549 ms
Failure
None
Limit
An empty file, a filename-only artifact, or buffers with a different distance must fail independent geometry checks.
Verifier
simple buffer geometry verified
Source
DeepSeek V4 Flash (AI Gateway BYOK)
Test
simple-buffer-v6 · Accepted
Output
Accepted · 1 attempt(s)
Cost
0.00046 USD
Time
8084 ms
Failure
None
Limit
An empty file, a filename-only artifact, or buffers with a different distance must fail independent geometry checks.
Verifier
simple buffer geometry verified
Source
DeepSeek V4 Flash (AI Gateway BYOK)
Test
simple-buffer-v6 · Accepted
Output
Accepted · 1 attempt(s)
Cost
0.00042 USD
Time
9138 ms
Failure
None
Limit
An empty file, a filename-only artifact, or buffers with a different distance must fail independent geometry checks.
Verifier
simple buffer geometry verified
Source
DeepSeek V4 Flash (AI Gateway BYOK)
Test
simple-buffer-v6 · Accepted
Output
Accepted · 1 attempt(s)
Cost
0.00047 USD
Time
9448 ms
Failure
None
Limit
An empty file, a filename-only artifact, or buffers with a different distance must fail independent geometry checks.
Verifier
simple buffer geometry verified
Source
DeepSeek V4 Flash (AI Gateway BYOK)
Test
simple-buffer-v6 · Accepted
Output
Accepted · 1 attempt(s)
Cost
0.00042 USD
Time
9197 ms
Failure
None
Limit
An empty file, a filename-only artifact, or buffers with a different distance must fail independent geometry checks.
Verifier
simple buffer geometry verified
Source
DeepSeek V4 Flash (AI Gateway BYOK)
Test
simple-buffer-v6 · Accepted
Output
Accepted · 1 attempt(s)
Cost
0.00048 USD
Time
9872 ms
Failure
None
Limit
An empty file, a filename-only artifact, or buffers with a different distance must fail independent geometry checks.
Verifier
simple buffer geometry verified
Source
DeepSeek V4 Flash (AI Gateway BYOK)
Test
simple-buffer-v6 · Accepted
Output
Accepted · 1 attempt(s)
Cost
0.00145 USD
Time
15096 ms
Failure
None
Limit
An empty file, a filename-only artifact, or buffers with a different distance must fail independent geometry checks.
Verifier
simple buffer geometry verified
Source
DeepSeek V4 Flash (AI Gateway BYOK)
Test
simple-buffer-v6 · Accepted
Output
Accepted · 1 attempt(s)
Cost
0.00158 USD
Time
16294 ms
Failure
None
Limit
An empty file, a filename-only artifact, or buffers with a different distance must fail independent geometry checks.
Verifier
simple buffer geometry verified
Source
DeepSeek V4 Flash (AI Gateway BYOK)
Test
simple-buffer-v6 · Accepted
Output
Accepted · 1 attempt(s)
Cost
0.00129 USD
Time
12456 ms
Failure
None
Limit
An empty file, a filename-only artifact, or buffers with a different distance must fail independent geometry checks.
Verifier
simple buffer geometry verified
Source
DeepSeek V4 Flash (AI Gateway BYOK)
Test
simple-buffer-v6 · Accepted
Output
Accepted · 1 attempt(s)
Cost
0.00224 USD
Time
17220 ms
Failure
None
Limit
An empty file, a filename-only artifact, or buffers with a different distance must fail independent geometry checks.
Verifier
simple buffer geometry verified
Source
DeepSeek V4 Flash (AI Gateway BYOK)
Test
simple-buffer-v6 · Accepted
Output
Accepted · 1 attempt(s)
Cost
0.00224 USD
Time
19403 ms
Failure
None
Limit
An empty file, a filename-only artifact, or buffers with a different distance must fail independent geometry checks.
Verifier
simple buffer geometry verified
Source
DeepSeek V4 Flash (AI Gateway BYOK)
Test
simple-buffer-v6 · Accepted
Output
Accepted · 1 attempt(s)
Cost
0.00232 USD
Time
22729 ms
Failure
None
Limit
An empty file, a filename-only artifact, or buffers with a different distance must fail independent geometry checks.
Verifier
simple buffer geometry verified
Source
Gemini 2.5 Flash (Google AI Studio via AI Gateway BYOK)
Test
simple-buffer-v6 · Accepted
Output
Accepted · 1 attempt(s)
Cost
0.00034 USD
Time
6098 ms
Failure
None
Limit
An empty file, a filename-only artifact, or buffers with a different distance must fail independent geometry checks.
Verifier
simple buffer geometry verified
Source
Gemini 2.5 Flash (Google AI Studio via AI Gateway BYOK)
Test
simple-buffer-v6 · Accepted
Output
Accepted · 1 attempt(s)
Cost
0.00035 USD
Time
7871 ms
Failure
None
Limit
An empty file, a filename-only artifact, or buffers with a different distance must fail independent geometry checks.
Verifier
simple buffer geometry verified
Source
Gemini 2.5 Flash (Google AI Studio via AI Gateway BYOK)
Test
simple-buffer-v6 · Accepted
Output
Accepted · 1 attempt(s)
Cost
0.00034 USD
Time
8501 ms
Failure
None
Limit
An empty file, a filename-only artifact, or buffers with a different distance must fail independent geometry checks.
Verifier
simple buffer geometry verified
Source
Gemini 2.5 Flash (Google AI Studio via AI Gateway BYOK)
Test
simple-buffer-v6 · Accepted
Output
Accepted · 1 attempt(s)
Cost
0.00038 USD
Time
10243 ms
Failure
None
Limit
An empty file, a filename-only artifact, or buffers with a different distance must fail independent geometry checks.
Verifier
simple buffer geometry verified
Source
Gemini 2.5 Flash (Google AI Studio via AI Gateway BYOK)
Test
simple-buffer-v6 · Accepted
Output
Accepted · 1 attempt(s)
Cost
0.00034 USD
Time
5694 ms
Failure
None
Limit
An empty file, a filename-only artifact, or buffers with a different distance must fail independent geometry checks.
Verifier
simple buffer geometry verified
Source
Gemini 2.5 Flash (Google AI Studio via AI Gateway BYOK)
Test
simple-buffer-v6 · Accepted
Output
Accepted · 1 attempt(s)
Cost
0.00034 USD
Time
7768 ms
Failure
None
Limit
An empty file, a filename-only artifact, or buffers with a different distance must fail independent geometry checks.
Verifier
simple buffer geometry verified
Source
Gemini 2.5 Flash (Google AI Studio via AI Gateway BYOK)
Test
simple-buffer-v6 · Accepted
Output
Accepted · 1 attempt(s)
Cost
0.00136 USD
Time
11251 ms
Failure
None
Limit
An empty file, a filename-only artifact, or buffers with a different distance must fail independent geometry checks.
Verifier
simple buffer geometry verified
Source
Gemini 2.5 Flash (Google AI Studio via AI Gateway BYOK)
Test
simple-buffer-v6 · Accepted
Output
Accepted · 1 attempt(s)
Cost
0.00138 USD
Time
16401 ms
Failure
None
Limit
An empty file, a filename-only artifact, or buffers with a different distance must fail independent geometry checks.
Verifier
simple buffer geometry verified
Source
Gemini 2.5 Flash (Google AI Studio via AI Gateway BYOK)
Test
simple-buffer-v6 · Accepted
Output
Accepted · 1 attempt(s)
Cost
0.00127 USD
Time
10624 ms
Failure
None
Limit
An empty file, a filename-only artifact, or buffers with a different distance must fail independent geometry checks.
Verifier
simple buffer geometry verified
Source
Gemini 2.5 Flash (Google AI Studio via AI Gateway BYOK)
Test
simple-buffer-v6 · Accepted
Output
Accepted · 1 attempt(s)
Cost
0.00207 USD
Time
12712 ms
Failure
None
Limit
An empty file, a filename-only artifact, or buffers with a different distance must fail independent geometry checks.
Verifier
simple buffer geometry verified
Source
Gemini 2.5 Flash (Google AI Studio via AI Gateway BYOK)
Test
simple-buffer-v6 · Accepted
Output
Accepted · 1 attempt(s)
Cost
0.00228 USD
Time
17825 ms
Failure
None
Limit
An empty file, a filename-only artifact, or buffers with a different distance must fail independent geometry checks.
Verifier
simple buffer geometry verified
Source
Gemini 2.5 Flash (Google AI Studio via AI Gateway BYOK)
Test
simple-buffer-v6 · Accepted
Output
Accepted · 1 attempt(s)
Cost
0.00223 USD
Time
20634 ms
Failure
None
Limit
An empty file, a filename-only artifact, or buffers with a different distance must fail independent geometry checks.
Verifier
simple buffer geometry verified
Source
Gemini 2.5 Flash (Google Vertex AI via AI Gateway BYOK)
Test
simple-buffer-v6 · Accepted
Output
Accepted · 1 attempt(s)
Cost
0.00040 USD
Time
6792 ms
Failure
None
Limit
An empty file, a filename-only artifact, or buffers with a different distance must fail independent geometry checks.
Verifier
simple buffer geometry verified
Source
Gemini 2.5 Flash (Google Vertex AI via AI Gateway BYOK)
Test
simple-buffer-v6 · Accepted
Output
Accepted · 1 attempt(s)
Cost
0.00050 USD
Time
6803 ms
Failure
None
Limit
An empty file, a filename-only artifact, or buffers with a different distance must fail independent geometry checks.
Verifier
simple buffer geometry verified
Source
Gemini 2.5 Flash (Google Vertex AI via AI Gateway BYOK)
Test
simple-buffer-v6 · Accepted
Output
Accepted · 1 attempt(s)
Cost
0.00035 USD
Time
7896 ms
Failure
None
Limit
An empty file, a filename-only artifact, or buffers with a different distance must fail independent geometry checks.
Verifier
simple buffer geometry verified
Source
Gemini 2.5 Flash (Google Vertex AI via AI Gateway BYOK)
Test
simple-buffer-v6 · Accepted
Output
Accepted · 1 attempt(s)
Cost
0.00047 USD
Time
8238 ms
Failure
None
Limit
An empty file, a filename-only artifact, or buffers with a different distance must fail independent geometry checks.
Verifier
simple buffer geometry verified
Source
Gemini 2.5 Flash (Google Vertex AI via AI Gateway BYOK)
Test
simple-buffer-v6 · Accepted
Output
Accepted · 1 attempt(s)
Cost
0.00034 USD
Time
8402 ms
Failure
None
Limit
An empty file, a filename-only artifact, or buffers with a different distance must fail independent geometry checks.
Verifier
simple buffer geometry verified
Source
Gemini 2.5 Flash (Google Vertex AI via AI Gateway BYOK)
Test
simple-buffer-v6 · Accepted
Output
Accepted · 1 attempt(s)
Cost
0.00034 USD
Time
8618 ms
Failure
None
Limit
An empty file, a filename-only artifact, or buffers with a different distance must fail independent geometry checks.
Verifier
simple buffer geometry verified
Source
Gemini 2.5 Flash (Google Vertex AI via AI Gateway BYOK)
Test
simple-buffer-v6 · Accepted
Output
Accepted · 1 attempt(s)
Cost
0.00100 USD
Time
10783 ms
Failure
None
Limit
An empty file, a filename-only artifact, or buffers with a different distance must fail independent geometry checks.
Verifier
simple buffer geometry verified
Source
Gemini 2.5 Flash (Google Vertex AI via AI Gateway BYOK)
Test
simple-buffer-v6 · Accepted
Output
Accepted · 1 attempt(s)
Cost
0.00102 USD
Time
12598 ms
Failure
None
Limit
An empty file, a filename-only artifact, or buffers with a different distance must fail independent geometry checks.
Verifier
simple buffer geometry verified
Source
Gemini 2.5 Flash (Google Vertex AI via AI Gateway BYOK)
Test
simple-buffer-v6 · Accepted
Output
Accepted · 1 attempt(s)
Cost
0.00086 USD
Time
10367 ms
Failure
None
Limit
An empty file, a filename-only artifact, or buffers with a different distance must fail independent geometry checks.
Verifier
simple buffer geometry verified
Source
Gemini 2.5 Flash (Google Vertex AI via AI Gateway BYOK)
Test
simple-buffer-v6 · Accepted
Output
Accepted · 1 attempt(s)
Cost
0.00172 USD
Time
14842 ms
Failure
None
Limit
An empty file, a filename-only artifact, or buffers with a different distance must fail independent geometry checks.
Verifier
simple buffer geometry verified
Source
Gemini 2.5 Flash (Google Vertex AI via AI Gateway BYOK)
Test
simple-buffer-v6 · Accepted
Output
Accepted · 1 attempt(s)
Cost
0.00155 USD
Time
15784 ms
Failure
None
Limit
An empty file, a filename-only artifact, or buffers with a different distance must fail independent geometry checks.
Verifier
simple buffer geometry verified
Source
Gemini 2.5 Flash (Google Vertex AI via AI Gateway BYOK)
Test
simple-buffer-v6 · Accepted
Output
Accepted · 1 attempt(s)
Cost
0.00253 USD
Time
19231 ms
Failure
None
Limit
An empty file, a filename-only artifact, or buffers with a different distance must fail independent geometry checks.
Verifier
simple buffer geometry verified
Back to evidence index