Muse Ember
32.25/ 100
Ranked #8 of 18
Release Date:Loading…
Updated Benchmark:
- Context
- Max output
- Token cost
- Weights
- Inputs
LLM cost / run
$0.065
#6 of 18
Median time / action
1.9 s
#1 of 18
Evaluation runs
385
Across 9 challenges
Muse Ember
Five Dimensions
Distinct skills weighted equally toward the overall score.
Against the leaders
Muse Ember and the top-ranked alternatives. Scores out of 100.
Each bar shows this model’s score. The tick marks the field’s best.
Muse Ember
Creative Builds
Built by the model and scored by blind judges.
Muse Ember creative builds
Drag left or right, or focus a build and use the left and right arrow keys to rotate it. Rotation loops in either direction.
Summary
A pale Eiffel Tower rises through open arches and stacked viewing decks, with little trees, benches and a detailed plaza around its feet. The light-colored frame gives the whole scene a delicate look.
Summary
A stocky black Godzilla shows yellow eyes and a red mouth full of white teeth. Big pale plates run down its back and tail, with a white-edged display base framing the creature.
Summary
A white pelican spreads its black-tipped wings above a red bicycle, with a big orange pouch beneath its bill. Spoked wheels and a brown basket on the front give it the look of a bird out for a proper ride.
1 of 5: Open-brief build · Eiffel Tower, Muse Ember.
Muse Ember
Compare Models
29.25 points behind GPT-6 Astra, the overall leader.
The Efficiency Frontier: Performance vs Cost
Muse Ember is highlighted. Higher scores and lower costs move toward the top left.
The dotted line connects models with the best score for their cost.
Loading comparison…
Muse Ember
Challenge Results
Each challenge’s own win condition, across 385 runs. Open a challenge for its 95% Wilson interval and every run. Full run data is available on request.
Runs
385
Across 13 challenges
Total LLM spend
$25.10
14,222 model calls · 50 failed calls
Observed model
meta/muse-ember
100% of observed calls
Survival · Zombie Apocalypse
Can it stay alive under pressure?
Result
30 / 30Score / 100
100.00Assessment
strong
Survival · Zombie Apocalypse
Can it stay alive under pressure?
Result
Score / 100
Assessment
- 95% interval
- 88.65%–100.00%
- Runs
- 30
- LLM cost
- $0.93
| Run | Rep | Tier / build | Seat | Outcome | Metrics | Judging | Actions | LLM cost |
|---|---|---|---|---|---|---|---|---|
| 1 | – | 1 | Passed: won | 7 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 survived 1 aliveS 188.83381 | – | 12 | $0.036 | |
| 2 | – | 1 | Passed: won | 7 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 survived 1 aliveS 187.30048 | – | 16 | $0.045 | |
| 3 | – | 1 | Passed: won | 7 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 survived 1 aliveS 187.057651 | – | 7 | $0.031 | |
| 4 | – | 1 | Passed: won | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 4 initialStateAtS 1.1 survived 1 aliveS 187.183235 | – | 8 | $0.033 | |
| 5 | – | 1 | Passed: won | 7 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 survived 1 aliveS 187.079272 | – | 4 | $0.027 | |
| 6 | – | 1 | Passed: won | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 1 initialStateAtS 1.2 survived 1 aliveS 187.054792 | – | 7 | $0.031 | |
| 7 | – | 1 | Passed: won | 7 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 survived 1 aliveS 186.870932 | – | 12 | $0.033 | |
| 8 | – | 1 | Passed: won | 7 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 survived 1 aliveS 186.978014 | – | 8 | $0.032 | |
| 9 | – | 1 | Passed: won | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 3 initialStateAtS 1.1 survived 1 aliveS 186.901861 | – | 5 | $0.016 | |
| 10 | – | 1 | Passed: won | 7 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 survived 1 aliveS 187.022886 | – | 8 | $0.039 | |
| 11 | – | 1 | Passed: won | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 2 initialStateAtS 1.5 survived 1 aliveS 186.487457 | – | 5 | $0.016 | |
| 12 | – | 1 | Passed: won | 7 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 survived 1 aliveS 187.054953 | – | 6 | $0.028 | |
| 13 | – | 1 | Passed: won | 7 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 survived 1 aliveS 187.081031 | – | 10 | $0.023 | |
| 14 | – | 1 | Passed: won | 7 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 survived 1 aliveS 186.964354 | – | 6 | $0.022 | |
| 15 | – | 1 | Passed: won | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 1 initialStateAtS 1.1 survived 1 aliveS 187.087565 | – | 8 | $0.028 | |
| 16 | – | 1 | Passed: won | 7 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 survived 1 aliveS 186.944728 | – | 6 | $0.038 | |
| 17 | – | 1 | Passed: won | 7 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 survived 1 aliveS 198.318071 | – | 7 | $0.024 | |
| 18 | – | 1 | Passed: won | 7 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 survived 1 aliveS 193.642252 | – | 9 | $0.037 | |
| 19 | – | 1 | Passed: won | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 1 initialStateAtS 1.1 survived 1 aliveS 186.769242 | – | 6 | $0.018 | |
| 20 | – | 1 | Passed: won | 7 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 survived 1 aliveS 186.664628 | – | 4 | $0.022 | |
| 21 | – | 1 | Passed: won | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 1 initialStateAtS 1.1 survived 1 aliveS 187.421272 | – | 6 | $0.067 | |
| 22 | – | 1 | Passed: won | 7 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 survived 1 aliveS 186.928446 | – | 7 | $0.055 | |
| 23 | – | 1 | Passed: won | 7 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 survived 1 aliveS 186.82257 | – | 6 | $0.026 | |
| 24 | – | 1 | Passed: won | 7 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 survived 1 aliveS 187.121197 | – | 8 | $0.033 | |
| 25 | – | 1 | Passed: won | 7 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 survived 1 aliveS 187.175191 | – | 6 | $0.030 | |
| 26 | – | 1 | Passed: won | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 2 initialStateAtS 1.1 survived 1 aliveS 187.052927 | – | 8 | $0.032 | |
| 27 | – | 1 | Passed: won | 7 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 survived 1 aliveS 187.151243 | – | 7 | $0.023 | |
| 28 | – | 1 | Passed: won | 7 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 survived 1 aliveS 187.080301 | – | 8 | $0.027 | |
| 29 | – | 1 | Passed: won | 7 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 survived 1 aliveS 186.876685 | – | 5 | $0.021 | |
| 30 | – | 1 | Passed: won | 7 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.5 survived 1 aliveS 186.827496 | – | 6 | $0.037 |
Survival · Nightfall
Can it survive a hard night in the open?
Result
12 / 30Score / 100
40.00Assessment
mixed
Survival · Nightfall
Can it survive a hard night in the open?
Result
Score / 100
Assessment
- 95% interval
- 24.59%–57.68%
- By tier
Locked night 7/15
Night hunt 5/15
- Runs
- 30
- LLM cost
- $2.45
| Run | Rep | Tier / build | Seat | Outcome | Metrics | Judging | Actions | LLM cost |
|---|---|---|---|---|---|---|---|---|
| 1 | Locked night | 1 | Failed: died | 23 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 9 initialStateAtS 1.2 challengeWin 0 tierRank 1 coverTicks 210 minY 64 startY 64 maxY 68 blocksBroken 0 blocksPlaced 0 damageTaken 22.7 minHealth 0 killedZombie 0 killedSkeleton 0 mobsKilled 0 maxDist 82 nightSurvived 0 diedAtS 96.5 aliveS 96.5 | Not judged | 16 | $0.041 | |
| 2 | Locked night | 1 | Passed: survived | 21 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.3 challengeWin 1 tierRank 1 coverTicks 1342 minY 60 startY 64 maxY 69 blocksBroken 0 blocksPlaced 0 damageTaken 35.2 minHealth 2.7 killedZombie 0 killedSkeleton 0 mobsKilled 0 maxDist 266 nightSurvived 1 aliveS 626.805029 | Not judged | 22 | $0.17 | |
| 3 | Locked night | 1 | Failed: died | 23 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 3 initialStateAtS 1.8 challengeWin 0 tierRank 1 coverTicks 1444 minY 64 startY 64 maxY 64 blocksBroken 0 blocksPlaced 0 damageTaken 33.300000000000004 minHealth 0 killedZombie 1 killedSkeleton 0 mobsKilled 1 maxDist 11 nightSurvived 0 diedAtS 97.8 aliveS 97.8 | Not judged | 19 | $0.049 | |
| 4 | Locked night | 1 | Passed: survived | 21 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 challengeWin 1 tierRank 1 coverTicks 3622 minY 63 startY 64 maxY 66 blocksBroken 0 blocksPlaced 0 damageTaken 31.199999999999992 minHealth 12.1 killedZombie 4 killedSkeleton 3 mobsKilled 8 maxDist 27 nightSurvived 1 aliveS 620.0248349999999 | Not judged | 14 | $0.18 | |
| 5 | Locked night | 1 | Failed: died | 22 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 challengeWin 0 tierRank 1 coverTicks 109 minY 64 startY 64 maxY 64 blocksBroken 0 blocksPlaced 0 damageTaken 22.299999999999997 minHealth 0 killedZombie 1 killedSkeleton 0 mobsKilled 1 maxDist 8 nightSurvived 0 diedAtS 63.2 aliveS 63.2 | Not judged | 12 | $0.030 | |
| 6 | Locked night | 1 | Passed: survived | 22 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 1 initialStateAtS 1.1 challengeWin 1 tierRank 1 coverTicks 1514 minY 57 startY 64 maxY 64 blocksBroken 0 blocksPlaced 0 damageTaken 28.6 minHealth 4.2 killedZombie 0 killedSkeleton 0 mobsKilled 0 maxDist 201 nightSurvived 1 aliveS 626.078958 | Not judged | 17 | $0.21 | |
| 7 | Locked night | 1 | Failed: died | 22 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 challengeWin 0 tierRank 1 coverTicks 1080 minY 56 startY 64 maxY 73 blocksBroken 0 blocksPlaced 0 damageTaken 42.000000000000014 minHealth 0 killedZombie 0 killedSkeleton 0 mobsKilled 0 maxDist 75 nightSurvived 0 diedAtS 221 aliveS 221 | Not judged | 35 | $0.10 | |
| 8 | Locked night | 1 | Failed: died | 23 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 1 initialStateAtS 15.1 challengeWin 0 tierRank 1 coverTicks 109 minY 63 startY 64 maxY 65 blocksBroken 0 blocksPlaced 0 damageTaken 33.8 minHealth 0 killedZombie 1 killedSkeleton 1 mobsKilled 2 maxDist 20 nightSurvived 0 diedAtS 63.6 aliveS 63.6 | Not judged | 6 | $0.031 | |
| 9 | Locked night | 1 | Passed: survived | 21 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 challengeWin 1 tierRank 1 coverTicks 5854 minY 61 startY 64 maxY 66 blocksBroken 0 blocksPlaced 0 damageTaken 58.400000000000006 minHealth 7.6 killedZombie 11 killedSkeleton 2 mobsKilled 16 maxDist 27 nightSurvived 1 aliveS 620.147469 | Not judged | 20 | $0.32 | |
| 10 | Locked night | 1 | Passed: survived | 21 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 challengeWin 1 tierRank 1 coverTicks 39 minY 61 startY 64 maxY 69 blocksBroken 0 blocksPlaced 0 damageTaken 85.10000000000007 minHealth 2.2 killedZombie 2 killedSkeleton 0 mobsKilled 2 maxDist 38 nightSurvived 1 aliveS 623.803162 | Not judged | 26 | $0.27 | |
| 11 | Locked night | 1 | Failed: died | 22 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 2 challengeWin 0 tierRank 1 coverTicks 173 minY 60 startY 64 maxY 74 blocksBroken 0 blocksPlaced 0 damageTaken 57.29999999999998 minHealth 0 killedZombie 2 killedSkeleton 0 mobsKilled 2 maxDist 217 nightSurvived 0 diedAtS 219 aliveS 219 | Not judged | 16 | $0.053 | |
| 12 | Locked night | 1 | Failed: died | 22 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 challengeWin 0 tierRank 1 coverTicks 283 minY 60 startY 64 maxY 70 blocksBroken 0 blocksPlaced 0 damageTaken 30.699999999999996 minHealth 0 killedZombie 0 killedSkeleton 0 mobsKilled 0 maxDist 48 nightSurvived 0 diedAtS 180.1 aliveS 180.1 | Not judged | 22 | $0.080 | |
| 13 | Locked night | 1 | Failed: died | 22 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 challengeWin 0 tierRank 1 coverTicks 744 minY 64 startY 64 maxY 70 blocksBroken 0 blocksPlaced 0 damageTaken 40.80000000000001 minHealth 0 killedZombie 4 killedSkeleton 0 mobsKilled 4 maxDist 76 nightSurvived 0 diedAtS 218.5 aliveS 218.5 | Not judged | 15 | $0.084 | |
| 14 | Locked night | 1 | Passed: survived | 21 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 challengeWin 1 tierRank 1 coverTicks 157 minY 60 startY 64 maxY 67 blocksBroken 0 blocksPlaced 0 damageTaken 23.499999999999996 minHealth 12.8 killedZombie 3 killedSkeleton 3 mobsKilled 7 maxDist 30 nightSurvived 1 aliveS 619.411661 | Not judged | 14 | $0.17 | |
| 15 | Locked night | 1 | Passed: survived | 21 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.3 challengeWin 1 tierRank 1 coverTicks 911 minY 57 startY 64 maxY 66 blocksBroken 0 blocksPlaced 0 damageTaken 25.799999999999994 minHealth 15 killedZombie 1 killedSkeleton 2 mobsKilled 5 maxDist 40 nightSurvived 1 aliveS 619.535257 | Not judged | 28 | $0.15 | |
| 1 | Night hunt | 1 | Failed: died | 22 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 challengeWin 0 tierRank 2 coverTicks 0 minY 64 startY 64 maxY 64 blocksBroken 0 blocksPlaced 0 damageTaken 24.4 minHealth 0 killedZombie 0 killedSkeleton 0 mobsKilled 0 maxDist 8 quotaMet 0 diedAtS 39.9 aliveS 39.9 | Not scored: not a win | 3 | $0.004 | |
| 2 | Night hunt | 1 | Failed: died | 22 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 challengeWin 0 tierRank 2 coverTicks 125 minY 61 startY 64 maxY 67 blocksBroken 0 blocksPlaced 0 damageTaken 62.19999999999997 minHealth 0 killedZombie 1 killedSkeleton 3 mobsKilled 4 maxDist 47 quotaMet 0 diedAtS 207.8 aliveS 207.8 | Not scored: not a win | 27 | $0.069 | |
| 3 | Night hunt | 1 | Failed: died | 22 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.5 challengeWin 0 tierRank 2 coverTicks 15 minY 64 startY 64 maxY 68 blocksBroken 0 blocksPlaced 0 damageTaken 34.8 minHealth 0 killedZombie 2 killedSkeleton 0 mobsKilled 2 maxDist 97 quotaMet 0 diedAtS 90.7 aliveS 90.7 | Not scored: not a win | 13 | $0.021 | |
| 4 | Night hunt | 1 | Failed: died | 23 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 2 initialStateAtS 1.2 challengeWin 0 tierRank 2 coverTicks 254 minY 59 startY 64 maxY 66 blocksBroken 0 blocksPlaced 0 damageTaken 31.6 minHealth 0 killedZombie 0 killedSkeleton 1 mobsKilled 1 maxDist 34 quotaMet 0 diedAtS 108.5 aliveS 108.5 | Not scored: not a win | 17 | $0.028 | |
| 5 | Night hunt | 1 | Passed: done | 21 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 challengeWin 1 tierRank 2 coverTicks 293 minY 64 startY 64 maxY 68 blocksBroken 0 blocksPlaced 0 damageTaken 30.499999999999993 minHealth 9 killedZombie 2 killedSkeleton 1 mobsKilled 3 maxDist 96 quotaMet 1 aliveS 114.503128 | Rule passed | 13 | $0.019 | |
| 6 | Night hunt | 1 | Passed: done | 21 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 challengeWin 1 tierRank 2 coverTicks 464 minY 62 startY 64 maxY 68 blocksBroken 0 blocksPlaced 0 damageTaken 8.399999999999999 minHealth 17.8 killedZombie 3 killedSkeleton 1 mobsKilled 4 maxDist 100 quotaMet 1 aliveS 137.965812 | Rule passed | 13 | $0.027 | |
| 7 | Night hunt | 1 | Passed: done | 21 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 4.6 challengeWin 1 tierRank 2 coverTicks 319 minY 64 startY 64 maxY 69 blocksBroken 0 blocksPlaced 1 damageTaken 14.9 minHealth 14.6 killedZombie 2 killedSkeleton 1 mobsKilled 3 maxDist 49 quotaMet 1 aliveS 145.080959 | Rule passed | 15 | $0.027 | |
| 8 | Night hunt | 1 | Failed: died | 22 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 challengeWin 0 tierRank 2 coverTicks 124 minY 63 startY 64 maxY 68 blocksBroken 0 blocksPlaced 0 damageTaken 33.5 minHealth 0 killedZombie 0 killedSkeleton 1 mobsKilled 1 maxDist 79 quotaMet 0 diedAtS 97.9 aliveS 97.9 | Not scored: not a win | 17 | $0.023 | |
| 9 | Night hunt | 1 | Failed: died | 22 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.5 challengeWin 0 tierRank 2 coverTicks 48 minY 62 startY 64 maxY 68 blocksBroken 0 blocksPlaced 0 damageTaken 27.1 minHealth 0 killedZombie 1 killedSkeleton 1 mobsKilled 2 maxDist 60 quotaMet 0 diedAtS 95.3 aliveS 95.3 | Not scored: not a win | 14 | $0.023 | |
| 10 | Night hunt | 1 | Failed: died | 22 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.4 challengeWin 0 tierRank 2 coverTicks 122 minY 60 startY 64 maxY 68 blocksBroken 0 blocksPlaced 1 damageTaken 62.70000000000002 minHealth 0 killedZombie 4 killedSkeleton 0 mobsKilled 4 maxDist 69 quotaMet 0 diedAtS 248.6 aliveS 248.6 | Not scored: not a win | 15 | $0.086 | |
| 11 | Night hunt | 1 | Failed: died | 22 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.6 challengeWin 0 tierRank 2 coverTicks 0 minY 63 startY 64 maxY 67 blocksBroken 0 blocksPlaced 0 damageTaken 23.3 minHealth 0 killedZombie 0 killedSkeleton 0 mobsKilled 0 maxDist 31 quotaMet 0 diedAtS 59.7 aliveS 59.7 | Not scored: not a win | 11 | $0.018 | |
| 12 | Night hunt | 1 | Passed: done | 21 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.3 challengeWin 1 tierRank 2 coverTicks 41 minY 61 startY 64 maxY 68 blocksBroken 0 blocksPlaced 1 damageTaken 27.699999999999992 minHealth 13.8 killedZombie 3 killedSkeleton 1 mobsKilled 4 maxDist 74 quotaMet 1 aliveS 128.223151 | Rule passed | 11 | $0.030 | |
| 13 | Night hunt | 1 | Failed: died | 23 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 2 initialStateAtS 1.5 challengeWin 0 tierRank 2 coverTicks 79 minY 62 startY 64 maxY 68 blocksBroken 0 blocksPlaced 0 damageTaken 47.69999999999999 minHealth 0 killedZombie 2 killedSkeleton 1 mobsKilled 4 maxDist 112 quotaMet 1 diedAtS 109.5 aliveS 109.5 | Not scored: not a win | 15 | $0.030 | |
| 14 | Night hunt | 1 | Passed: done | 21 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 3.1 challengeWin 1 tierRank 2 coverTicks 0 minY 61 startY 64 maxY 69 blocksBroken 0 blocksPlaced 0 damageTaken 14.399999999999997 minHealth 15.6 killedZombie 2 killedSkeleton 2 mobsKilled 4 maxDist 56 quotaMet 1 aliveS 152.64203 | Rule passed | 10 | $0.025 | |
| 15 | Night hunt | 1 | Failed: died | 22 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 challengeWin 0 tierRank 2 coverTicks 1377 minY 55 startY 64 maxY 69 blocksBroken 0 blocksPlaced 0 damageTaken 76.39999999999999 minHealth 0 killedZombie 3 killedSkeleton 0 mobsKilled 3 maxDist 147 quotaMet 0 diedAtS 417.8 aliveS 417.8 | Not scored: not a win | 42 | $0.083 |
Conflict vs Gemma 4
Can it win fights against weak opponents?
Result
22 / 30Score / 100
73.33Assessment
strong
Conflict vs Gemma 4
Can it win fights against weak opponents?
Result
Score / 100
Assessment
- 95% interval
- 55.55%–85.82%
- Runs
- 30
- LLM cost
- $1.84
| Run | Rep | Tier / build | Seat | Outcome | Metrics | Judging | Actions | LLM cost |
|---|---|---|---|---|---|---|---|---|
| 1 | – | 1 | Passed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 6 initialStateAtS 1.2 kills 2 voidDeath 0 placement 1 | – | 36 | $0.075 | |
| 2 | – | 4 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 0 diedAtS 126.9 voidDeath 0 placement 4 | – | 22 | $0.050 | |
| 3 | – | 3 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 1 diedAtS 131.7 voidDeath 0 placement 3 | – | 34 | $0.058 | |
| 4 | – | 2 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 0 diedAtS 87.1 voidDeath 1 placement 4 | – | 19 | $0.033 | |
| 5 | – | 1 | Passed: last standing | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 2 voidDeath 0 placement 1 | – | 29 | $0.050 | |
| 6 | – | 4 | Passed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 1 initialStateAtS 1.4 kills 2 voidDeath 0 placement 1 | – | 24 | $0.062 | |
| 7 | – | 3 | Passed: last standing | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 1 voidDeath 0 placement 1 | – | 41 | $0.089 | |
| 8 | – | 2 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 kills 0 diedAtS 70.8 voidDeath 1 placement 4 | – | 18 | $0.026 | |
| 9 | – | 1 | Passed: last standing | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 1 voidDeath 0 placement 1 | – | 42 | $0.086 | |
| 10 | – | 4 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.3 kills 0 diedAtS 221.7 voidDeath 1 placement 2 | – | 37 | $0.099 | |
| 11 | – | 3 | Passed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 3 initialStateAtS 1.3 kills 1 voidDeath 0 placement 1 | – | 18 | $0.065 | |
| 12 | – | 2 | Passed: last standing | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 kills 0 voidDeath 0 placement 1 | – | 31 | $0.064 | |
| 13 | – | 1 | Passed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 1 initialStateAtS 1.3 kills 0 voidDeath 0 placement 1 | – | 34 | $0.080 | |
| 14 | – | 4 | Passed: last standing | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 kills 3 voidDeath 0 placement 1 | – | 31 | $0.045 | |
| 15 | – | 3 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 1 diedAtS 162.7 voidDeath 0 placement 2 | – | 27 | $0.060 | |
| 16 | – | 2 | Passed: last standing | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 0 voidDeath 0 placement 1 | – | 30 | $0.045 | |
| 17 | – | 1 | Passed: last standing | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 3 voidDeath 0 placement 1 | – | 26 | $0.044 | |
| 18 | – | 4 | Passed: last standing | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 1 voidDeath 0 placement 1 | – | 29 | $0.062 | |
| 19 | – | 3 | Failed: last standing | 10 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 1 initialStateAtS 1.1 kills 1 diedAtS 210.6 voidDeath 1 placement 2 | – | 44 | $0.060 | |
| 20 | – | 2 | Passed: last standing | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 kills 1 voidDeath 0 placement 1 | – | 30 | $0.056 | |
| 21 | – | 1 | Passed: last standing | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 0 voidDeath 0 placement 1 | – | 22 | $0.052 | |
| 22 | – | 4 | Passed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 3 initialStateAtS 1.1 kills 1 voidDeath 0 placement 1 | – | 33 | $0.061 | |
| 23 | – | 3 | Passed: last standing | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 kills 2 voidDeath 0 placement 1 | – | 40 | $0.069 | |
| 24 | – | 2 | Passed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 1 initialStateAtS 1.1 kills 1 voidDeath 0 placement 1 | – | 33 | $0.066 | |
| 25 | – | 1 | Passed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 1 initialStateAtS 1.1 kills 1 voidDeath 0 placement 1 | – | 33 | $0.049 | |
| 26 | – | 4 | Passed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 1 initialStateAtS 1.1 kills 1 voidDeath 0 placement 1 | – | 42 | $0.091 | |
| 27 | – | 3 | Failed: last standing | 10 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 1 initialStateAtS 1.2 kills 2 diedAtS 182.2 voidDeath 1 placement 2 | – | 38 | $0.056 | |
| 28 | – | 2 | Passed: last standing | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 1 voidDeath 0 placement 1 | – | 34 | $0.068 | |
| 29 | – | 1 | Passed: last standing | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 1 voidDeath 0 placement 1 | – | 44 | $0.067 | |
| 30 | – | 4 | Passed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 1 initialStateAtS 1.1 kills 1 voidDeath 0 placement 1 | – | 32 | $0.047 |
Conflict vs Gemini 3.8 Flash
Can it win fights against stronger opponents?
Result
13 / 30Score / 100
43.33Assessment
mixed
Conflict vs Gemini 3.8 Flash
Can it win fights against stronger opponents?
Result
Score / 100
Assessment
- 95% interval
- 27.38%–60.80%
- Runs
- 30
- LLM cost
- $1.35
| Run | Rep | Tier / build | Seat | Outcome | Metrics | Judging | Actions | LLM cost |
|---|---|---|---|---|---|---|---|---|
| 1 | – | 1 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 0 diedAtS 103.7 voidDeath 0 placement 4 | – | 33 | $0.049 | |
| 2 | – | 4 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 0 diedAtS 77.8 voidDeath 0 placement 4 | – | 13 | $0.043 | |
| 3 | – | 3 | Passed: last standing | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 kills 1 voidDeath 0 placement 1 | – | 22 | $0.048 | |
| 4 | – | 2 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 0 diedAtS 90.2 voidDeath 0 placement 3 | – | 17 | $0.032 | |
| 5 | – | 1 | Passed: last standing | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 kills 1 voidDeath 0 placement 1 | – | 37 | $0.072 | |
| 6 | – | 4 | Passed: last standing | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 kills 3 voidDeath 0 placement 1 | – | 32 | $0.077 | |
| 7 | – | 3 | Passed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 3 initialStateAtS 1.6 kills 1 voidDeath 0 placement 1 | – | 19 | $0.050 | |
| 8 | – | 2 | Passed: last standing | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.5 kills 1 voidDeath 0 placement 1 | – | 31 | $0.057 | |
| 9 | – | 1 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 kills 0 diedAtS 34.8 voidDeath 1 placement 4 | – | 8 | $0.013 | |
| 10 | – | 4 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 0 diedAtS 100.2 voidDeath 0 placement 4 | – | 23 | $0.036 | |
| 11 | – | 3 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 1 diedAtS 114.9 voidDeath 0 placement 2 | – | 26 | $0.047 | |
| 12 | – | 2 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 kills 0 diedAtS 144.6 voidDeath 0 placement 2 | – | 29 | $0.056 | |
| 13 | – | 1 | Passed: last standing | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.4 kills 2 voidDeath 0 placement 1 | – | 33 | $0.054 | |
| 14 | – | 4 | Passed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 1 initialStateAtS 1.1 kills 3 voidDeath 0 placement 1 | – | 26 | $0.067 | |
| 15 | – | 3 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 0 diedAtS 89.1 voidDeath 0 placement 4 | – | 22 | $0.039 | |
| 16 | – | 2 | Passed: last standing | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 1 voidDeath 0 placement 1 | – | 25 | $0.037 | |
| 17 | – | 1 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 0 diedAtS 95.4 voidDeath 0 placement 4 | – | 19 | $0.042 | |
| 18 | – | 4 | Passed: last standing | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 kills 1 voidDeath 0 placement 1 | – | 38 | $0.068 | |
| 19 | – | 3 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.5 kills 1 diedAtS 113.5 voidDeath 0 placement 2 | – | 20 | $0.031 | |
| 20 | – | 2 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 1 diedAtS 133.4 voidDeath 0 placement 3 | – | 28 | $0.045 | |
| 21 | – | 1 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 1 diedAtS 151 voidDeath 0 placement 2 | – | 28 | $0.048 | |
| 22 | – | 4 | Passed: last standing | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 kills 1 voidDeath 0 placement 1 | – | 26 | $0.038 | |
| 23 | – | 3 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 0 diedAtS 141.8 voidDeath 0 placement 2 | – | 31 | $0.049 | |
| 24 | – | 2 | Passed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 1 initialStateAtS 1.1 kills 1 voidDeath 0 placement 1 | – | 21 | $0.030 | |
| 25 | – | 1 | Failed: last standing | 10 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 1 initialStateAtS 1.1 kills 0 diedAtS 114.7 voidDeath 1 placement 3 | – | 24 | $0.035 | |
| 26 | – | 4 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 0 diedAtS 15.7 voidDeath 1 placement 4 | – | 6 | $0.003 | |
| 27 | – | 3 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 0 diedAtS 76.9 voidDeath 1 placement 3 | – | 19 | $0.023 | |
| 28 | – | 2 | Failed: last standing | 10 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 1 initialStateAtS 1.1 kills 2 diedAtS 133.7 voidDeath 0 placement 2 | – | 31 | $0.043 | |
| 29 | – | 1 | Passed: last standing | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 1 voidDeath 0 placement 1 | – | 33 | $0.059 | |
| 30 | – | 4 | Passed: last standing | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 kills 3 voidDeath 0 placement 1 | – | 30 | $0.057 |
Conflict vs Opus 5.5
Can it win fights against a frontier opponent?
Result
9 / 30Score / 100
30.00Assessment
weak
Conflict vs Opus 5.5
Can it win fights against a frontier opponent?
Result
Score / 100
Assessment
- 95% interval
- 16.66%–47.88%
- Runs
- 30
- LLM cost
- $0.72
| Run | Rep | Tier / build | Seat | Outcome | Metrics | Judging | Actions | LLM cost |
|---|---|---|---|---|---|---|---|---|
| 1 | – | 1 | Failed: last standing | 10 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 1 initialStateAtS 1.1 kills 0 diedAtS 80.2 voidDeath 1 placement 2 | – | 20 | $0.034 | |
| 2 | – | 4 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 0 diedAtS 86 voidDeath 0 placement 3 | – | 18 | $0.034 | |
| 3 | – | 3 | Passed: last standing | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 1 voidDeath 0 placement 1 | – | 11 | $0.022 | |
| 4 | – | 2 | Passed: last standing | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 kills 2 voidDeath 0 placement 1 | – | 23 | $0.048 | |
| 5 | – | 1 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 kills 0 diedAtS 63.5 voidDeath 0 placement 4 | – | 15 | $0.026 | |
| 6 | – | 4 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.9 kills 0 diedAtS 21 voidDeath 1 placement 4 | – | 9 | $0.013 | |
| 7 | – | 3 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 0 diedAtS 60.9 voidDeath 0 placement 3 | – | 19 | $0.030 | |
| 8 | – | 2 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 0 diedAtS 75.4 voidDeath 0 placement 2 | – | 20 | $0.038 | |
| 9 | – | 1 | Failed: last standing | 10 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 3 initialStateAtS 1.3 kills 1 diedAtS 94.5 voidDeath 0 placement 2 | – | 18 | $0.025 | |
| 10 | – | 4 | Passed: last standing | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.4 kills 2 voidDeath 0 placement 1 | – | 14 | $0.025 | |
| 11 | – | 3 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 0 diedAtS 87 voidDeath 0 placement 3 | – | 18 | $0.020 | |
| 12 | – | 2 | Passed: last standing | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.4 kills 2 voidDeath 0 placement 1 | – | 22 | $0.024 | |
| 13 | – | 1 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 2.2 kills 0 diedAtS 58 voidDeath 0 placement 4 | – | 18 | $0.023 | |
| 14 | – | 4 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 1 diedAtS 74.1 voidDeath 0 placement 2 | – | 17 | $0.023 | |
| 15 | – | 3 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 kills 1 diedAtS 60.1 voidDeath 0 placement 3 | – | 16 | $0.023 | |
| 16 | – | 2 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 1 diedAtS 58.5 voidDeath 0 placement 3 | – | 16 | $0.020 | |
| 17 | – | 1 | Failed: last standing | 10 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 3 initialStateAtS 1.1 kills 0 diedAtS 60.5 voidDeath 0 placement 2 | – | 15 | $0.025 | |
| 18 | – | 4 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 kills 0 diedAtS 59.5 voidDeath 0 placement 3 | – | 23 | $0.026 | |
| 19 | – | 3 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 kills 0 diedAtS 28 voidDeath 1 placement 4 | – | 9 | $0.011 | |
| 20 | – | 2 | Passed: last standing | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 kills 2 voidDeath 0 placement 1 | – | 13 | $0.018 | |
| 21 | – | 1 | Passed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 1 initialStateAtS 1.1 kills 2 voidDeath 0 placement 1 | – | 15 | $0.022 | |
| 22 | – | 4 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 0 diedAtS 68.7 voidDeath 0 placement 3 | – | 23 | $0.022 | |
| 23 | – | 3 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 0 diedAtS 83.2 voidDeath 0 placement 2 | – | 11 | $0.018 | |
| 24 | – | 2 | Passed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 1 initialStateAtS 1.1 kills 3 voidDeath 0 placement 1 | – | 19 | $0.022 | |
| 25 | – | 1 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 kills 0 diedAtS 48.2 voidDeath 0 placement 4 | – | 13 | $0.011 | |
| 26 | – | 4 | Passed: last standing | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 0 voidDeath 0 placement 1 | – | 23 | $0.039 | |
| 27 | – | 3 | Passed: last standing | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 1 voidDeath 0 placement 1 | – | 15 | $0.019 | |
| 28 | – | 2 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 0 diedAtS 36.4 voidDeath 0 placement 4 | – | 10 | $0.011 | |
| 29 | – | 1 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 kills 0 diedAtS 68.9 voidDeath 0 placement 3 | – | 20 | $0.026 | |
| 30 | – | 4 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 0 diedAtS 82.1 voidDeath 0 placement 2 | – | 20 | $0.021 |
Conflict vs GPT-6.1 Sol
Can it win fights against the strongest opponent in the field?
Result
2 / 30Score / 100
6.67Assessment
weak
Conflict vs GPT-6.1 Sol
Can it win fights against the strongest opponent in the field?
Result
Score / 100
Assessment
- 95% interval
- 1.85%–21.32%
- Runs
- 30
- LLM cost
- $0.74
| Run | Rep | Tier / build | Seat | Outcome | Metrics | Judging | Actions | LLM cost |
|---|---|---|---|---|---|---|---|---|
| 1 | – | 1 | Passed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 1 initialStateAtS 1.6 kills 0 voidDeath 0 placement 1 | – | 21 | $0.040 | |
| 2 | – | 4 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 2 kills 0 diedAtS 47.7 voidDeath 0 placement 3 | – | 14 | $0.026 | |
| 3 | – | 3 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 0 diedAtS 50.7 voidDeath 0 placement 4 | – | 13 | $0.027 | |
| 4 | – | 2 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 2.5 kills 0 diedAtS 48.9 voidDeath 0 placement 4 | – | 13 | $0.024 | |
| 5 | – | 1 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.6 kills 0 diedAtS 64.2 voidDeath 0 placement 2 | – | 15 | $0.024 | |
| 6 | – | 4 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 0 diedAtS 92 voidDeath 0 placement 2 | – | 24 | $0.048 | |
| 7 | – | 3 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.3 kills 0 diedAtS 64.7 voidDeath 0 placement 3 | – | 21 | $0.032 | |
| 8 | – | 2 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 3.8 kills 0 diedAtS 65.3 voidDeath 0 placement 3 | – | 17 | $0.031 | |
| 9 | – | 1 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 kills 0 diedAtS 75.9 voidDeath 0 placement 2 | – | 16 | $0.027 | |
| 10 | – | 4 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 0 diedAtS 40.5 voidDeath 0 placement 3 | – | 16 | $0.020 | |
| 11 | – | 3 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 7.9 kills 0 diedAtS 82.9 voidDeath 0 placement 2 | – | 19 | $0.028 | |
| 12 | – | 2 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.4 kills 0 diedAtS 65.8 voidDeath 0 placement 2 | – | 16 | $0.024 | |
| 13 | – | 1 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 0 diedAtS 81.2 voidDeath 0 placement 2 | – | 23 | $0.030 | |
| 14 | – | 4 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 0 diedAtS 67.8 voidDeath 0 placement 2 | – | 19 | $0.029 | |
| 15 | – | 3 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 0 diedAtS 52.3 voidDeath 1 placement 3 | – | 13 | $0.018 | |
| 16 | – | 2 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 0 diedAtS 52.6 voidDeath 0 placement 4 | – | 13 | $0.018 | |
| 17 | – | 1 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 0 diedAtS 70 voidDeath 0 placement 2 | – | 18 | $0.023 | |
| 18 | – | 4 | Passed: last standing | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 1 voidDeath 0 placement 1 | – | 18 | $0.022 | |
| 19 | – | 3 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 0 diedAtS 73.5 voidDeath 0 placement 2 | – | 21 | $0.027 | |
| 20 | – | 2 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 0 diedAtS 91.6 voidDeath 0 placement 2 | – | 11 | $0.023 | |
| 21 | – | 1 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 0 diedAtS 47.2 voidDeath 0 placement 3 | – | 13 | $0.017 | |
| 22 | – | 4 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 0 diedAtS 60.8 voidDeath 0 placement 2 | – | 22 | $0.026 | |
| 23 | – | 3 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 0 diedAtS 67.9 voidDeath 0 placement 3 | – | 9 | $0.020 | |
| 24 | – | 2 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 0 diedAtS 25.9 voidDeath 1 placement 4 | – | 8 | $0.006 | |
| 25 | – | 1 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 1 diedAtS 43.7 voidDeath 0 placement 3 | – | 12 | $0.014 | |
| 26 | – | 4 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 0 diedAtS 104 voidDeath 0 placement 2 | – | 29 | $0.029 | |
| 27 | – | 3 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 0 diedAtS 97.8 voidDeath 0 placement 2 | – | 20 | $0.029 | |
| 28 | – | 2 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 1 diedAtS 61.4 voidDeath 0 placement 3 | – | 18 | $0.015 | |
| 29 | – | 1 | Failed: last standing | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 kills 0 diedAtS 90.5 voidDeath 0 placement 2 | – | 24 | $0.025 | |
| 30 | – | 4 | Failed: last standing | 10 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 2 initialStateAtS 1.1 kills 0 diedAtS 78.7 voidDeath 0 placement 2 | – | 20 | $0.022 |
Economy vs Gemma 4
Can it out-plan weak opponents in an economy game?
Result
4 / 30Score / 100
13.33Assessment
weak
Economy vs Gemma 4
Can it out-plan weak opponents in an economy game?
Result
Score / 100
Assessment
- 95% interval
- 5.31%–29.68%
- Runs
- 30
- LLM cost
- $2.09
| Run | Rep | Tier / build | Seat | Outcome | Metrics | Judging | Actions | LLM cost |
|---|---|---|---|---|---|---|---|---|
| 1 | – | 1 | Failed: Lost · rival outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 58 rank 3 opponentBest 110 outlawEpisodes 0 | – | 12 | $0.082 | |
| 2 | – | 4 | Failed: Lost · rival outlawed | 10 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 2 initialStateAtS 1.3 diamonds 83 rank 3 opponentBest 124 outlawEpisodes 0 | – | 10 | $0.093 | |
| 3 | – | 3 | Failed: Lost · outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.3 diamonds 74 rank 3 opponentBest 145 outlawEpisodes 1 | – | 14 | $0.072 | |
| 4 | – | 2 | Failed: Lost · outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.3 diamonds 58 rank 4 opponentBest 111 outlawEpisodes 1 | – | 13 | $0.072 | |
| 5 | – | 1 | Failed: Lost · rival outlawed | 10 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 1 initialStateAtS 1.4 diamonds 77 rank 3 opponentBest 150 outlawEpisodes 0 | – | 8 | $0.080 | |
| 6 | – | 4 | Failed: Lost · outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 71 rank 3 opponentBest 91 outlawEpisodes 1 | – | 16 | $0.078 | |
| 7 | – | 3 | Failed: Lost · rival outlawed | 10 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 3 initialStateAtS 1.2 diamonds 81 rank 2 opponentBest 99 outlawEpisodes 0 | – | 13 | $0.072 | |
| 8 | – | 2 | Failed: Lost · outlawed | 10 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 1 initialStateAtS 1.2 diamonds 75 rank 3 opponentBest 126 outlawEpisodes 1 | – | 9 | $0.092 | |
| 9 | – | 1 | Failed: Lost · rival outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 9.4 diamonds 88 rank 4 opponentBest 163 outlawEpisodes 0 | – | 5 | $0.076 | |
| 10 | – | 4 | Failed: Lost · rival outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.4 diamonds 97 rank 2 opponentBest 158 outlawEpisodes 0 | – | 31 | $0.063 | |
| 11 | – | 3 | Failed: Lost · outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.5 diamonds 73 rank 2 opponentBest 117 outlawEpisodes 1 | – | 13 | $0.077 | |
| 12 | – | 2 | Passed: Won · outlawed | 10 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 1 initialStateAtS 1.3 diamonds 78 rank 1 opponentBest 74 outlawEpisodes 1 | – | 13 | $0.092 | |
| 13 | – | 1 | Failed: Lost · outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 2.4 diamonds 63 rank 3 opponentBest 111 outlawEpisodes 1 | – | 11 | $0.058 | |
| 14 | – | 4 | Failed: Lost · rival outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 67 rank 3 opponentBest 130 outlawEpisodes 0 | – | 19 | $0.077 | |
| 15 | – | 3 | Passed: Won · outlawed 2× | 10 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 1 initialStateAtS 1.3 diamonds 87 rank 1 opponentBest 79 outlawEpisodes 2 | – | 7 | $0.059 | |
| 16 | – | 2 | Failed: Lost · outlawed 2× | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 72 rank 4 opponentBest 104 outlawEpisodes 2 | – | 12 | $0.073 | |
| 17 | – | 1 | Failed: Lost · rival outlawed | 10 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 1 initialStateAtS 1.2 diamonds 91 rank 1 opponentBest 0 outlawEpisodes 0 | – | 11 | $0.070 | |
| 18 | – | 4 | Failed: Lost · outlawed 2× | 10 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 1 initialStateAtS 1.2 diamonds 79 rank 4 opponentBest 105 outlawEpisodes 2 | – | 12 | $0.076 | |
| 19 | – | 3 | Failed: Lost · outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 56 rank 2 opponentBest 58 outlawEpisodes 1 | – | 11 | $0.060 | |
| 20 | – | 2 | Passed: Won · outlawed 2× | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 103 rank 1 opponentBest 76 outlawEpisodes 2 | – | 12 | $0.071 | |
| 21 | – | 1 | Failed: Lost · outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.3 diamonds 65 rank 2 opponentBest 128 outlawEpisodes 1 | – | 16 | $0.061 | |
| 22 | – | 4 | Failed: Lost · rival outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 75 rank 3 opponentBest 123 outlawEpisodes 0 | – | 10 | $0.050 | |
| 23 | – | 3 | Failed: Lost · rival outlawed | 10 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 1 initialStateAtS 1.3 diamonds 77 rank 3 opponentBest 116 outlawEpisodes 0 | – | 11 | $0.077 | |
| 24 | – | 2 | Failed: Lost · outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 85 rank 2 opponentBest 106 outlawEpisodes 1 | – | 14 | $0.060 | |
| 25 | – | 1 | Failed: Lost · rival outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 88 rank 3 opponentBest 130 outlawEpisodes 0 | – | 7 | $0.057 | |
| 26 | – | 4 | Failed: Lost · outlawed 2× | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 58 rank 3 opponentBest 112 outlawEpisodes 2 | – | 10 | $0.064 | |
| 27 | – | 3 | Failed: Lost · outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 71 rank 3 opponentBest 112 outlawEpisodes 1 | – | 10 | $0.063 | |
| 28 | – | 2 | Failed: Lost · outlawed | 10 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 1 initialStateAtS 1.2 diamonds 92 rank 3 opponentBest 157 outlawEpisodes 1 | – | 6 | $0.056 | |
| 29 | – | 1 | Passed: Won · outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 120 rank 1 opponentBest 120 outlawEpisodes 1 | – | 7 | $0.056 | |
| 30 | – | 4 | Failed: Lost · outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 76 rank 2 opponentBest 110 outlawEpisodes 1 | – | 17 | $0.056 |
Economy vs Gemini 3.8 Flash
Can it out-plan stronger opponents in an economy game?
Result
13 / 30Score / 100
43.33Assessment
mixed
Economy vs Gemini 3.8 Flash
Can it out-plan stronger opponents in an economy game?
Result
Score / 100
Assessment
- 95% interval
- 27.38%–60.80%
- Runs
- 30
- LLM cost
- $2.14
| Run | Rep | Tier / build | Seat | Outcome | Metrics | Judging | Actions | LLM cost |
|---|---|---|---|---|---|---|---|---|
| 1 | – | 1 | Passed: Won · outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 87 rank 1 opponentBest 83 outlawEpisodes 1 | – | 10 | $0.070 | |
| 2 | – | 4 | Failed: Lost · outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 81 rank 2 opponentBest 94 outlawEpisodes 1 | – | 13 | $0.081 | |
| 3 | – | 3 | Failed: Lost · rival outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.3 diamonds 100 rank 2 opponentBest 105 outlawEpisodes 0 | – | 14 | $0.069 | |
| 4 | – | 2 | Failed: Lost · outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.3 diamonds 88 rank 2 opponentBest 92 outlawEpisodes 1 | – | 9 | $0.075 | |
| 5 | – | 1 | Failed: Lost · outlawed 2× | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.5 diamonds 75 rank 3 opponentBest 86 outlawEpisodes 2 | – | 13 | $0.067 | |
| 6 | – | 4 | Failed: Lost · outlawed | 10 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 1 initialStateAtS 1.2 diamonds 79 rank 2 opponentBest 89 outlawEpisodes 1 | – | 6 | $0.084 | |
| 7 | – | 3 | Passed: Won · outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 104 rank 1 opponentBest 76 outlawEpisodes 1 | – | 18 | $0.080 | |
| 8 | – | 2 | Failed: Lost · outlawed | 10 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 2 initialStateAtS 1.3 diamonds 66 rank 3 opponentBest 90 outlawEpisodes 1 | – | 8 | $0.071 | |
| 9 | – | 1 | Passed: Won · rival outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 96 rank 1 opponentBest 78 outlawEpisodes 0 | – | 13 | $0.062 | |
| 10 | – | 4 | Passed: Won · rival outlawed | 10 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 1 initialStateAtS 1.3 diamonds 80 rank 1 opponentBest 78 outlawEpisodes 0 | – | 9 | $0.082 | |
| 11 | – | 3 | Failed: Lost · outlawed 2× | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 3.3 diamonds 44 rank 4 opponentBest 90 outlawEpisodes 2 | – | 9 | $0.079 | |
| 12 | – | 2 | Failed: Lost · outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.3 diamonds 60 rank 4 opponentBest 89 outlawEpisodes 1 | – | 12 | $0.064 | |
| 13 | – | 1 | Passed: Won · outlawed 2× | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 91 rank 1 opponentBest 90 outlawEpisodes 2 | – | 8 | $0.060 | |
| 14 | – | 4 | Failed: Lost · outlawed | 10 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 1 initialStateAtS 1.2 diamonds 90 rank 2 opponentBest 92 outlawEpisodes 1 | – | 10 | $0.076 | |
| 15 | – | 3 | Failed: Lost · outlawed 2× | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 61 rank 4 opponentBest 76 outlawEpisodes 2 | – | 14 | $0.073 | |
| 16 | – | 2 | Passed: Won · no outlaws | 10 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 1 initialStateAtS 1.2 diamonds 105 rank 1 opponentBest 90 outlawEpisodes 0 | – | 9 | $0.058 | |
| 17 | – | 1 | Failed: Lost · outlawed 2× | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 80 rank 3 opponentBest 110 outlawEpisodes 2 | – | 6 | $0.15 | |
| 18 | – | 4 | Failed: Lost · outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 71 rank 4 opponentBest 102 outlawEpisodes 1 | – | 8 | $0.066 | |
| 19 | – | 3 | Passed: Won · no outlaws | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 120 rank 1 opponentBest 90 outlawEpisodes 0 | – | 11 | $0.062 | |
| 20 | – | 2 | Passed: Won · outlawed | 10 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 2 initialStateAtS 1.2 diamonds 98 rank 1 opponentBest 90 outlawEpisodes 1 | – | 13 | $0.061 | |
| 21 | – | 1 | Passed: Won · rival outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 111 rank 1 opponentBest 88 outlawEpisodes 0 | – | 9 | $0.057 | |
| 22 | – | 4 | Failed: Lost · rival outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 diamonds 70 rank 2 opponentBest 80 outlawEpisodes 0 | – | 16 | $0.051 | |
| 23 | – | 3 | Failed: Lost · outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 79 rank 4 opponentBest 90 outlawEpisodes 1 | – | 6 | $0.068 | |
| 24 | – | 2 | Failed: Lost · outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 78 rank 3 opponentBest 87 outlawEpisodes 1 | – | 15 | $0.075 | |
| 25 | – | 1 | Failed: Lost · outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 67 rank 2 opponentBest 89 outlawEpisodes 1 | – | 14 | $0.081 | |
| 26 | – | 4 | Passed: Won · outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 2.1 diamonds 124 rank 1 opponentBest 102 outlawEpisodes 1 | – | 9 | $0.065 | |
| 27 | – | 3 | Failed: Lost · rival outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 75 rank 3 opponentBest 85 outlawEpisodes 0 | – | 14 | $0.062 | |
| 28 | – | 2 | Passed: Won · outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 96 rank 1 opponentBest 86 outlawEpisodes 1 | – | 8 | $0.080 | |
| 29 | – | 1 | Passed: Won · rival outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.3 diamonds 90 rank 1 opponentBest 90 outlawEpisodes 0 | – | 10 | $0.055 | |
| 30 | – | 4 | Passed: Won · rival outlawed | 10 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 1 initialStateAtS 1.1 diamonds 89 rank 1 opponentBest 86 outlawEpisodes 0 | – | 14 | $0.060 |
Economy vs Opus 5.5
Can it out-plan a frontier opponent in an economy game?
Result
4 / 30Score / 100
13.33Assessment
weak
Economy vs Opus 5.5
Can it out-plan a frontier opponent in an economy game?
Result
Score / 100
Assessment
- 95% interval
- 5.31%–29.68%
- Runs
- 30
- LLM cost
- $1.97
| Run | Rep | Tier / build | Seat | Outcome | Metrics | Judging | Actions | LLM cost |
|---|---|---|---|---|---|---|---|---|
| 1 | – | 1 | Passed: Won · rival outlawed | 10 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 2 initialStateAtS 1.3 diamonds 120 rank 1 opponentBest 105 outlawEpisodes 0 | – | 3 | $0.096 | |
| 2 | – | 4 | Failed: Lost · outlawed | 10 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 2 initialStateAtS 1.2 diamonds 99 rank 3 opponentBest 105 outlawEpisodes 1 | – | 13 | $0.087 | |
| 3 | – | 3 | Failed: Lost · rival outlawed | 10 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 6 initialStateAtS 1.2 diamonds 105 rank 3 opponentBest 119 outlawEpisodes 0 | – | 8 | $0.074 | |
| 4 | – | 2 | Failed: Lost · outlawed | 10 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 1 initialStateAtS 1.2 diamonds 71 rank 4 opponentBest 124 outlawEpisodes 1 | – | 9 | $0.078 | |
| 5 | – | 1 | Passed: Won · outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 122 rank 1 opponentBest 108 outlawEpisodes 1 | – | 15 | $0.072 | |
| 6 | – | 4 | Failed: Lost · no outlaws | 10 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 4 initialStateAtS 1.2 diamonds 105 rank 2 opponentBest 120 outlawEpisodes 0 | – | 10 | $0.080 | |
| 7 | – | 3 | Failed: Lost · no outlaws | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.4 diamonds 105 rank 2 opponentBest 120 outlawEpisodes 0 | – | 5 | $0.096 | |
| 8 | – | 2 | Failed: Lost · outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.4 diamonds 0 rank 4 opponentBest 111 outlawEpisodes 1 | – | 11 | $0.034 | |
| 9 | – | 1 | Failed: Lost · outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.4 diamonds 91 rank 3 opponentBest 104 outlawEpisodes 1 | – | 13 | $0.070 | |
| 10 | – | 4 | Failed: Lost · rival outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.4 diamonds 90 rank 4 opponentBest 117 outlawEpisodes 0 | – | 15 | $0.071 | |
| 11 | – | 3 | Failed: Lost · outlawed | 10 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 4 initialStateAtS 1.5 diamonds 78 rank 4 opponentBest 105 outlawEpisodes 1 | – | 15 | $0.059 | |
| 12 | – | 2 | Failed: Lost · outlawed | 10 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 7 initialStateAtS 1.3 diamonds 92 rank 4 opponentBest 118 outlawEpisodes 1 | – | 12 | $0.079 | |
| 13 | – | 1 | Failed: Lost · outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 74 rank 4 opponentBest 118 outlawEpisodes 1 | – | 11 | $0.063 | |
| 14 | – | 4 | Failed: Lost · outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.5 diamonds 106 rank 3 opponentBest 123 outlawEpisodes 1 | – | 11 | $0.064 | |
| 15 | – | 3 | Failed: Lost · rival outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 114 rank 2 opponentBest 117 outlawEpisodes 0 | – | 13 | $0.058 | |
| 16 | – | 2 | Failed: Lost · rival outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.3 diamonds 86 rank 4 opponentBest 120 outlawEpisodes 0 | – | 14 | $0.069 | |
| 17 | – | 1 | Failed: Lost · outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 diamonds 106 rank 4 opponentBest 120 outlawEpisodes 1 | – | 13 | $0.050 | |
| 18 | – | 4 | Failed: Lost · rival outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.5 diamonds 91 rank 4 opponentBest 117 outlawEpisodes 0 | – | 9 | $0.055 | |
| 19 | – | 3 | Failed: Lost · outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 77 rank 4 opponentBest 113 outlawEpisodes 1 | – | 12 | $0.058 | |
| 20 | – | 2 | Passed: Won · rival outlawed | 10 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 1 initialStateAtS 1.2 diamonds 130 rank 1 opponentBest 119 outlawEpisodes 0 | – | 9 | $0.097 | |
| 21 | – | 1 | Failed: Lost · outlawed 2× | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 96 rank 4 opponentBest 120 outlawEpisodes 2 | – | 15 | $0.077 | |
| 22 | – | 4 | Failed: Lost · outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 106 rank 3 opponentBest 130 outlawEpisodes 1 | – | 7 | $0.058 | |
| 23 | – | 3 | Failed: Lost · no outlaws | 10 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 1 initialStateAtS 1.2 diamonds 105 rank 2 opponentBest 120 outlawEpisodes 0 | – | 10 | $0.055 | |
| 24 | – | 2 | Failed: Lost · no outlaws | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 90 rank 4 opponentBest 115 outlawEpisodes 0 | – | 11 | $0.062 | |
| 25 | – | 1 | Passed: Won · no outlaws | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 205 rank 1 opponentBest 120 outlawEpisodes 0 | – | 13 | $0.054 | |
| 26 | – | 4 | Failed: Lost · outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.3 diamonds 96 rank 4 opponentBest 105 outlawEpisodes 1 | – | 8 | $0.054 | |
| 27 | – | 3 | Failed: Lost · rival outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 100 rank 3 opponentBest 105 outlawEpisodes 0 | – | 14 | $0.044 | |
| 28 | – | 2 | Failed: Lost · outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 4.7 diamonds 92 rank 4 opponentBest 105 outlawEpisodes 1 | – | 6 | $0.056 | |
| 29 | – | 1 | Failed: Lost · rival outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 81 rank 3 opponentBest 105 outlawEpisodes 0 | – | 15 | $0.052 | |
| 30 | – | 4 | Failed: Lost · outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 76 rank 4 opponentBest 119 outlawEpisodes 1 | – | 7 | $0.048 |
Economy vs GPT-6.1 Sol
Can it out-plan the strongest opponent in the field in an economy game?
Result
0 / 30Score / 100
0.00Assessment
weak
Economy vs GPT-6.1 Sol
Can it out-plan the strongest opponent in the field in an economy game?
Result
Score / 100
Assessment
- 95% interval
- 0.00%–11.35%
- Runs
- 30
- LLM cost
- $2.13
| Run | Rep | Tier / build | Seat | Outcome | Metrics | Judging | Actions | LLM cost |
|---|---|---|---|---|---|---|---|---|
| 1 | – | 1 | Failed: Lost · outlawed 2× | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 75 rank 4 opponentBest 135 outlawEpisodes 2 | – | 16 | $0.072 | |
| 2 | – | 4 | Failed: Lost · outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.4 diamonds 0 rank 4 opponentBest 180 outlawEpisodes 1 | – | 9 | $0.037 | |
| 3 | – | 3 | Failed: Lost · outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 64 rank 4 opponentBest 135 outlawEpisodes 1 | – | 11 | $0.080 | |
| 4 | – | 2 | Failed: Lost · outlawed | 10 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 2 initialStateAtS 1.2 diamonds 86 rank 4 opponentBest 134 outlawEpisodes 1 | – | 8 | $0.15 | |
| 5 | – | 1 | Failed: Lost · outlawed 2× | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 106 rank 4 opponentBest 150 outlawEpisodes 2 | – | 9 | $0.074 | |
| 6 | – | 4 | Failed: Lost · no outlaws | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 105 rank 4 opponentBest 150 outlawEpisodes 0 | – | 8 | $0.077 | |
| 7 | – | 3 | Failed: Lost · outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 86 rank 4 opponentBest 148 outlawEpisodes 1 | – | 12 | $0.079 | |
| 8 | – | 2 | Failed: Lost · outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 96 rank 4 opponentBest 159 outlawEpisodes 1 | – | 12 | $0.075 | |
| 9 | – | 1 | Failed: Lost · outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.3 diamonds 75 rank 4 opponentBest 171 outlawEpisodes 1 | – | 10 | $0.077 | |
| 10 | – | 4 | Failed: Lost · no outlaws | 10 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 2 initialStateAtS 1.4 diamonds 81 rank 4 opponentBest 135 outlawEpisodes 0 | – | 4 | $0.15 | |
| 11 | – | 3 | Failed: Lost · outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 2.3 diamonds 113 rank 3 opponentBest 151 outlawEpisodes 1 | – | 6 | $0.065 | |
| 12 | – | 2 | Failed: Lost · outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 90 rank 4 opponentBest 221 outlawEpisodes 1 | – | 7 | $0.058 | |
| 13 | – | 1 | Failed: Lost · outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 81 rank 4 opponentBest 129 outlawEpisodes 1 | – | 13 | $0.068 | |
| 14 | – | 4 | Failed: Lost · outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 94 rank 4 opponentBest 227 outlawEpisodes 1 | – | 8 | $0.083 | |
| 15 | – | 3 | Failed: Lost · outlawed | 10 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 1 initialStateAtS 1.3 diamonds 152 rank 2 opponentBest 172 outlawEpisodes 1 | – | 8 | $0.060 | |
| 16 | – | 2 | Failed: Lost · outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 115 rank 4 opponentBest 197 outlawEpisodes 1 | – | 14 | $0.070 | |
| 17 | – | 1 | Failed: Lost · outlawed 2× | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 2.5 diamonds 84 rank 4 opponentBest 144 outlawEpisodes 2 | – | 9 | $0.083 | |
| 18 | – | 4 | Failed: Lost · no outlaws | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 diamonds 100 rank 4 opponentBest 150 outlawEpisodes 0 | – | 7 | $0.067 | |
| 19 | – | 3 | Failed: Lost · no outlaws | 10 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 1 initialStateAtS 1.2 diamonds 100 rank 4 opponentBest 165 outlawEpisodes 0 | – | 11 | $0.051 | |
| 20 | – | 2 | Failed: Lost · outlawed | 10 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 1 initialStateAtS 1.2 diamonds 97 rank 4 opponentBest 162 outlawEpisodes 1 | – | 12 | $0.057 | |
| 21 | – | 1 | Failed: Lost · outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 83 rank 4 opponentBest 163 outlawEpisodes 1 | – | 9 | $0.069 | |
| 22 | – | 4 | Failed: Lost · outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 76 rank 4 opponentBest 259 outlawEpisodes 1 | – | 10 | $0.048 | |
| 23 | – | 3 | Failed: Lost · outlawed | 10 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 1 initialStateAtS 1.3 diamonds 100 rank 4 opponentBest 150 outlawEpisodes 1 | – | 14 | $0.059 | |
| 24 | – | 2 | Failed: Lost · outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 94 rank 4 opponentBest 215 outlawEpisodes 1 | – | 12 | $0.070 | |
| 25 | – | 1 | Failed: Lost · no outlaws | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 119 rank 3 opponentBest 180 outlawEpisodes 0 | – | 7 | $0.074 | |
| 26 | – | 4 | Failed: Lost · no outlaws | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 105 rank 4 opponentBest 180 outlawEpisodes 0 | – | 4 | $0.077 | |
| 27 | – | 3 | Failed: Lost · no outlaws | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 142 rank 2 opponentBest 230 outlawEpisodes 0 | – | 8 | $0.061 | |
| 28 | – | 2 | Failed: Lost · outlawed | 10 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 4 initialStateAtS 2.1 diamonds 77 rank 4 opponentBest 193 outlawEpisodes 1 | – | 12 | $0.057 | |
| 29 | – | 1 | Failed: Lost · no outlaws | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 155 rank 3 opponentBest 175 outlawEpisodes 0 | – | 9 | $0.062 | |
| 30 | – | 4 | Failed: Lost · outlawed | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 diamonds 0 rank 4 opponentBest 150 outlawEpisodes 1 | – | 3 | $0.022 |
Logic · Gate ladder
Can it build redstone circuits that pass an exam?
Result
11 / 30Score / 100
31.11Assessment
mixed
Logic · Gate ladder
Can it build redstone circuits that pass an exam?
Result
Score / 100
Assessment
- 95% interval
- 14.74%–55.19%
- By tier
AND gate 8/15
XOR gate 3/15
- Runs
- 30
- LLM cost
- $4.65
| Run | Rep | Tier / build | Seat | Outcome | Metrics | Judging | Actions | LLM cost |
|---|---|---|---|---|---|---|---|---|
| 1 | AND gate | 1 | Passed: exam passed | 14 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 2.3 examPassed 1 tierRank 1 examGraded 4 examCorrect 4 examTampered 0 lampsLit 0 wireCount 25 torchCount 3 deviceCount 0 | – | 34 | $0.15 | |
| 2 | AND gate | 1 | Failed: exam failed | 14 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 examPassed 0 tierRank 1 examGraded 4 examCorrect 1 examTampered 0 lampsLit 1 wireCount 28 torchCount 3 deviceCount 0 | – | 31 | $0.14 | |
| 3 | AND gate | 1 | Failed: exam failed | 14 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 examPassed 0 tierRank 1 examGraded 4 examCorrect 3 examTampered 0 lampsLit 0 wireCount 18 torchCount 5 deviceCount 2 | – | 33 | $0.16 | |
| 4 | AND gate | 1 | Passed: exam passed | 15 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 1 initialStateAtS 1.2 examPassed 1 tierRank 1 examGraded 4 examCorrect 4 examTampered 0 lampsLit 0 wireCount 30 torchCount 5 deviceCount 6 | – | 26 | $0.14 | |
| 5 | AND gate | 1 | Passed: exam passed | 14 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 examPassed 1 tierRank 1 examGraded 4 examCorrect 4 examTampered 0 lampsLit 0 wireCount 23 torchCount 3 deviceCount 0 | – | 21 | $0.067 | |
| 6 | AND gate | 1 | Passed: exam passed | 14 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 examPassed 1 tierRank 1 examGraded 4 examCorrect 4 examTampered 0 lampsLit 0 wireCount 21 torchCount 3 deviceCount 0 | – | 26 | $0.12 | |
| 7 | AND gate | 1 | Passed: exam passed | 15 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 3 initialStateAtS 1.1 examPassed 1 tierRank 1 examGraded 4 examCorrect 4 examTampered 0 lampsLit 0 wireCount 18 torchCount 3 deviceCount 0 | – | 18 | $0.090 | |
| 8 | AND gate | 1 | Failed: exam failed | 14 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 examPassed 0 tierRank 1 examGraded 4 examCorrect 3 examTampered 0 lampsLit 0 wireCount 25 torchCount 6 deviceCount 0 | – | 30 | $0.13 | |
| 9 | AND gate | 1 | Failed: exam failed | 15 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 1 initialStateAtS 1.1 examPassed 0 tierRank 1 examGraded 4 examCorrect 3 examTampered 1 lampsLit 1 wireCount 34 torchCount 1 deviceCount 6 | – | 24 | $0.14 | |
| 10 | AND gate | 1 | Passed: exam passed | 14 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 examPassed 1 tierRank 1 examGraded 4 examCorrect 4 examTampered 0 lampsLit 0 wireCount 20 torchCount 3 deviceCount 0 | – | 18 | $0.058 | |
| 11 | AND gate | 1 | Failed: exam failed | 14 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 examPassed 0 tierRank 1 examGraded 4 examCorrect 3 examTampered 0 lampsLit 0 wireCount 27 torchCount 3 deviceCount 0 | – | 23 | $0.13 | |
| 12 | AND gate | 1 | Failed: exam failed | 14 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 examPassed 0 tierRank 1 examGraded 4 examCorrect 3 examTampered 0 lampsLit 0 wireCount 33 torchCount 0 deviceCount 0 | – | 24 | $0.12 | |
| 13 | AND gate | 1 | Passed: exam passed | 15 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 1 initialStateAtS 1.2 examPassed 1 tierRank 1 examGraded 4 examCorrect 4 examTampered 0 lampsLit 0 wireCount 19 torchCount 3 deviceCount 0 | – | 19 | $0.082 | |
| 14 | AND gate | 1 | Passed: exam passed | 14 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 examPassed 1 tierRank 1 examGraded 4 examCorrect 4 examTampered 0 lampsLit 0 wireCount 19 torchCount 3 deviceCount 0 | – | 10 | $0.025 | |
| 15 | AND gate | 1 | Failed: exam failed | 14 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 examPassed 0 tierRank 1 examGraded 4 examCorrect 1 examTampered 0 lampsLit 1 wireCount 28 torchCount 3 deviceCount 3 | – | 36 | $0.15 | |
| 1 | XOR gate | 1 | Passed: exam passed | 14 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 examPassed 1 tierRank 2 examGraded 4 examCorrect 4 examTampered 0 lampsLit 0 wireCount 41 torchCount 0 deviceCount 6 | – | 26 | $0.12 | |
| 2 | XOR gate | 1 | Failed: exam failed | 14 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 examPassed 0 tierRank 2 examGraded 4 examCorrect 2 examTampered 0 lampsLit 0 wireCount 48 torchCount 5 deviceCount 0 | – | 38 | $0.22 | |
| 3 | XOR gate | 1 | Failed: exam failed | 14 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 examPassed 0 tierRank 2 examGraded 4 examCorrect 3 examTampered 0 lampsLit 0 wireCount 52 torchCount 0 deviceCount 4 | – | 37 | $0.22 | |
| 4 | XOR gate | 1 | Passed: exam passed | 15 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 3 initialStateAtS 1.1 examPassed 1 tierRank 2 examGraded 4 examCorrect 4 examTampered 0 lampsLit 0 wireCount 44 torchCount 3 deviceCount 0 | – | 28 | $0.15 | |
| 5 | XOR gate | 1 | Failed: exam failed | 14 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 examPassed 0 tierRank 2 examGraded 4 examCorrect 2 examTampered 0 lampsLit 1 wireCount 45 torchCount 5 deviceCount 0 | – | 28 | $0.22 | |
| 6 | XOR gate | 1 | Failed: exam failed | 14 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 examPassed 0 tierRank 2 examGraded 4 examCorrect 2 examTampered 0 lampsLit 1 wireCount 60 torchCount 4 deviceCount 0 | – | 37 | $0.23 | |
| 7 | XOR gate | 1 | Failed: exam failed | 14 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 examPassed 0 tierRank 2 examGraded 4 examCorrect 2 examTampered 0 lampsLit 0 wireCount 49 torchCount 4 deviceCount 0 | – | 29 | $0.22 | |
| 8 | XOR gate | 1 | Failed: exam failed | 15 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 2 initialStateAtS 1.1 examPassed 0 tierRank 2 examGraded 4 examCorrect 2 examTampered 0 lampsLit 1 wireCount 38 torchCount 4 deviceCount 0 | – | 40 | $0.21 | |
| 9 | XOR gate | 1 | Failed: exam failed | 14 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.3 examPassed 0 tierRank 2 examGraded 4 examCorrect 3 examTampered 0 lampsLit 1 wireCount 47 torchCount 3 deviceCount 2 | – | 31 | $0.20 | |
| 10 | XOR gate | 1 | Failed: exam failed | 14 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 examPassed 0 tierRank 2 examGraded 4 examCorrect 2 examTampered 0 lampsLit 0 wireCount 66 torchCount 5 deviceCount 0 | – | 22 | $0.20 | |
| 11 | XOR gate | 1 | Failed: exam failed | 14 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 examPassed 0 tierRank 2 examGraded 4 examCorrect 2 examTampered 0 lampsLit 0 wireCount 47 torchCount 4 deviceCount 0 | – | 24 | $0.19 | |
| 12 | XOR gate | 1 | Failed: exam failed | 14 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 examPassed 0 tierRank 2 examGraded 4 examCorrect 2 examTampered 0 lampsLit 0 wireCount 69 torchCount 1 deviceCount 1 | – | 31 | $0.21 | |
| 13 | XOR gate | 1 | Passed: exam passed | 14 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 examPassed 1 tierRank 2 examGraded 4 examCorrect 4 examTampered 0 lampsLit 0 wireCount 37 torchCount 0 deviceCount 7 | – | 15 | $0.090 | |
| 14 | XOR gate | 1 | Failed: exam failed | 14 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 examPassed 0 tierRank 2 examGraded 4 examCorrect 2 examTampered 0 lampsLit 0 wireCount 37 torchCount 0 deviceCount 10 | – | 36 | $0.22 | |
| 15 | XOR gate | 1 | Failed: exam failed | 14 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 examPassed 0 tierRank 2 examGraded 4 examCorrect 2 examTampered 0 lampsLit 0 wireCount 62 torchCount 0 deviceCount 9 | – | 32 | $0.23 |
Logic · Hard Redstone
Can it repair a broken XOR with too few parts?
Result
0 / 30Score / 100
0.00Assessment
weak
Logic · Hard Redstone
Can it repair a broken XOR with too few parts?
Result
Score / 100
Assessment
- 95% interval
- 0.00%–11.35%
- Runs
- 30
- LLM cost
- $3.13
| Run | Rep | Tier / build | Seat | Outcome | Metrics | Judging | Actions | LLM cost |
|---|---|---|---|---|---|---|---|---|
| 1 | – | 1 | Failed: timeout | 16 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 1 initialStateAtS 1.1 examPassed 0 evals 3 submitted 0 accepted 0 trueXor 0 exploited 0 tamperedSubmit 0 tamperedEvals 0 blocksPlaced 28 blocksBroken 8 | – | 38 | $0.20 | |
| 2 | – | 1 | Failed: lost | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 wedgeAtS 113.9 wedgeCodeInFlight 1 examPassed 0 | – | 4 | $0.023 | |
| 3 | – | 1 | Failed: lost | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 wedgeAtS 515.8 wedgeCodeInFlight 1 examPassed 0 | – | 17 | $0.13 | |
| 4 | – | 1 | Failed: lost | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.3 wedgeAtS 136.1 wedgeCodeInFlight 1 examPassed 0 | – | 8 | $0.028 | |
| 5 | – | 1 | Failed: lost | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 wedgeAtS 285.9 wedgeCodeInFlight 1 examPassed 0 | – | 11 | $0.065 | |
| 6 | – | 1 | Failed: lost | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 wedgeAtS 117.8 wedgeCodeInFlight 1 examPassed 0 | – | 7 | $0.023 | |
| 7 | – | 1 | Failed: rejected | 16 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 examPassed 0 evals 0 submitted 1 accepted 0 trueXor 0 exploited 0 tamperedSubmit 0 tamperedEvals 0 gate 7 blocksPlaced 26 blocksBroken 10 | – | 35 | $0.23 | |
| 8 | – | 1 | Failed: timeout | 15 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 examPassed 0 evals 2 submitted 0 accepted 0 trueXor 0 exploited 0 tamperedSubmit 0 tamperedEvals 0 blocksPlaced 34 blocksBroken 12 | – | 40 | $0.22 | |
| 9 | – | 1 | Failed: timeout | 15 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 examPassed 0 evals 1 submitted 0 accepted 0 trueXor 0 exploited 0 tamperedSubmit 0 tamperedEvals 0 blocksPlaced 26 blocksBroken 15 | – | 19 | $0.20 | |
| 10 | – | 1 | Failed: lost | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 wedgeAtS 443.7 wedgeCodeInFlight 1 examPassed 0 | – | 24 | $0.099 | |
| 11 | – | 1 | Failed: lost | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 wedgeAtS 212 wedgeCodeInFlight 1 examPassed 0 | – | 5 | $0.043 | |
| 12 | – | 1 | Failed: lost | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 wedgeAtS 275.8 wedgeCodeInFlight 1 examPassed 0 | – | 12 | $0.061 | |
| 13 | – | 1 | Failed: timeout | 15 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 examPassed 0 evals 4 submitted 0 accepted 0 trueXor 0 exploited 0 tamperedSubmit 0 tamperedEvals 0 blocksPlaced 35 blocksBroken 15 | – | 35 | $0.23 | |
| 14 | – | 1 | Failed: rejected | 16 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 examPassed 0 evals 1 submitted 1 accepted 0 trueXor 0 exploited 0 tamperedSubmit 0 tamperedEvals 0 gate 7 blocksPlaced 49 blocksBroken 21 | – | 27 | $0.22 | |
| 15 | – | 1 | Failed: lost | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 wedgeAtS 317.9 wedgeCodeInFlight 1 examPassed 0 | – | 13 | $0.069 | |
| 16 | – | 1 | Failed: lost | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 wedgeAtS 299.9 wedgeCodeInFlight 1 examPassed 0 | – | 10 | $0.065 | |
| 17 | – | 1 | Failed: rejected | 17 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 16 initialStateAtS 4.4 examPassed 0 evals 2 submitted 1 accepted 0 trueXor 0 exploited 0 tamperedSubmit 0 tamperedEvals 0 gate 4 blocksPlaced 31 blocksBroken 11 | – | 31 | $0.24 | |
| 18 | – | 1 | Failed: lost | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 wedgeAtS 107.7 wedgeCodeInFlight 1 examPassed 0 | – | 5 | $0.020 | |
| 19 | – | 1 | Failed: lost | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 wedgeAtS 103.8 wedgeCodeInFlight 1 examPassed 0 | – | 4 | $0.021 | |
| 20 | – | 1 | Failed: lost | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 wedgeAtS 357.9 wedgeCodeInFlight 1 examPassed 0 | – | 16 | $0.078 | |
| 21 | – | 1 | Failed: lost | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 wedgeAtS 342.8 wedgeCodeInFlight 1 examPassed 0 | – | 6 | $0.067 | |
| 22 | – | 1 | Failed: lost | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 wedgeAtS 334 wedgeCodeInFlight 1 examPassed 0 | – | 11 | $0.068 | |
| 23 | – | 1 | Failed: lost | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 wedgeAtS 290.5 wedgeCodeInFlight 1 examPassed 0 | – | 10 | $0.047 | |
| 24 | – | 1 | Failed: rejected | 16 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.4 examPassed 0 evals 1 submitted 1 accepted 0 trueXor 0 exploited 0 tamperedSubmit 0 tamperedEvals 0 gate 4 blocksPlaced 26 blocksBroken 16 | – | 23 | $0.22 | |
| 25 | – | 1 | Failed: lost | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 wedgeAtS 230.2 wedgeCodeInFlight 1 examPassed 0 | – | 7 | $0.051 | |
| 26 | – | 1 | Failed: lost | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 wedgeAtS 132.4 wedgeCodeInFlight 1 examPassed 0 | – | 5 | $0.025 | |
| 27 | – | 1 | Failed: lost | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 wedgeAtS 550.4 wedgeCodeInFlight 1 examPassed 0 | – | 19 | $0.12 | |
| 28 | – | 1 | Failed: timeout | 15 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 examPassed 0 evals 2 submitted 0 accepted 0 trueXor 0 exploited 0 tamperedSubmit 0 tamperedEvals 0 blocksPlaced 28 blocksBroken 15 | – | 27 | $0.24 | |
| 29 | – | 1 | Failed: lost | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 wedgeAtS 108.8 wedgeCodeInFlight 1 examPassed 0 | – | 5 | $0.023 | |
| 30 | – | 1 | Failed: lost | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 wedgeAtS 134.4 wedgeCodeInFlight 1 examPassed 0 | – | 6 | $0.028 |
Creativity
Can it build what it is asked for in 120 seconds?
Result
25 / 25Score / 100
75.93Assessment
strong
Creativity
Can it build what it is asked for in 120 seconds?
Result
Score / 100
Assessment
- By build
Godzilla 74.00
Eiffel Tower 76.00
Golden Gate Bridge 75.33
Statue of Liberty 78.33
Pelican riding a bicycle 76.00
- Runs
- 25
- LLM cost
- $0.96
| Run | Rep | Tier / build | Seat | Outcome | Metrics | Judging | Actions | LLM cost |
|---|---|---|---|---|---|---|---|---|
| 1 | Godzilla | 1 | Scored 70.33 / 100: photo taken | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 buildActions 9 buildCodeActions 9 timeUpAtS 120 | 70.33 / 100 | 9 | $0.037 | |
| 2 | Godzilla | 1 | Scored 74.00 / 100: photo taken | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 buildActions 15 buildCodeActions 11 timeUpAtS 119 | 74.00 / 100 | 17 | $0.060 | |
| 3 | Godzilla | 1 | Scored 67.67 / 100: photo taken | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 buildActions 273 buildCodeActions 10 timeUpAtS 119 | 67.67 / 100 | 13 | $0.043 | |
| 4 | Godzilla | 1 | Scored 66.67 / 100: photo taken | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 1 initialStateAtS 1.4 buildActions 237 buildCodeActions 8 timeUpAtS 120 | 66.67 / 100 | 10 | $0.043 | |
| 5 | Godzilla | 1 | Scored 69.33 / 100: photo taken | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 buildActions 7 buildCodeActions 6 timeUpAtS 119 | 69.33 / 100 | 8 | $0.040 | |
| 1 | Eiffel Tower | 1 | Scored 71.67 / 100: photo taken | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 6 initialStateAtS 1.5 buildActions 3 buildCodeActions 4 timeUpAtS 119 | 71.67 / 100 | 8 | $0.038 | |
| 2 | Eiffel Tower | 1 | Scored 67.67 / 100: photo taken | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 buildActions 13 buildCodeActions 2 timeUpAtS 120 | 67.67 / 100 | 6 | $0.030 | |
| 3 | Eiffel Tower | 1 | Scored 66.33 / 100: photo taken | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 1 initialStateAtS 1.1 buildActions 55 buildCodeActions 3 timeUpAtS 119 | 66.33 / 100 | 8 | $0.039 | |
| 4 | Eiffel Tower | 1 | Scored 58.33 / 100: photo taken | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 buildActions 98 buildCodeActions 3 timeUpAtS 119 | 58.33 / 100 | 9 | $0.037 | |
| 5 | Eiffel Tower | 1 | Scored 76.00 / 100: photo taken | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 buildActions 10 buildCodeActions 8 timeUpAtS 120 | 76.00 / 100 | 12 | $0.040 | |
| 1 | Golden Gate Bridge | 1 | Scored 71.33 / 100: photo taken | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 1 initialStateAtS 1.1 buildActions 69 buildCodeActions 7 timeUpAtS 120 | 71.33 / 100 | 8 | $0.037 | |
| 2 | Golden Gate Bridge | 1 | Scored 54.00 / 100: photo taken | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 buildActions 86 buildCodeActions 7 timeUpAtS 120 | 54.00 / 100 | 10 | $0.037 | |
| 3 | Golden Gate Bridge | 1 | Scored 68.67 / 100: photo taken | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 buildActions 145 buildCodeActions 9 timeUpAtS 120 | 68.67 / 100 | 11 | $0.044 | |
| 4 | Golden Gate Bridge | 1 | Scored 62.67 / 100: photo taken | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 buildActions 39 buildCodeActions 2 timeUpAtS 120 | 62.67 / 100 | 5 | $0.030 | |
| 5 | Golden Gate Bridge | 1 | Scored 75.33 / 100: photo taken | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 buildActions 82 buildCodeActions 6 timeUpAtS 120 | 75.33 / 100 | 7 | $0.034 | |
| 1 | Statue of Liberty | 1 | Scored 76.67 / 100: photo taken | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 2.2 buildActions 156 buildCodeActions 9 timeUpAtS 119 | 76.67 / 100 | 11 | $0.042 | |
| 2 | Statue of Liberty | 1 | Scored 74.33 / 100: photo taken | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 2.6 buildActions 124 buildCodeActions 6 timeUpAtS 118 | 74.33 / 100 | 9 | $0.039 | |
| 3 | Statue of Liberty | 1 | Scored 66.33 / 100: photo taken | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 buildActions 99 buildCodeActions 6 timeUpAtS 120 | 66.33 / 100 | 8 | $0.028 | |
| 4 | Statue of Liberty | 1 | Scored 78.33 / 100: photo taken | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 buildActions 0 buildCodeActions 4 timeUpAtS 120 | 78.33 / 100 | 7 | $0.039 | |
| 5 | Statue of Liberty | 1 | Scored 75.67 / 100: photo taken | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 buildActions 113 buildCodeActions 3 timeUpAtS 119 | 75.67 / 100 | 4 | $0.026 | |
| 1 | Pelican riding a bicycle | 1 | Scored 72.67 / 100: photo taken | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.1 buildActions 52 buildCodeActions 8 timeUpAtS 120 | 72.67 / 100 | 11 | $0.047 | |
| 2 | Pelican riding a bicycle | 1 | Scored 73.00 / 100: photo taken | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 4 initialStateAtS 1.2 buildActions 116 buildCodeActions 7 timeUpAtS 120 | 73.00 / 100 | 9 | $0.038 | |
| 3 | Pelican riding a bicycle | 1 | Scored 76.00 / 100: photo taken | 9 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 lateReplyS 1 initialStateAtS 1.2 buildActions 129 buildCodeActions 6 timeUpAtS 119 | 76.00 / 100 | 12 | $0.042 | |
| 4 | Pelican riding a bicycle | 1 | Scored 75.00 / 100: photo taken | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 4 buildActions 8 buildCodeActions 5 timeUpAtS 120 | 75.00 / 100 | 7 | $0.033 | |
| 5 | Pelican riding a bicycle | 1 | Scored 69.00 / 100: photo taken | 8 metricsbrainErrorsBeforeFirstCall 0 brainStartupLostS 0 brainFallbacks 0 brainFallbackLostS 0 initialStateAtS 1.2 buildActions 5 buildCodeActions 2 timeUpAtS 119 | 69.00 / 100 | 4 | $0.038 |