PREVIEW · the site is new and still changing
Nerdict
GPT-6.1 Solhighin Codex CLIGalton board
Score14/15missed: Bell-shaped histogram (half the balls in the middle third)
Cost$0.15
Time4m39s
Runs of this setup#1 14/15
Galton board by GPT-6.1 SolOpen it running ↗

This is the exact file the model wrote, unedited, served from an isolated domain with the network blocked, as in the test.

What the robot did

The comparison clip (the same script for every model)

Checks

14/15

Written from the prompt (test v1, checks v1). The model never saw them.

  • ✓Opens without a page error
  • ✓Test hooks present (getState, setGravity, pause, resume, reset)
  • ✓Visible canvas, at least 800×6001346×907
  • ✓Animation is alive (frames keep changing)372 quadros em 3 s; imagem mudou
  • ✓Smooth: median frame time under 25 msintervalo mediano 8.3 ms (~120 fps)
  • ✓Starts by itself: balls fall and reach the binsdropped=312 inBins=233
  • ✓At least 13 bins15 caixas
  • ✓Counters add up (balls in bins ≤ balls dropped)soma=233 inBins=233 dropped=312
  • ✗Bell-shaped histogram (half the balls in the middle third)terço central com 43% de 233 bolas
  • ✓Pause freezes, resume continuespausado: 315→315; depois de retomar: 342
  • ✓Changing gravity changes the scene650 → 520 (pedido 520.0)
  • ✓Reset empties the binsdepois do reset: inBins=0 dropped=3
  • ✓No uncaught exception during the session
  • ✓No console errors
  • ✓No network attempts
Model
GPT-6.1 Sol gpt-6.1-sol
Reasoning effort
high
Started
Oct 10, 19:48 UTC
Harness
Codex CLI 0.162.0, by OpenAI (not ours) · one shot · tools used: 0
Harness settings
isolated container with no global instructions, read-only sandbox; shell, browser, apps, multi-agent and web off; empty /work folder · imagem=nerdict-bancada-codex:0.162.0 · sandbox=read-only · time limit 60 min
Tokens
in 9,794 · cache read 9,472 · out 13,341 · reasoning 4,008 · requests 1
Cost
$0.15 API-equivalent · extra spend $0 (subscription)
Test
Galton board v1 · checks v1 · prompt 2e0eaba1ad6a
Output file
28.8 KB · sha256 9777395b970c
Run id
20261010T194817Z_galton-v1_sol-high_r1