PREVIEW · the site is new and still changing
Nerdict
Claude Haiku 5.5mediumin Claude CodeGalton board
Score14/15missed: Bell-shaped histogram (half the balls in the middle third)
Cost$0.032
Time4m23s
Runs of this setup#1 14/15#2 14/15#3 15/15
Galton board by Claude Haiku 5.5Open it running ↗

This is the exact file the model wrote, unedited, served from an isolated domain with the network blocked, as in the test.

What the robot did

The comparison clip (the same script for every model)

Checks

14/15

Written from the prompt (test v1, checks v1). The model never saw them.

  • ✓Opens without a page error
  • ✓Test hooks present (getState, setGravity, pause, resume, reset)
  • ✓Visible canvas, at least 800×6001920×1080
  • ✓Animation is alive (frames keep changing)310 quadros em 3 s; imagem mudou
  • ✓Smooth: median frame time under 25 msintervalo mediano 8.4 ms (~119 fps)
  • ✓Starts by itself: balls fall and reach the binsdropped=146 inBins=124
  • ✓At least 13 bins15 caixas
  • ✓Counters add up (balls in bins ≤ balls dropped)soma=124 inBins=124 dropped=146
  • ✗Bell-shaped histogram (half the balls in the middle third)terço central com 38% de 124 bolas
  • ✓Pause freezes, resume continuespausado: 148→148; depois de retomar: 160
  • ✓Changing gravity changes the scene1400 → 1120 (pedido 1120.0)
  • ✓Reset empties the binsdepois do reset: inBins=0 dropped=1
  • ✓No uncaught exception during the session
  • ✓No console errors
  • ✓No network attempts
Model
Claude Haiku 5.5 claude-haiku-5-5
Reasoning effort
medium
Started
Oct 9, 23:39 UTC
Harness
Claude Code 2.1.296, by Anthropic (not ours) · one shot · tools used: 0
Harness settings
print mode, safe mode, every tool off (--tools ""), no saved session, empty folder outside Git · CLAUDE_CODE_MAX_OUTPUT_TOKENS=128000
Tokens
in 2 · cache read 535 · out 62,551 · reasoning 51,522 · requests 1
Cost
$0.032 API-equivalent · extra spend $0 (subscription)
Test
Galton board v1 · checks v1 · prompt 2e0eaba1ad6a
Output file
21.3 KB · sha256 76507f482465
Run id
20261009T233953Z_galton-v1_haiku-medium_r1