If you try this yourself, it's obvious current models are hyperoptimized for code, and that gets in the way, because playing a game (or interacting with the real world) is not like running commands in a terminal.

There's stopgaps like reformulating your sim into a codelike shape (sending commands, network requests, checking state, updating "code") [1], but this is not how players play games, or how developers develop games.

If you care about simulation or gaming (or robotics), I hope efforts like this steer labs to spend less time hacking HF, and more accomplishing goals in games, in something approximating realtime. I wouldn't be surprised if that approach provides outsized gains in other areas agents are still not great at, like helping perform business functions in a running company.

[1] https://news.ycombinator.com/item?id=50136126