No, I think if you paused the game while the LLM is thinking it will still fail.

Even outside of controls based games, LLMs fail on sokoban like puzzles weirdly enough, see MazeBench, they’re also not that good at chess, probably around 1600 elo.