My assumption is that any Wordpress setup whatsoever allows anyone to execute code remotely.

Indeed, it's a foothold into a network.