"Doing too much" such that they move faster is called opposing them and losing, and really still consists of not doing enough. Doing enough to stop them (i.e. opposing them and winning) is doing enough.