It has an effect, 50% of the time it's positive, increasing the quality of the answer, and 50% of the time it's negative.

These models are already running with a temperature that is >0. This just replaces a random number with a slightly less random number.

That was my point, replacing one random sampling by another has exactly that effect.