Yes, naively understood in his sense 'best' word means that you pick the word with the maximum score, instead of sampling from the distribution.

That doesn't actually give you the 'best' text in any human sense of the word. Just like playing the 'best' move in Poker without sampling leads you to lose a lot of money.