Empirically, we now get more than 3x the yield per land area than 1960, and the trend is steadily rising (see graph link below).
Your argument is that it can't grow to infinity, which is probably true. But there is nothing indicting we're close to any hard boundaries.
https://ourworldindata.org/grapher/index-of-cereal-productio...