> Wasting applicants time should have consequences.

The consequence is that they don't get to enjoy your competence as an employee nor that of others who don't feel treated well, with implications for their future strength in the market. That's a much stronger consequence that being rude for a moment to somebody who doesn't care anyway.