> What if I want my content freely available to humans, and not to bots? Why is that such an insane, unworkable ask?

Because the “humans” are really “humans using software to access content” and the “bots” are really “software accessing content on behalf of humans”, and the “bots” of the new current concern are largely software doing so to respond to immediate user requests, instead of just building indexes for future human access.