Having to serve 1000x more traffic from bots is completely unacceptable for most site owners as well.
The fact that this trade-off isn't obvious indicates you haven't tried to run a site at scale and make a living off of it.
Having to serve 1000x more traffic from bots is completely unacceptable for most site owners as well.
The fact that this trade-off isn't obvious indicates you haven't tried to run a site at scale and make a living off of it.
You are quite incorrect. I make a living off a website and 99.9% of my traffic is from bots. Literally hundreds of millions of requests from bots. The cost of bots is worth the cost of not harming legit users.