If bots could be forced to pay per crawl somehow, it would subsidize nearly all legit user traffic.