you think they care about that ? they’d still crawl like this just in case which is why they don’t rate limit atm

It would of course need to be legally enforced somehow, with penalties high enough to hurt even the big players.