There are indeed scrapers which use tens of thousands of distinct IPs, and so rate limiting them isn't a solution.