Unfortunately scrappers are problematic enough that for more and more organizations alternative is to stop serving traffic.

For example OpenStreetMap is using nowadays this or equivalents to prevent downtime and/or runaway costs.