Today most is probably live crawling during AI query resolution.

no, you get tons of infinite link web following