I stopped trying to understand. Encountering a 404 on my site leads directly to a 1 year ban.