Google (and other search engines) gave you an easy and reliable way to opt-out of having your content indexed and linked to. People did in fact object pretty loudly every time Google attempted to surface the information on google.com rather than sending traffic to the source.