Indeed - just earlier this week I read Google AI summarize a query about testosterone, citing 3 sources. The first citation was a link to a NIH study (or of similar repute). Ok great. The second? Two spam (and explicit) websites existing solely to sell penis enlargement pills.

What was worrying is only some of the claims were supported by the linked study, and most of the response content was drawn from the spam sites.