I do think models currently don't have enough source skepticism.
If you look at agent traces when asked to compare two options to help inform a decision, many of the comparison pages cited in research are often hosted by one of the companies being compared; nearly all are AI-generated AEO plays. Not deeply considering the motive of published information is currently a glitch that can be exploited, but the window will close.
I'm sure model providers will set up some crappy pay for play verification system for "trusted" product information, comparisons, and reviews.
Yes 100%. I see this all the time. You’re asking about a product and the LLM will cite a source from a competitor where the competitor will review the source and list a few positives about the product but lots of negatives. Then the LLM uses them in the response. So cheeky