I found it really difficult to figure out if it is safe to turn on web search in a corporate (or privacy critical) environment. The AI companies generally seem to claim it’s safe but looking at this + the general ability of Google Search Console to display search queries, the answer seems a no? Did anyone already found definitive proof either way (beyond the bug(?) of this article)
I definitely wouldn't! Beyond the "glitch" I'm reporting here where full prompts are seemingly sent to GSC, it may still be that searches are scraped... meaning that while it's less obviously personal than a raw prompt it still could leak user intent.
I don't think any privacy critical topics belong to an AI you don't control yourself.
the moment that prompt is typed to a third party, then we must assume that it's stored and will be eventually used for statistics or any other reason, it's a bit insane how we went completely backward in security since GPT 3.5, we have people defending privacy policies of tech giants but they are known to constantly breach them :/