The watermark doesn’t change the distribution, only per-token selection. I think not understanding that is the source of most people’s FUD.
The watermark doesn’t change the distribution, only per-token selection. I think not understanding that is the source of most people’s FUD.
There's no difference between those two things. The distribution that matters is the distribution of tokens that are picked not the distribution of tokens the LLM model passed to the selector.
On average the distribution of selected watermarked tokens is the same as the original distribution. You can test this experimentally.
I think there is a possible weakness in the context of the watermarker but that is not your claim iiuc.
The distribution of token "ple" being the same on average, but lower after "crum" and higher after "cou", is not no difference. It's irrelevant that the single-token distribution is unchanged if the joint distribution is different.
This comment disagrees with you: https://news.ycombinator.com/item?id=49324387
That comment merely says quality must be compromised. It doesn’t make it clear why that must be true. Empirical study seems to say that quality is not compromised, and looking at various proposed schemes, it seems intuitively true.