This should be trivially demonstrable if it actually works. Cosine similarity is not a good metric, however, for attention compression.

[flagged]