Convolution is a local operation.

Attention is a global operation.

[deleted]