But does it actually work, or is it something made up because it sounds cool.

It's an improvement, but obviously you're still limited with effective context size, and everything over it is marginal improvement.