This has nothing to do with Moore's law. It's about neural networks.

Can we say that algorithmic speed-ups are sufficiently rare that they are usually impressive?

This isn't any algorithmic speedup.

[deleted]