I think the problem is that Finder searches too much stuff by default. The same problem is true of modern windows search, iOS search, and Android.

First thing I do on all of them is have it only search local stuff. If I want to do a damn web search I'll open my browser of choice and use Kagi. On iOS I restrict it even further to only show local apps and settings. Massively improves the speed, latency, etc etc.