...and why use LLMs specifically?

In many cases, other methods run faster/scale better/use less energy.

Because LLMs are one million times easier to use and they give very good results.