>LLMs are not generating better compilers nor better kernels than what exists.

Not LLMs, but AI is inventing new hardware:

https://deepmind.google/blog/how-alphachip-transformed-compu...