> People have been correctly excited about the many "sudden" breakthroughs LLMs are making in Maths

That people ARE making, surely not machines. Like Terence Tao or Knuts did using the tool to their advantage, for example it would have been impossible for me to prove the same thing Tao did with an LLM. Same reason I believe programmers won't go away