> LLMs do something more complex and far more effective than memorise-regurgitate

They literally do not, what are you talking about?

What kind of training data do you suppose contains an answer to "how to build a submarine out of spaghetti on Mars" ? What do you think memorization means?

https://chatgpt.com/s/t_6942e03a42b481919092d4751e3d808e