> Not only does an LLM have perfect recall

This has not been my experience. These days they are pretty good at googling though.

They do not have perfect recall unless you provide them a passage in the current context and then ask them to quote it.

The 'lossy encyclopedia' analogy is quite apt