Yes, I think the augmentation of LLMs with (hopefully eventually higher dimensional) world models will prove very interesting for all this.