Correct me if I am wrong, I think this is related to the term "covariate shift" (change in model input distribution x) and "concept drift".

The interesting part is that its then not possible for true AGI with the current approach, since there is no ceiling/boundaries to "contain" it?