I mean this is a huge potential issue with high intelligence AI systems (HIAI maybe we'll call it one day). We already see AI develop biases and go into odd spiritual states when talking with other AI. They inherit the behaviors in human data.

I've seen people say "oh this will just go away when they get smart enough", but I have to say I'm a doubter.