I'm not too worried about it because the first segment of society is doomed to be 'good but never great.'
AI lacks the ability to identify greatness because it's trained on the output of the average person who also lacks this ability.
It's going to create a new elite class of people who have good taste and the masses who have bad taste. Many current elites will end up with the masses. They may retain their wealth on paper, but it will be a cheap, low-quality existence but they will be convinced it's luxury.
I think eventually, everyone will get what they want, but not everyone will get what they need.
Taste is subjective, authenticity is not. People in #2 want human created content, even if it's not as "good".
My definition of bad taste is; will be derivative. These people will consume variants of the same thing over and over, not realizing it to be the case. They will be narrow minded and predictable. They will be afraid of any other ideas which doesn't fit the acceptable pattern of their tribe.
I replied above, but they're already like this.
True but I don't think we've reached the limit.
This is why I advocate for people to spend some time outside in nature and try to do something different once in a while because it's so easy to get stuck in a really small bubble. Especially when you exist in an entirely man-made, soon-to-be fully AI-controlled environment. You may lose your ability to have novel thoughts.
Some people are already there but the range of thoughts seems to be narrowing.
My biggest fear is being caught up in such group for financial reasons and trying to navigate some kind of linguistic and conceptual minefield everyday. I already encountered a situation like that twice in my career. Very tense environment. Feels like you're in a brainwashing cult and have to pretend to be one of them; it's really hard to pretend to be ignorant of certain kinds of information when you don't know what the full range of forbidden ideas is. Saying the wrong things got me fired both times; differences in our mental conditioning created very subtle tension/discomfort between me and management.
They will tolerate people who are 'running a simpler program' than themselves but they will absolutely not tolerate someone with a broader programming. Hence you have to pretend to be narrow-minded which is hard to maintain. This is why I like remote work.
The elites already have bad taste. They aren't going anywhere without tax and financial reform and the return of political donation regulation.