When I got married, my spouse and I told people to wear whatever they wanted because we didn't really care. I also never cared at all about what we were wearing on our dates because what I enjoy about spending time with people is not seeing them present themselves in a way that I tell them to. I would go to a restaurant in sweats if I were allowed to.
I fundamentally do not understand what reason everyone else should have to dress to please you compared to themselves. Seeing everyone else as props to fit your preferred aesthetic rather than people who's desires about their own appearances are more important than what you want them to look like just seems selfish to me.
It's a free country and you can dress as you please.
But people will judge you by how you dress, and you will miss opportunities as a result, and you'll never know that this is happening.
As I mentioned earlier, people do react to me differently depending on how I dress. And I've known many people who align with your views on this, and they've all wondered why opportunity passed them by (or they realized they needed to change).
Can I ask: suppose you were charged with a crime. Your lawyer showed up in track shorts. Would you get another lawyer? I sure would.