Would you not? It would look odd and draw a lot of attention simply for being unusual, but I'm struggling to come up with any way in which doing so would actually harm me.