Headsets like the Bigscreen Beyond 2 are basically the weight and size of goggles. Wearing headphones isn't actively comfortable either but very few people would say that that is prohibitively uncomfortable relative to their desire to listen to music. It's not unreasonable to think that the privacy and convenience of a VR workspace could eventually reach that level of convenience for a significant number of people.

The real issue for replacing monitors seems to be screen fidelity.