The light is not incapacitating, it's simply an unnecessary annoyance.
People do love windows, but people also love window blinds that they close when the light points directly into a room. Especially if you are forced to face that window.
People who spend a lot of time outside gravitate towards wearing hats and sunglasses.