To each their own but I have a matte M4 Pro and I don't like it, and the screen is noticeably worse than my glossy M2 Pro.
There's a graininess to the screen that makes it feel a little worse at all times, meanwhile I never had a problem in daylight just cranking brightness into the XDR range using Lunar.
It's especially noticeable on light UIs, where empty space gets an RGB "sparkle" to it. I noticed the same thing when picking out my XDR years ago, so it seems like they never figured out how to solve it.