I mean when lists are opt-in and users have to specifically choose what lists to subscribe to then well… kinda tough shit if you end up on one that many people are happy with. That's the point of putting moderation in the hands of users, they're allowed to block you for any number of weird reasons.
It sucks when server operators group together because it effectively becomes a centralized moderation team that makes decisions for users with tenuous implicit consent but user moderation lists aren't that.