This place would look like 4chan if it wasn't for the moderation.
Moderation absolutely drives the culture, by setting a tone that drives away certain users while attracting others.
In other words what ever issues a site has are inherently due to moderation whether it be a choice on the part the moderators or a lack of resources to moderate as they would like to.
I don't think we're actually disagreeing. Yes, moderation is key, but ultimately people post the content. As you say, it's a matter of attraction. But if the target group of attraction is empty, there's no amount of moderation that can help that.