Generally speaking you shouldn't be able to impose your will on others

Sure, but in every democracy most laws pass with such just-about majorities.