It absolutely is a valid concern when the other party controls all the wealth, and guns, and governments! Unless you like losing anyway.

Do you think the civil war was a pleasant or productive one for anyone?

The British did it a different way re: slavery, and notably did not burn half their country to the ground - and still banned it.