Raising my hand is not punishment. People are free to fear I will slap them but I didn't do it until I do.
Yes, the settings play a roll of course. The joke is best with other males of the same age. It's not funny with kids or woman.
Social contract, rule in my head? I don't know if there is a difference.