English is not my mother tongue, so all I can say is no, that's not how communication works (of course you can think whatever you want or your neurons conjure up, I can't argue with what you think). Discourse analysis revolves around the dynamics of speaking, speakers and conversations: gender, age, empathy, attention there are lots of factors in play that decide who speaks and how or when the other party or parties can take turn (or whether the turn is given). Taking turns is not a social contract; it's a rule in your head. You're free to decide to punish people for violating rules in your head, but depending on the level of punishment, you may end up in court.

Raising my hand is not punishment. People are free to fear I will slap them but I didn't do it until I do.

Yes, the settings play a roll of course. The joke is best with other males of the same age. It's not funny with kids or woman.

Social contract, rule in my head? I don't know if there is a difference.