Who defines what is extremist propaganda? The people who win the propaganda war and get to label the other side as extremists is the answer.

Extremism can be more-or-less objectively defined in terms of difference from the mean/median. Measurement is tricky but just because something has fuzzy boundaries doesn't mean it's meaningless. Especially when something is not near that fuzzy boundary.