So you can frame anyone you disagree with as "intolerant", and then you are free to be intolerant to them.

Also I can be intolerant to you, because you are intolerant (to people you think are intolerant).

This is neither smart nor moral. This is logically inconsistent and breeds conflict almost by definition.