Well, all of these are politics and ideology. It's OK to have an ideological bent of some sort or other. You can indeed be highly intolerant of those who are intolerant in certain ways. You can hate certain kinds of hate. And you can call out greedy callous bastards wherever you see them. It's basically being discerning.
GP is saying neo-Nazis are "not just politics, but also something worse". You're not really disagreeing with them, maybe just missing their point about some ideologies being worthy of planned exclusion from a civilized society. Aka the paradox of tolerance. That's what makes some political stances "not just politics".
I find a lot of the paradox-ness goes away when one look at such arrangements a peace-treaties. (Or at least, it gets subsumed into a broader set of respective and respectable dilemmas.)
For example, just because Country A "wants peace" doesn't mean they do nothing as Country B gets taken over by a revanchists regime declaring the treaty evil and massing troops the borders. It would be ridiculous (and depressingly realistic) for some critics to say: "They don't really want peace, or else they would be a nation of pacifists who would let themselves get annexed right now without bloodshed.)
I view this paradox as just an effect of poor framing. We should not look at it as “I am against intolerance/hatred/XYZ”, but “I want to minimize intolerance/hatred/XYZ.” The first focuses on local, case-by-case contexts, the latter in aggregate. Some XYZs, in some contexts, have properties that make them effective local tools to mitigate themselves in an aggregate context, which is probably a better candidate paradox here.