What people tend to forget is that all totalitarian systems that came to power, have their origins form reactive movements acting to ineffectiveness or oppressiveness of existing systems. NSDAP was formed in response to worsening national situation. Reds and Whites were formed in response to worsening national situation. Italian fascism was response to political turmoil in post-war Italy. Quite a few European countries romanced with authoritarian rule (or went borderline fascist) in inter-war period.
Let me turn this question around: what if anti-nazi party came into power, and then to assure that no nazi party would ever come into power, it would implement its own authoritarian system? After all a lot of those governments enjoyed popular support during their rise to power, with people willing to give up their freedoms for sake of perceived security.
Back in McCarthyism it was better "dead than red". What if "its good to throw the nazi off the copter" is just a sign of our societies marching to new era of scare?