We do not call people Nazis because we dislike them, we dislike them because they are Nazis. Most non-Nazis, when accused of being a Nazi, point out how their views differ from the Nazis. I won't claim it's always the case, but the people who argue they can't possibly be Nazis because Nazis are bad, and they are not, typically are.
The Nazis very much were an alt-right, anti-liberal group. They were more than that; I gave a whole list of core tenets to their beliefs. Overlapping some tiny amount doesn't make someone a Nazi. Hitler being a vegetarian is not an indictment of vegetarians. But if a person were to go through the list of those 6 things the Nazis championed and find themselves championing 4 or 5 of them, it should be cause for alarm.