I used to think as you outlined here, and then I realised that I would only care if they made a Third Reich comparison that I disagreed with. If they said Milo is literally Hitler, I'd... well, I would have been very confused because Milo is a tasty chocolate drink. But I wouldn't have considered it an offense... so the offense wasn't actually the use of unspeakable comparisons, it was the sin of doing so while disagreeing with me!
So I try not to judge quite so quickly now, though I probably still fail plenty...