You're right, he didn't call them that. He called them garbage.
While unacceptable by presidential standards, it's extremely tame compared to the things Trump regularly says about groups of people (we could even just limit that to the things he says about liberals or Democrats), and the vocal support he receives from his supporters for these statements. The fact that this got so much attention is evidence that "double standard" would be an understatement.