Tolerance is a social compact and it requires mutuality. "My preference is to punch you in the face, if you claim to be tolerant you must accept that" is obviously foolish, no matter how much you dress it up.
> It is, of course, morally just to be intolerant towards intolerance
A Conservative might argue that Muslims are intolerant and thus should not be allowed in the country or that trans people are intolerant of people using the correct pronouns for them.
You can phrase pretty much any side of a political question as being either tolerant or intolerant with a bit of work.
And we determine who is right and who isn't through the power of reason and evidence.