Think a little more broadly here. If he thinks that someone would be justified in throwing a punch if he insults their mother, then he presumably thinks that he would be justified in throwing a punch in the opposite situation.
No -- you've got the roles reversed: the claim is that he will be imprisoned if he assaults the insulter, claiming that the insulter provoked him with "fighting words"