I agree that their comment was perhaps a bit uncalled for and rude. Even if it was meant in a humorous manner I think it was in bad taste. But there is no need to be equally rude to them in my opinion.