Yes, if you're in the position to find a job elsewhere, do it. This is an uphill battle that you don't need to fight. And there's no guarantee that you would win -- reason is of no use here. The most perfectly-constructed rebuttal will not be effective.