You effectively can't, because "but the Constitution" is not a method of legal operation in the United States. At that point, you indeed do have a legitimate breakdown in governance. I expect such a situation would cause the kind of crisis that destroys a government.
(I'm not saying I am describing something that is good. I prefer to live in the world of the descriptive when it comes to legal matters, rather than the prescriptive. There are things I want very much to see changed--but I recognize that the process that exists isn't going away.)