I don't think your version of "serious damage" from this issue matches most voters. Even if this were a parliamentary system where sufficient public outcry could force new elections, or a "do over" recall was available (a terrible flaw in the state constitutions where it exists, IMHO), you'd still not be getting the U.S. administration you seem to want. You need to convince the public and then win elections, that's how change happens.