What about those who abstained from voting? The hole in the 'consent of the governed', 'you got what you asked for' mythology is that there is no way to withdraw your consent.

Imagine giving inmates the 'freedom' to vote for their warden. The outcome of such an election would have no bearing on the morality of their imprisonment.