Nobody currently alive actually voted on anything related to the US Constitution, any of the first fifteen amendments, or many important laws, because they weren't alive. I don't see how the Thirteenth Amendment is any different from the many laws which were enacted and last amended before you or I was alive. Either the populace has consented to all of that body of law, or none of it.