Here are the voter registration requirements in New Hampshire, to pick a state out at random, for example: https://sos.nh.gov/media/nbhlz4bt/registering-to-vote-in-new...
You can literal simply pinky swear and sign a document in front of an election official at your voting place and time that you are an eligible voter to register, and then go vote. They have no practical way of truly verifying what you say in most cases. There are legitimate edge cases that need this, so that’s why things work this way.
For most taxpayers, that's the SSN, and its widely used for other purposes.
Republicans mostly seem to have a problem when people point out that their incompetence is causing them to leak publicly, e.g., https://news.ycombinator.com/item?id=28867562
[1] https://www.irs.gov/individuals/international-taxpayers/taxp...