Requiring voter ID disenfranchises marginalised and poor voters, who may not be able to obtain ID easily. I know several people who have no form of government issued ID.
It's different in countries like Germany and France, where compulsory national ID is a thing.
Rates of fraud and abuse are low enough that this isn't an issue. Technically I could go and vote in somebody else's name, and hope they also didn't vote, and I most likely wouldn't get caught. But if they did vote as well, then the double-vote would be noticed (people have have been caught casting multiple votes in the past) and would be investigated.