My problem with "e-voting" has never been the security aspect, but how easy it would be to manipulate. Given how even some elections can be, just getting that last 1% of votes (I know the American system is somewhat different, as you need mandates, not votes, but I'm talking generally) could tip it in your direction. With traditional voting, a person usually has to meet, in person, to vote. With "e-voting" you could easily forge tons of votes, even with actual people, just by social engineering and forging of documents.