That will let you verify that your vote is counted, but is there any way to verify that additional votes are not manufactured?
That raises the question of how do you avoid double-voting or voting for people who didn't vote. I think there's technical solutions to both.
Maybe have a separate record for "this person voted" and another record for "1 vote for X", with encrypted references back and forth? Then you could at least verify that there are an equal number of both records, that all the identities are valid and only used up to once, and tabulate the final results. It would still be possible for someone who didn't vote to have a false vote logged, but that is a more narrow attack.