Ideally, assuming you would be voting with a key linked to your identity (SIN), both the IDs of voters and their votes could be entirely public and on your receipt.
The act of counting votes would be for a set of parties to be work with only the public list and given the private key(s) to generate results. The trust there should be similar to counting paper ballots, especially if independent parties combine subsets and arrive at the same result.