There's ways. A memorized "secret" that would be put on the ballot in addition to your vote could be used for you to verify a checksum.

The main issue is the hardware, and added complexity. But these are interesting problems that should be talked about.