Even if the average person had a working understanding of cryptography, which I think is highly unrealistic to begin with, that wouldn't be enough to give the system credibility.
For the system to be credible and resilient against coups it must be possible for the average person to audit the system end-to-end. This is impossible to achieve with online voting, yet trivially achievable with paper ballot systems:
An observer can verify that ID is being verified, that voter list is managed correctly, that every person is issued 1 ballot.
When votes are being counted they can see each ballot and count along with the officials. The number of ballots in the box must match the number of issued ballots based on the voter list.
They can get a copy of the report where they verify that the counts are correct. Then they can verify that the authorities indeed used the same numbers for their polling place in the final counts. And because you have cooperating like-minded observers in every polling place, you know that the final count is correct.
It's like a human-powered Merkle tree.