At my (non-US) voting location, we put marked ballots into big plastic boxes. After the polls closed, the ballots were counted by volunteers, and the counting was supervised by other people to make sure it was done correctly.
Nobody had to worry about the boxes being tampered with, or about "unauthorized" people gaining access to them before or after the election, because they're just boxes.
If your election can be trusted only if only "authorized" people interact with voting equipment, then it can't be trusted at all. Obscurity has no place in elections.