Given the fact that you have to be logged in to upvote, and after you upvote you can't re-upvote - yes you can tell what someone upvoted.
The system serves to record the arrows you've clicked, therefore this information must be stored somewhere. Someone with access to this this information should be able to determine "what stuff an account upvoted," unless the system has been designed to obfuscate the connections(i.e. accounts & clicked items) at the database level.
Edit: should have clarified that by user I meant a hash of name and password, so it's infeasible to calculate offline.