Maybe restrict users below a certain karma to X number of upvotes per day? That way, you need to consider carefully which stories you upvote. Comment upvotes could stay infinite.