This does make me curious about the pattern of upvoting. It seems likely that usually people upvote without clicking on the referral link first, but I wonder what the percentage is.
For the record I have macwright.com as well as the top upvoted HN links in my RSS feed.