This is an interesting suggestion.
I think of looking at new submissions as a kind of "service to the community"-- more specifically, to the community I want HN to be. If the front page is filled with links I don't value, then it's partly my fault if I've failed to upvote submissions I would rather see on the front page (this, of course, means browsing "new" is a reward unto itself, but it's a somewhat abstract reward nonetheless).
Sometimes I wish HN wouldn't track average karma. That discourages me from commenting on new submissions that I believe won't get many eyeballs. Intellectually, I know my average karma shouldn't mean anything to me, but the fact that it's there for all the world to see exerts a gravity of its own. "You get what you measure."