Here is a simpler formula:
vote = max(10,floor(karma/1000))
If I get an upvote from tptacek, I'd get 10 pts but a down vote will send me to oblivion at once.At the same time noobs don't have voting power until they get enough karma, increasing comment quality.
Trolls who get below -100 will be automatically hellbanned.