Having to work harder at moderation seems acceptable to me. And it'd be fairly simple to implement a "You can't just say 'you suck' when downvoting. If you do, you lose your downvoting privileges permanently." policy.