I never commented a lot but still ran into trouble - with my voting. I was silently banned from voting and I have no idea when. Now I just read - very liberating! So, thanks HN and go to hell.
It needs to be at least 2 for your votes to count (unless it's now changed). The calculation is something like: over your n most recent comments (for some n), and the top score is discarded.