However many downvotes something gets, the lowest score that will be shown is -4. The goal of this is to mitigate bandwagon downvoting. I'm not sure it actually works, because when I see -4 I just assume it's something significantly lower, but there you go.