Assuming karma is added and removed one at a time, there's a number that's not particularly large where you can't add any more.