If you have a range (-inf, inf) and you split it at some random C, even though there are still infinite values on either side, the probability you choose another number on the left side of C is (p) and on the right side is (1-p) regardless of how you choose the next number. That's what makes these probabilities finite and makes the math work out.