What do you mean there is no uniform distribution over any infinite set? There is the uniform distribution over [0,1] which is both infinite and not even countable.
I'm confused.
I'm confused.
Perhaps I should have stuck to natural numbers in my previous comment, otherwise yes, you can have uniform distributions with respect to some additional structure of the probability space (like [0,1] with the Lebesgue measure you suggest).