Yeah there is indeed a physical limit to human population.
And that physical limit is much closer to 100 billion people, than it is to 1 billion.
Population growth is already on the downward trend, and we are expected to reach population growth neutrality by 2040.