Its not really a matter of size as it is of quality. I personally wouldn't mind a lot more genius rocket scientist supermodels being born. Our best chance to stave off extinction is not to bury our heads in the sand and hope we last on this one rock but to expand. Growth is not in itself the evil, limited resources is and that is what should be tackled. If humanity had limited itself to the size that some people think is sensible from the very beginning you wouldn't be enjoying the comforts like your room and fancy computer that you are now.