This did not stop people in the past. You read of three-room New York tenements holding families of ten, or families with half a dozen children living in a single-room frontier cabin, and this was considered commonplace.
My parents raised eleven children in a typical four-bedroom suburban tract house.
I wonder why modern people would be different?