100 miles? My dude, that is a circle from Poughkeepsie to the tip of Long Island. Forget one-story single-family housing, there is farmland in that circle. There are hundreds of square miles of state parks in that circle.
If people were willing and able to commute that distance you could easily quintuple the housing stock in that area building nothing but one story SFH.
Manhattan itself has a median height of 4-5 stories; the outer boroughs bring that down to 2-3, because commuting from Far Rockaway to midtown is already a schlep.