I built a house last year, and had to work with a few different banks to finally get a construction loan. One of the fist ones said to me "1900 sq-ft? You shouldn't be building a house that small".
We made it work, but would have gone with a manufactured home before we would have built something with 3k+ square feet just to make the bank happy.