This is a big part of it. Almost anyone who lived in a large house in the past would have "summer rooms" and "winter rooms" - rooms that were more comfortable during those times.
They'd take more to heat because they often leaked, but they were cooler in the summer also.
Now we heat and cool all the rooms, even on those same older houses.