Glass doesn't need to be poorly insulating. Double and triple paned glass are great at insulation. Some even use vacuum, at which point you're basically building a giant Thermos. Getting a good seal is still tricky. Unwanted solar heat or unwanted heat escape via infrared can be modulated with windows that have adjustable reflectivity in the infrared. Unfortunately, it's expensive to build that way! But there have been a few attempts at this approach in the last decade, mostly in places like Norway or Quebec.