The other factor to consider is that people who are too cold can layer up but someone who’s too hot doesn’t have an option other than working from home.
One thing which increased environmental concerns is leading to is reconsidering both of these given how expensive AC is. Getting people to dress appropriately for the season would lead to a big reduction in peak electrical load in much of the U.S. In some cities like San Diego where distribution capacity is constrained that’s the difference between having brownouts or not.