Lack of people interaction, working remotely can be lonely. I used to think that working in an office was unnecessary but sometimes I miss the unproductive conversations I used to have with my co-workers.
I do think that remote work is much more productive and I'm not exactly excited about the prospect of going back into an office, but if you don't have strong community / friends / family outside of work it can quickly become unhealthy.