It does add separation from work and not-work. Take the headset off and you go from work to home without any commute.
I know plenty of people who had a shitty time and ended up dealing with a lot of mental health issues.
I'd be _fine_ with going to the office once every other week to just meet up, but not more than that.