I've probably been lucky that both the teams I've worked with have been small enough to get to know and strong at mixing async messaging, video calls, and occasional facetime to good effect for both coordination and camaraderie. Not everyone is set up that way; I can think of some previous off-site contract gigs I had which didn't fit that description and your downsides match my experience more closely there.
Overall, though, whether in-office or remote the worst work/life balance issues have always come from sheer workload more than anything else. If that's addressed remote work doesn't make it worse, just changes the moment to moment tradeoffs, and the gains from being able to flexibly context shift and not having to manage commutes are alone so strong I wouldn't want to give it up. Social isolation is a problem I'm willing to solve for myself (and at some level have to anyway).
I've moved to a hybrid work environment. I go into the office twice a week, which helps with these issues tremendously. It also means that my employer has to keep paying salaries that are livable within driving distance of our headquarters (I live about 20 minutes away). My biggest fear about WFH is that employers will wise up and start only hiring people willing to live in the middle of nowhere because they can live just as comfortably on half the salary.
No one should be relying on their job for their primary social experience. If you have never had a social life outside of it, you’re missing out on life.