I'd rather stay 6+ hours in meetings in more comfortable clothes (loose shorts) and sitting in a more comfortable chair - not to mention the lack of people wanting me to leave the meeting room because of THEIR meeting.
Yes, communication suffers to a certain extent, but occasional visits to the office eliminates the problems with 1:1s you mention. And at least in my experience, this small degradation of in-person communication isn't such a big deal.
So if you surveyed me, I'd say "Please let me stay home!". Also, if IC work is "great to do remotely", I'd rather see my team at peak productivity remotely than indulging any possible desire I could have to talk to them in person. As a manager, I exist to unblock and help my team, so what's best for the team is best for me.