No. It's debatable. Many believe remote work is undeniably more efficient and the fulfillment you feel from high bandwidth conversations is a delusion.
Also, if we stipulate that my fulfillment from being in the office is irrelevant, that doesn't change the fact that other people will not conform to my preferred mode of communication. I'm fine with instant messaging, and a lot of people are, but in my experience, a majority don't or won't use it well.
The people who suck at communicating online suck in person too. At least online there's a record of who can't read or spell. And don't get me started on the hours I've had to wait while someone is in the hallway having a chat.
Anyway, I have other reasons for not wanting to work remotely too. I've seen many comments on HN from people that are very sure that the ideal for anyone technical is a private office that's utterly silent and undisturbed for concentration. That isn't me. I do get irritable if someone is having a long non-work conversation that's barely loud enough to be distracting, but I don't want to be shut up in a closet. People derive value from asking me stuff and vice versa.