If it's just you and a handful of other people who aren't even on your team/people you directly work with, you're gonna be sitting in video calls, and typing away into Teams/Slack/whatever just like when you're at home. You're working from home at the office. Except it's probably worse because it's you and a bunch of other people in an enclosed space, all hearing every other person chatting away in a different video call, feedbacking into each other's calls. The only benefit at that point is it's a change of scenery and maybe an escape from the wife and kids.
Not all communication needs to (or even should) be all to all. I can benefit from being able to directly discuss a problem or a design question with a colleague who's also at the office even if others are remote.
My workplace is pretty much optional remote. I go to the office most days, as do some others, while many more are remote most days. But usually at least one of my closest coworkers is also at the office, so there can be benefits to communication.
I feel it's a pretty good compromise. I'd feel less comfortable and focused either at a deserted or fully crowded office. Optional remote is still good for some focused work or if it makes scheduling more convenient.