Some subset of people who want to work in an office want to do so only with people who only work in an office as well. For these people, “everyone do your own thing” is not a satisfying solution. And it doesn’t have to be! Work doesn’t have to satisfy everyone.
If you work with people like this and say, “just do your own thing, it works for me” then you are trying to control other people because it pleases you better.
And again, there is nothing wrong with this. You are looking out for yourself, which is fine. It’s then up to your employer to make a decision on policy and then the employees decide if that’s a policy they want to work under.