The reason given is: "it's important to have social contacts with the other colleagues that are not in your team". If people thought that was important then they'd go to the office more often than required. It seems like they don't, so they won't.
It's frustrating and a bit mad to see management push these decisions when there's no valid reason being given.