I suspect it's more that few people, even at "AI" companies, understand how AI works or how to apply it. In an environment of such uncertainty, a certain class of person feels safer physically sharing a room with his colleagues: this person can "read the room" and exhibit "taste" by aligning his opinions with some emerging consensus, picking up on tiny social cues to keep himself on track.
In a remote environment, by contrast, these social signals aren't as strong. Our room-taster is forced into object-level arguments. He might be revealed as ignorant. By the same token, if a company is remote, it needs some established workflow to make progress. Workflow means words written down somewhere. Writing means accountability. Safer to just vibe.
In case it's not clear, remote work is beneficial: it forces a company to develop a level of rigor that helps it interface better with reality.
Every alleged "collaboration" efficiency the in-person model produces comes at the cost of enlarging a pile of accumulating social-technology debt incurred by substituting vibing, room-reading, and charisma for writing, debate, and accountability.