Free-form collaboration has been a lot harder at my startup in a remote setting. The remote arrangement may benefit productivity when people are mostly working in silos, just crunching out code, but if you need to brainstorm or whiteboard something it's a genuine downgrade.

Lots of companies will be switching to a part-time-remote model, which makes the most sense to me