Google, a very large company with nearly unlimited technical resources, continues to bus workers 40 miles down the peninsula every day because they want workers to stay on-site. Google, of all companies, could afford as much office space in SF as they need, yet they still choose to only have a relatively small satellite office there.
The experience of large companies that have large remote workforces and FOSS projects that have workers so motivated that they'll work for no pay probably doesn't translate well to a small startup that doesn't have the resources of a large company, nor the employees so motivated that they'll work for free.
Remote work, as you say, has it's challenges, and sometimes it's better to pay the money avoid the challenges than to pay the money to confront the challenges.