Yes. For this very reason I think that only the extremes (everyone is collocated or everyone is remote) work. Mixing of local and remote people doesn't (maybe except for external contractors, who know they are expendable (and adjust their daily rates to compensate)).