Can you imagine the flip-side of the anti-remote argument if the manager was remote and the team wasn't?
"What do you mean I got a bad performance review? My boss isn't even here."
"What do you mean I got a bad performance review? My boss isn't even here."
I'd like to think "pretty far" but it definitely depends on the organization. For freelancing, you might have to put in a bit of face time, but nothing's stopping you from charging very high rates and doing part of the work remotely.
It is hard to make it work, but is very beneficial and can be a competitive advantage when you get it right. Hey, you can now hire top talent regardless of geographical boundaries!