The real trouble is for the middle managers trying to justify their jobs. They only know how to measure your productivity by the amount of time you spend at your desk, and they don't trust that you're working if they can't see you.
As businesses get better at measuring the productivity of remote workers by means other than time spent visibly in their seats, these middle managers won't have a role anymore.