It's not a matter of trust so much as it is human nature. Even good employees are more likely to slack off given the temptation of essentially unsupervised work.
Another way to look at it is not that the employees are remote, but that the manager is phoning it in. It's hard to be a dynamic leader through a Zoom window.