I think that part of the resistance is that if you have people who work remote, the bonds you build with the company and your coworkers can potentially be less strong than if you were there in person. This may make it easier for employees to job hop.
Another reason could be real estate related. If you signed a long term commercial lease right before covid hit, you want to make sure that you're getting your moneys worth.