The people unwilling to work from home, and thus require extra costs for the company like rent for the office
Of course large companies have further inefficiencies, where middle manager incentives are not aligned with those of the board, which are not aligned with those of the owners (all of which boils down to management layers being unable to reliably measure the worth of the layer they manage)