As a person, I would like people to think of me as fair. And that's for the workers to decide not a commenter on a forum.
How does paid vacation or benefits like health insurance fit into your model of the business existing to make money? You almost certainly provide those kinds of perks to your employees even though paying somebody while they are sitting on a beach somewhere doesn't directly help the business.
Think of work flexibility as just another perk. It's something you do to attract and retain the best people and allow them to do their best work.
They have to evaluate their employees and people who aren't doing well working remotely may require closer management, may lose their wfh benefits, or something else.
You are as necessary as that old lion, enjoying his pride, the day before the new lions come to town.
"Enjoy." --Daniel Tosh