It's not really yours to give up, is my point. You're not looking at this from the employer's perspective, and it's making it hard for you to understand that what you want is only part of the equation.
You’ve got to do better if you expect to retain employment long term, and certainly if you expect to retain the privilege of working remotely.
You may have had a better experience. If so, then, with all sincerity, I congratulate you on your luck; I bear no ill will to those who happen to find genuinely good employers.
Just don't take your experiences as typical and use them to argue that the rest of us should act as if our experiences either didn't happen, or aren't common.
I've retained employment for nearly two decades, and have retained the "privilege" of working remotely for nearly half of that. I'm not concerned.