At lower levers in the engineering ladder, I'm OK with that. I mean, if you're a junior engineer, your job is to do whatever your manager has directed you to do at that moment. But my current rung is staff engineer, and my job is to move the whole company forward by finding sticking points and unsticking them. That doesn't mean doing people's work for them, but very often does mean making sure other people aren't blocked while they wait for something to happen.
I feel like at very senior levels, you can't really say "it's not my job". You're looking out for the whole organization, not just your direct team, and it's your responsibility to help everyone move ahead - even the ones who don't report to you.