At some point, you may get to the level where you're happy with your comp and happy with your responsibilities, in which case it might actually be best to stay around as long as you can. Not my cup of tea, but it's definitely something to think about.
In other words, good on you for looking around after a few years!
Luckily this is becoming less likely now that more companies are allowing remote work. I live in a relatively small city and have interviewed at every local company that interests me. My previous employer was by far the highest paying of all of them. I was able to find a remote job that broke my golden handcuffs by almost 2x.
Starting all over again kinda sucks. The older I get the less I look forward to doing the hustle to gain cred in new orgs.
All that to say: you aren't wrong. If you're in that position and you don't want to leave, that's really the company's problem and not yours. Do your own thing! I support it 100%! (Not that you need my support, but you have it anyway!)