Tried that. I kept getting the 'we don't have the budget right now, but we'll make it up to you soon, promise'. Two years later I still didn't get more than 1.5% increases in salary, despite increases in responsibility and managing multiple offshore developers with a higher title than I had.
Put in my notice, got a call from the skip-level manager expressing surprise and how I meant so much to them, they need me, and what would it take to keep me. I said I got a significant raise in my offer (and I did, was about 60%), and asked for 30% on top of that to stay, and he just said "Wow. Well I can't do that. I was was thinking more like 20%."
And if they had given me the 20% earlier, maybe I wouldn't have gone job searching in the first place to get that 60% increase. So I guess in a perverse way I should thank them for being so stingy?