It's one thing to move from amazing to not bad for 50% more pay. It's another to move from a good work culture to one that abuses your off time, expects you never to take time off, or forces frequent overtime.
I just recently moved from a place with very good culture and benefits to a contracting company with much worse benefits. Just going from five weeks vacation to two weeks alone really stings. And my pay only went up 10% ... it wasn't only the money, it was because I wanted something new, but I still have a growing sense of regret.