Do what you need to to make yourself happy.
If you don't, you'll be dead soon, or dead inside. And either way that's not sending a good message to your children.
You should show them a happy life, and if you need to make changes at home or at work, than do that—no matter how hard it is.