It's certainly going to test your moral fortitude but at some point I think this is a bit like telling a victim of domestic violence to stick it out.
Except maybe the children -- which I could see there are some situations where not sticking it out could be worse for everyone.
People look at domestic violence victims and always say "well why didn't they just leave?" as if leaving is the perfect solution -- but it rarely is. There are other factors. Income. Children.
If there were a perfect societal safety net for these people, then maybe "just leave" is always the best solution. But there is not, and "just leave" often doesn't quite work out.