Suffer how exactly? The kids will have a father outside of prison, two sets of grandparents and several times more money devoted to them than the median American income.
If anything being kept away from the care of their fraudster unapologetic mother would be a boon , not suffering.