How about "throwing the baby out but keeps the bath water"?

Which is more appropriate for this scene I think.

LOL